Before I take this kind of photos last year, a photography master raise up this point to me(because I have the same problem with you when I took that). After i accept it and try, i found that it is more better, the photo looks more lonely I think.
But I want to tell all people that the road is the object, I took this picture when all pedestrians were gone. ( the road without people is what I want to have)