I used to love working in downtown SJ for that very reason -- no problems with the commute. On the other hand, walking out for lunch at mid-day in a "big city" and not seeing anyone on the sidewalks is a bit "there's been a nuclear bomb and only a few of us are still alive" kind of thing.

I think of SJ as a suburb -- some people actually work there, but most drive to someplace else. Palo Alto is also a suburb: some people actually live & work there, but most drive elsewhere, and almost everyone goes "someplace else" when they want to do something cultural.