I definitely see where you're coming from, but remember, the current situation isn't normal. I used to live by myself in an apartment working from home too. I still went out to lunch with friends and business associates. I could meet friends for drinks after work all over the area and didn't have to worry about my commute home. I'd work in co-working space, at coffee shops, on vacation, or anywhere else I wanted.

That being said, if I was in a new city with no friends or family, I would 100% want to have an office to go to.