If other people could have gardens or fountains or views overlooking the ocean, they can have a cave. "That sounds nice. I haven't been back to the Underdark in years, and most of the time I've spent in caves since is because goblins or someone moved in and took to harassing travelers."

Which... look, maybe there are goblin communities that are nice places to visit, but Bel is pretty certain that 'turns to banditry' also means that your home base will be unpleasant by your own people's standards, let alone outsiders'.