The “contentious” Mosman home caused countless objections from neighbours who didn’t want to lose their harbour views.