Bomer loves family time with boyfriend Simon Halls and three kids in NYC