Andy Cohen Jokes That He Worries He's Going to 'Squeeze' His Adorable Son Benjamin 'Too Hard'

You can never love your child too much, but Andy Cohen‘s physical affection for his son Benjamin Allen might need to be pulled back just a tad.

“I’m worried I’m gonna squeeze him too hard,” the new dad joked of his 10-week-old baby boy to Jimmy Fallon during a Thursday visit to The Tonight Show.

Fallon ribbed his guest about coming to his apartment building to visit “Ben Cohen,” who’s the star of the family now — but the Watch What Happens Live host wouldn’t have it any other way.

“It’s so great, man,” Cohen, 50, raved of being a first-time father. “It’s been such a journey, and it’s been so interesting trying to figure out how to do everything. [Even just to] take him outside, I’m like, ‘How do I do this?’ “

Want all the latest pregnancy and birth announcements, plus celebrity mom blogs? Click here to get those and more in the PEOPLE Parents newsletter.