It’s been four months since Hugh Hefner turned 91, but in a new interview with The Hollywood Reporter, the Playboy founder’s son Cooper reveals that his dad hasn’t been doing too well. “It’s tough to watch him struggle,” the 25-year-old shares, “but I’m just happy it’s physical and not mental.”

Despite his deteriorating health, the magazine mogul tried to put rumors to rest on Father’s Day, spending the holiday with Cooper and his other son Marston. The duo was all smiles alongside Hef, captioning a black-and-white photo, “Backgammon with the family.”

MORE: Former ‘Playboy’ Bunny Bridget Marquardt Isn’t on Good Terms With Hugh Hefner

Fans shared their excitement at seeing Hugh in his signature silk pajamas on the social media platform. “It’s good to see your dad, he’s been quiet lately,” one follower wrote, before another added, “Like father like son.”

View this post on Instagram

Backgammon with the family #FathersDay

A post shared by Cooper Hefner (@cooperbhefner) on

Last year, reports surfaced that Hugh was on his deathbed. Cooper quickly put those rumors to rest, telling E!, “He’s doing fine. My dad has always made the joke that if the mansion was your house, why would you want to leave?”

MORE: Crystal Hefner Removes Her Breast Implants, Says They “Slowly Poisoned” Her

However, he did admit, “I think because he has stepped back from the day to day operations of the business, people have thought that his health was not very good. The reality is he has a really bad back — that happens when you’re 90 — and he is enjoying life at the mansion.”

hugh hefner cooper crystal harris getty

Hugh with his son Cooper and wife Crystal in 2014.

Last September, Page Six reported that Hugh was down to 90 pounds and extremely frail. “His people are really trying to keep this under wraps,” a source said at the time. “You even have to sign a confidentiality agreement to go up to see him.” To add fuel to the fire, Hugh, who is currently married to 31-year-old model Crystal Harris, missed his annual Midsummer Night’s Dream party last year, which was hosted by his son instead.

His ex and former Girls Next Door star Kendra Wilkinson also revealed she was concerned about his “declining” health. “I worry every day you know that at that age and I’m not gonna lie, every day I open up my social media, I pray I don’t see what we think might happen,” she told E!. “He honestly is my family.”

Have a tip? Send it to us! Email In Touch at contact@intouchweekly.com.