Hugh Jackman can do it all – play an action hero in Wolverine, sing in Les Miserables and dance on Broadway, but there's one thing he can't do: stop the rumors that he's gay.

The speculation about the Aussie actor's sexuality began around the time he played flamboyantly gay singer Peter Allen in the Boy From Oz on Broadway, but while he says "on some levels it's a compliment," he hates to see the effect it has on his wife of 17 years, Deborra-Lee Furness.

Hugh Jackman Sings About Boobs on New Lonely Island Album

"If I was, I would be," he said in an interview yesterday with 60 Minutes in Australia. "It's, to me, not the most interesting thing about a person, anyway… I do get frustrated for Deb, cause I see Deb go, '"Ah, this is crazy!'"

Deborra-Lee, who's 13 years older than Hugh, says the constant questioning is "offensive." "If he was gay, fine, he would say he's gay," she says. "It's annoying because it's not true."

The couple have two children, Oscar and Ava, but Hugh admits that his kids aren't impressed by his role in the X-Men movies.

"They've only seen it recently," Hugh reveals. "I figured it would be very undermining to see their father slicing people's heads off. It does take away my credibility when I say, 'Please don't hit your sister.' 'Really, Dad?'"

But his 13-year-old son knows how to use his dad's fame when it counts.

"I have seen Oscar use the fact that his dad's Wolverine to try and chat up a 14-year-old girl," Hugh, 44, admits. "I'm like the wingman for my son!"

Have a tip? Send it to us! Email In Touch at contact@intouchweekly.com.