Life after scandal isn't treating Matt Lauer so well. Now, five months after the disgraced TV anchor was fired from his job as a Today show co-host amid sexual misconduct allegations, Matt has bascially been living as a recluse in one of the two guesthouses on the grounds of his $36.5 million mansion in Southampton, NY. But in the rare moments that he has been seen, Matt doesn't look like he's doing so great.

"He looks miserable, like the loneliest man in the world," a source exclusively reveals to In Touch. "He either stays inside the guesthouse or sits in one of the Adirondack chairs on the porch to take calls. You never see him smiling.”

matt lauer splash

Matt, 60, doesn't really have a reason to smile these days. Matt's firing from NBC came swiftly after an unidentified female colleague came forward and accused him of sexual harrassment and shortly after, multiple reports detailed the type of inappropriate behavior that Matt had allegedly been involved in. He would make lewd sexual remarks to his female collegaues, he invited a female colleague into his office and show her his penis, and he gave a female colleague a sex toy as a gift, according to Variety. Watch the video below to find out the creepiest detail about Matt's sexual misconduct scandal.

As if losing his job wasn't a hard enough blow, his personal life also took a turn for the worse. Two months after his scandal broke, Matt's wife Annette Roque kicked him out of their family's home but allowed him to live in the guesthouse on their property so that he could be close to their three children — 16-year-old son Jack, 14-year-old daughter Romy, and 11-year-old son Thijs. Annette, 52, is also preparing to file for divorce from her husband after 20 years of marriage, and she's planning to claim some of his $100 million fortune in spousal and child support — which is stressing Matt out. "He’s depressed," says a friend. "He feels that all his hard work and sacrifice won’t pay off for him in the end."