Watch what you say, Matt Roloff! On this week's brand new episode of Little People, Big World, the 56-year-old opened up about the famous family's farm and how it has taken a toll on his stress level.

"Let's say it hits the fan at the farm, and I just can't deal with it anymore. I can't deal with Amy's attitude," he said of his ex-wife. "If it gets any worse, I just feel like this is just like an escape. It's possible that I could move in here," Matt said. "There's part of me that wants to keep the farm and build a house that suits me, but part of me just wants to sell the farm and liquidate it and move on. It's a burden."

Matt and Amy announced their divorce in 2015 after nearly 30 years of marriage. He explained during the show that Amy was given the house as part of their agreement, so he's been living in a smaller home — aka the DW — on the property, which isn't exactly conducive for a little person.

"I'm going to divest a little bit of my revenue out of the farm, for sure," Matt said. "I bought a house as an investment in the area close by. I don't know if I'd move in there or not, but I do know that I can't live in the DW, because it's not serving my physical needs, so I got to deal with that." He added that he's been checking out Surprise, AZ retirement communities. "I'm looking at my options right now. I do love Arizona. The desert climate. I do love the idea of snow-birding. Being down there in the winter months."

Unfortunately, his twin sons are less than thrilled about his parents' potential decision. "I would like them to see them value that legacy over… a retirement home in Arizona or whatever that might be," Jeremy said. Zach added that it might be time for his bro to take over. "My dad has always gone on vacations throughout the year. He definitely loves his time off the farm and warmer weather. If this trip gets longer and longer, I think it is time for Jeremy to take a bigger interest in the farm. But that's going to take time." He continued, "This conversation with my mom and dad about the farm — I don't really know what to expect. But I don't want them to sell the farm."

Little People, Big World airs Tuesdays at 9 p.m. EST on TLC.