There was some serious trouble in paradise following Kanye West's explosive TMZ interview back in May.

In a new interview with The New York Times, West revealed that he thought Kim Kardashian might walk away from their marriage after the rapper made a controversial statement about slavery during his now-infamous TMZ newsroom diatribe, and that he called other members of the Kardashian-Jenner clan to feel out his wife's feelings towards him.

“There was a moment where I felt like after TMZ, maybe a week after that, I felt like the energy levels were low, and I called different family members and was asking, you know, ‘Was Kim thinking about leaving me after TMZ?' So that was a real conversation," he admitted.

West similarly expressed his anxiety about Kardashian, with whom he has three children, potentially leaving him on "Wouldn't Leave," a track off his Ye album featuring the lyrics, "Build your own'—I said, 'How, Sway?' / I said, 'Slavery a choice'—they said, 'How, 'Ye?' / Just imagine if they caught me on a wild day / Now I'm on fifty blogs gettin' fifty calls / My wife callin', screamin', say, 'We 'bout to lose it all!' / Had to calm her down 'cause she couldn't breathe / Told her she could leave me now, but she wouldn't leave."

And though Kim and Kanye are still together, the rapper wasn't being totally alarmist with his marriage concerns: In early June, Kardashian shared that she "wasn't so calm" after she initially caught wind of her husband's inflammatory statements.