Donald Sterling just needs to keep his mouth shut! After one audio recording of him leaked on the web, you'd think he'd use a little more caution when talking on the phone, but apparently not!

After his racist rant surfaced last month, the 80-year-old owner of the Los Angeles Clippers reacted to the news while on a phone call with a friend, and Radar obtained a copy of that conversation.

“You think I’m a racist?” Sterling angrily asks. “You think I have anything in the world but love for everybody? You don’t think that! You know I’m not a racist!”

“I grew up in East LA," Sterling continues. “I was the president of the high school there. I mean, and I’m a Jew! And 50% of the people there were black and 40% were Hispanic … So I mean, people must have a good feeling for me. I mean, how could you think I’m a racist knowing me all these years? How can you be in this business and be a racist? Do you think I tell the coach to get white players? Or to get the best player he can get?”

Last month Sterling's mistress V. Stiviano allegedly leaked a recording of Sterling saying he didn't want her bringing African American friends to Clippers games or posting pictures of them online. Sterling is heard saying, "It bothers me a lot that you want to broadcast that you’re associating with black people. Do you have to? ... I’m just saying, in your lousy f*cking Instagrams, you don’t have to have yourself with, walking with black people."

Stiviano then said all she did was take a picture with someone she admires -- Magic Johnson. Sterling's alleged reply? "I think the fact that you admire [Magic] -- I've known him well, and he should be admired. And I'm just saying that it's too bad you can't admire him privately. And during your entire f*cking life, your whole life, admire him -- bring him here, feed him, f*ck him, I don't care. You can do anything. But don't put him on an Instagram for the world to see so they have to call me. And don't bring him to my games. OK?"

So what did Sterling have to say about that? “It breaks my heart that Magic Johnson, a guy that I respect so much, wouldn’t stand up and say, ‘Well let’s get the facts. Let’s get him and talk to him,'" he said. "Nobody tried. Nobody!”

Sterling may have been banned from the NBA for life and fined $2.5 million, but he's not giving up the team. Not yet, anyway! “You can’t force someone to sell property in America!” he says. “I’m a lawyer, that’s my opinion.”