Simon's back! Silver-tongued Brit Simon Cowell will be taking over for Howard Stern for the next season of America's Got Talent, confirms Us Weekly.

The former American Idol judge said that this is something that has been on the table for five years, "We've been talking about it for a few years, funny enough, me and NBC. … This year ... everything worked. So it was perfect," said Cowell.

The 56-year-old is beloved and praised for his honest critiques of performers, and his soul/career-crushing word. He was Idol's favorite judge for nine seasons, from its premiere in 2002 until 2011.

But don't worry, Cowell assures his fans that just because he's become a dad doesn't mean he's getting soft. "I'm not going to lie to people when I think they're hopeless, I just couldn't do that!" But no, of course I'm not going to be rude for the sake of being rude. That would be ridiculous. I'll take it act by act," said the music man.

Being a judge on a variety competition show is nothing new to the new dad. He's judged both the American and British versions of The X Factor, and Britain’s Got Talent.

Stern announced his decision to leave the show three seasons on his SiriusXM show in June, saying that he wasn't able to do his daily radio show, AGT, and a new TV opportunity at the same time. One had to go -- and that was the wild variety show.

Though none have confirmed for the 11th season, AGT is hosted by Nick Cannon, and the other judges are Howie Mandel, Heidi Klum, and Mel B.