The 48-year-old radio presenter is the sixth celebrity to be voted out of camp, leaving the former health secretary in the jungle as the final fast approaches.
Moyles told hosts Ant McPartlin and Declan Donnelly: "I'm gutted that Matt Hancock is more popular than me! What the b'jesus is this?!"
He went on: "Why am I out and he's still in?!"
The former BBC Radio 1 Breakfast Show host admitted it had been hard to share a camp with the former health secretary and Conservative MP.
Moyles said: "I really struggled with it to be honest. In the end I separated 'Matt Hancock' from 'Matt'. He started doing all the trials and winning the food. Matt Hancock I've got major issues with, but Matt - less issues."
Pausing mid interview to point out a caterpillar on Donnelly's collar, Moyles admitted he was disappointed to be voted out as he was starting to think he could make it to the final.
He said: "I just said this morning - I've got this now, I'd really like to stay. I put on fresh clothes."
Moyles revealed: "He thinks I partly own Nobu, but I don't know if that made it onto the show."
The radio DJ said that days felt very long in the camp.
He said: "If you're not doing the trial or the Dingo Dollar challenge you are in camp all day. If you've done your washing the day before and had a shave you have nothing to do for 15 hours."
Moyles said he was pleased to have lost weight and been a part of the reality show that he is such a big fan of.
He said: "I never got over the surrealness of it all. I'd often be the last one to bed and I'd walk back into the camp and stare at it and think, 'This is amazing.' It is a massive privilege to do it, to be a part of this is an honour."
Moyles tipped Tindall, Scott and Warner to make it to the final three.
Watch: Babatunde Aleshe spills his drink during I'm A Celebrity exit interview