The conservative Tory party was shut down by Neil Parish on Friday after accusations earlier this week that he had surfed porn sites on two occasions - while sitting in a meeting in the lower house.
Two female party colleagues claim that Parish watched porn on his phone while sitting near them.
Neil Parish tells the BBC that it was "a moment of madness" and that he "is not proud" of what he has done.
He has previously also said that it happened by mistake on one occasion but that the second time it was intentional.
As recently as Friday, he wrote in a statement on his website that he would remain as a member of parliament while the events were investigated.
Neil Parish has a long political career behind him.
He has been a Member of Parliament since 2010 and between 1999 and 2009 he was a Member of the European Parliament.