But the MP Nadine Dorries, retorted: "The people in Westminster who are so outraged are actually terrified that at some stage any day soon Boris may make a challenge for the leadership and Number 10".
The former foreign secretary used his column to comment on Denmark's introduction of a burka ban.
Baroness Warsi repeated her calls for an investigation into Islamophobia within the Conservative party in a piece in the Guardian, and noted there had been a 26% rise in hate crimes against Muslims previous year, according to figures from monitoring group Tell Mama.
Scotland Yard chief Cressida Dick said the comments did not amount to a hate crime and police have not received any criminal complaint against Mr Johnson.
Conservative peer Sayeeda Warsi, a former party chairwoman, accused Johnson of adopting the "dog-whistle" tactics of right-wing firebrand Steve Bannon, US President Donald Trump's former top aide.
Speaking to Shelagh Fogarty, Lord Pickles said Mr Johnson's argument for not banning the burka had been lost by his "unfortunate" words.
She said: 'It's this thing about not taking things seriously, you know, like the old Boris of old: "Oh sorry, I've just s***ged your wife, didn't realise", that kind of thing'.
Trump vows to impose tariffs on more Chinese goods
March 1: President Donald Trump announcestariffs on all imports of steel and aluminum, including metals from China. The duties are part of a broader round of United States tariffs on $50bn worth of goods announced in March.
A source close to Johnson said, "We must not fall into the trap of shutting down the debate on hard issues".
Following a growing chorus of condemnation over Johnson's derogatory views he made about Muslim women wearing burqas, Britain's Conservative Party Chairman Brandon Lewis said on Tuesday he had asked Johnson to apologize.
But Mr Johnson has far more support among the public - with a Sky poll finding that six out of ten Britons do not think his remarks were racist.
But other Tories have come to Johnson's defence.
But Johnson also said the robe was oppressive, ridiculous and made women look like letter boxes and bank robbers, prompting an outcry from other politicians and British Muslim groups.
He added that he could not find scriptural authority for the dress code in the Koran.
"I would go further and say that is it absolutely ridiculous that people should choose to go around looking like letter boxes".