It is unclear what will happen to Berkut officers, but Arsen Avakov said more details would be given in a briefing on Wednesday.
Berkut unit had 4,000-5,000 members stationed across Ukraine.
Meanwhile, a new cabinet is expected to be presented to protesters in Kiev on Wednesday afternoon.
Also on Wednesday, Oleksandr Turchynov announced that he had assumed the duties of the head of the armed forces.
Ousted President Viktor Yanukovych fled Kiev at the weekend and his whereabouts are still unknown.
Interim authorities have issued a warrant for his arrest, and on Tuesday parliament voted in favor of trying him at the International Criminal Court (ICC) in The Hague.
Fugitive Viktor Yanukovych is accused of being behind the deaths of more than 100 protesters at the hands of riot police.
The much-despised Berkut are just one part of the security and law enforcement agencies, which have long been accused by human rights groups and local citizens of human rights abuses.
Also on Wednesday Russian Foreign Minister Sergei Lavrov called on other countries to condemn “nationalist and neo-fascist” sentiment in western Ukraine.
Sergei Lavrov called on the OSCE to condemn “calls to ban the Russian language, to turn the Russian-speaking population into <<non-citizens>> and to restrict freedom of expression”.
Russia has portrayed the ousting of Viktor Yanukovych as a violent seizure of power by the opposition, and has expressed concern about the role of far-right parties in the protests against him.
The US and EU countries have broadly backed the takeover of power by the opposition.
Many Russian-speaking residents in the south and east of Ukraine have protested against the actions of the interim authorities.
Tensions are rising in Crimea, where two big rival protests are being staged.
Crimean Tatars and local activists supporting the demonstrators in Kiev have gathered in front of the autonomous republic’s parliament in Simferopol.
iqPZ2d-wzwoThe US House Ethics Committee has voted to release its report on former Republican Representative…
ABC News has agreed to pay $15 million to President-elect Donald Trump to settle a…
South Korea’s parliament has voted to impeach President Yoon Suk Yeol over his failed attempt…
Israeli war planes have carried out more than 100 air strikes in Syria on December…
President-elect Donald Trump has threatened to impose 100% tariffs on the BRICS countries if they…
Syrian troops have withdrawn from the city of Aleppo following an offensive by rebels opposed…