The Ansar al-Sharia group said they set off a bomb at the base in the central town Bayhan before capturing soldiers.
The attack comes amid fears that Yemen is plunging into chaos after Shia rebels took over the capital.
Shia Houthis have been expanding south from their northern stronghold, prompting clashes with al-Qaeda in Yemen (AQAP) and other Sunni groups.
The UN has warned that Yemen is on the brink of civil war.
The base is in Shabwa province, an al-Qaeda stronghold. It is reportedly home to more than 1,000 troops.
The militants captured heavy weaponry when they took the base, one official told the AFP news agency.
Tribal mediators were trying to convince the group to withdraw, the official added.
Last week, the Houthis dissolved parliament and announced the formation of an interim government.
The move was widely condemned, with critics calling the actions a “coup”.
The US, UK and France have said they are closing their embassies in Yemen due to the deteriorating security situation there.
7AYHVDMBUBIThe US House Ethics Committee has voted to release its report on former Republican Representative…
ABC News has agreed to pay $15 million to President-elect Donald Trump to settle a…
South Korea’s parliament has voted to impeach President Yoon Suk Yeol over his failed attempt…
Israeli war planes have carried out more than 100 air strikes in Syria on December…
President-elect Donald Trump has threatened to impose 100% tariffs on the BRICS countries if they…
Syrian troops have withdrawn from the city of Aleppo following an offensive by rebels opposed…