According to Der Spiegel magazine, the calls were collected accidentally and the recordings were destroyed immediately.
John Kerry has reportedly spoken to his German counterpart, Frank-Walter Steinmeier, about the claims.
Correspondents say the reports will embarrass Germany after a row about the US spying on Chancellor Angela Merkel.
Der Spiegel said the German intelligence agency had tapped a satellite phone call John Kerry made in 2013.
Reports in German daily newspaper Suddeutsche Zeitung and public broadcasters NDR and WDR said documents passed to the CIA show German spies had also eavesdropped on Hillary Clinton when she was US Secretary of State.
German government sources told the newspaper and two broadcasters, that they intercepted the call by chance, and she had not been deliberately targeted. They also said it happened just once.
However, media reports said it had not been an isolated case.
A spokesman for the US embassy in Berlin declined to comment on the reports.
If confirmed the revelations could prove difficult for Germany. Relations with the United States have deteriorated amid allegations of American spying on Germany.
The head of the CIA in Germany was expelled last month, after it emerged the agency had tapped Chancellor Merkel’s mobile phone.
Image source: Wikimedia Commons President-elect Donald Trump celebrated his election victory at the Ultimate Fighting…
Millions of voters across the US chose to return Donald Trump to the White House…
Donald Trump declares victory in the US election as he addresses jubilant supporters in Florida.…
Stocks around the world are rising as Donald Trump appears to be on the cusp…
Donald Trump has won Pennsylvania, North Carolina and Georgia and taken a lead over Kamala…
Quincy Jones, the celebrated musician and producer who worked with Michael Jackson, Frank Sinatra, Ray…