According to Der Spiegel magazine, the calls were collected accidentally and the recordings were destroyed immediately.
John Kerry has reportedly spoken to his German counterpart, Frank-Walter Steinmeier, about the claims.
Correspondents say the reports will embarrass Germany after a row about the US spying on Chancellor Angela Merkel.
Der Spiegel said the German intelligence agency had tapped a satellite phone call John Kerry made in 2013.
Reports in German daily newspaper Suddeutsche Zeitung and public broadcasters NDR and WDR said documents passed to the CIA show German spies had also eavesdropped on Hillary Clinton when she was US Secretary of State.
German government sources told the newspaper and two broadcasters, that they intercepted the call by chance, and she had not been deliberately targeted. They also said it happened just once.
However, media reports said it had not been an isolated case.
A spokesman for the US embassy in Berlin declined to comment on the reports.
If confirmed the revelations could prove difficult for Germany. Relations with the United States have deteriorated amid allegations of American spying on Germany.
The head of the CIA in Germany was expelled last month, after it emerged the agency had tapped Chancellor Merkel’s mobile phone.
Sydney has welcomed 2025 with a spectacular fireworks display - cheers erupted as the clock struck midnight…
Following an eight-year legal battle, Angelina Jolie and Brad Pitt have reached a divorce settlement,…
Former President Jimmy Carter died on December 29 at the age of 100 after spending several…
Georgia’s outgoing president Salome Zourabichvili refused to step down on December 29, saying she was…
The bald eagle has been officially declared the national bird of the United States, after…
Dozens of passengers have survived a crash involving a plane carrying 69 people in Kazakhstan,…