An FBI agent was pulled off the investigation into David Petraeus's illicit contact with Paula Broadwell when he reportedly became…