Fired FBI agents had worked on various criminal cases against Trump, sources say