FBI official ousted under Trump says Patel's Bureau has had "loss of expertise"