If the brake lathe is multi speed turn the rotors at the slow setting and only make small cuts.

It would not hurt to clean out and chamfer the cross drill holes before before and after you cut them too.