Pix of what the car looked like after the accident would help. But, if caster is off after swapping out the control arm something is definately out of spec. Maybe the mounting point of the control arm. Hope your strut tower wasnt twisted in some way, but its possible.

A free alignment check at a tire shop might point out the problem. Just a suggestion.