I originally had to use a bit of force on the ball joint,
had to remove the Arm and KnuckleI, and then unscrewed the lock nut so its level with the thread,
got hold of a piece of HARD WOOD, and a small MASH/sledge hammer, and used a little bit of persuasion,
again, let WB 40 soak in TO IT, you will find it will come out eventually,
Do not use the mash hammer on the top of the ball joint.
Surely there is a place that could press the old bushs out for a slab.
[Take 2 > 3 minutes each one]
Since you have damaged the rubber boot, its just as easy to got a replacement arm,
A cheap alternative for a OEM one is from a Wrecker, as you only need it for a good Ball Jount and Rubber seal. I see a fair few S/Hand one on eBay now and then.