How do I remove Ball joint from lower arm
 

I am changing the the left transaxle on my girlfriends 2001 Hyundai Sonata. I have the wheel and lugs off. I took the nut off the Tie Rod. I have the nut off the Ball Joint and I even took the bolts off the control arm so that I could lower the arm out of the way.
My problem is I cannot get the Ball Joint to come out of the arm. I have tried a Pickle Fork to pop it and the Ball Joint remover I have does not fit. I have also tried using a pry bar but no luck so far. It seems the Hyundai Ball joint sits on top and not below like other cars.
Any suggestion on how to get that Ball Joint out of the arm?

Hit the knuckle with a solid hammer.

Sashimis right
 

Give it a good shot with a hammer but shot placement is important ( Knuckle shot only )