Upper Ball Joint removal 1995 4runner

It seems in order to get to the castelled nut (the brake line is in the way) the calliper and the piece that attaches to the steering knukle have to be removed. I am missing something obvious or there is just no way around it?

9 year old bolts just don't want to budge so the less I have to remove....

Dimitri