Check the starter with a battery. Chargers in general do not give good DC current, only rectified AC. Also, the charger may not be giving the starter enough current to actuate the solenoid.
Make sure you are finding all the fuses. There are always more....
Clean with emery cloth or fine sand paper any contacts that are rusted.