Start

My isuzu trooer would not start, I change Coil, Distributor, presssure regulator and fuel pump. The only time it will start is if I disconnected the pump wire then it will start and as soon as it start I will reconnect the wire and it will run fine, if I stop the engine I will have to do the same thing again. please help to find the fault.
Thank you.