Help Fuel Relay/computer?

I have a 96 Cutlass Supreme 3.1L and this is the problem once a year now the second time this year the car will not start this is what it does. When I turn on the ignition you can hear the fuel pump RELAY is ticking, it is opening and closing realy fast not closing the circut/relay to send power to the pump. I have swaped the relays between the A/C and the fuel pump (same relay) and still does it, so the relay is good well 99% sure. So my guess is a computer problem right? Has anyone had this problem happen to them. It always seems to fix it self within a day but I just had to call into work cuase it will not start. Any help and insight would be welcomed.