POPS out of second

Have a problem with my 97 TJ. POPS out of second when I let off the clutch during downshift or when I let off the gas in 2nd gear . Have had a few people tell me it is probably the syncros however we are all just backyard mechanics and don't know for sure. The jeep has been rode hard during several 4 wheel outings and now I will pay for the lack of care(fluid changes, etc.) afterwards. Can anyone tell me if I am looking in the right direction by thinking syncros?

It could be several things:1. worn checkballs, fork rod ball grooves or check springs. 2. Worn mainshaft or countershaft bearings 3. excessive gear end play 4. Worn synchros. Unfortunately it will require removal of the transmission to find out for sure. What I would do is rent a tranny jack and remove the tranny myself to save labor and then bring it to a good shop for repairs / rebuild.