Possible future problems?

I have 2003 1.8T, 17,900 miles on it.
This morning I went to my car and turned it on to fined out that the clock was off by 4 hours and the trip had reset. This is the second or third third time that it's happened. Has this happened to anyone else and is this something serious to be worried about? Also, I am the only one that has access to it, so it's not like someone else could be fiddeling with it.