The game is freezing frequently. While the Sim is frozen, time goes on until it unfreezes and then resets itself to before the freezing occurred. It's most visible if you speed up your time.