2007 GCR, page 57, section 6.10.2 basically states if you leave the track/pits, enter the paddock and then re-enter the track/pits you forfeit all previous times.

You got hosed if all you did was come into the pits.