It's was joke. Somewhere between Season 1 & 2 They seem to have gotten fitter.
In season 1 of Walking Dead, I do not recall there being a scene where people went to a Gold's Gym and worked out to the song, I'm Sexy and I Know It. That must have taken place some time in the second season.