Esfand claims he's the only one working out off camera at Camp Knut