According to Cleveland.com, Dr. Michael Roizen speculates that “presidents get two years older for every year they’re in office” [reference]
This is probably due to stress of the job rather than living at the white house. It is well known that stress shortens the cell’s telomeres which is an indication of cellular aging.