Nope, it's not all in your head if you always seem to be freezing while you're male coworkers are totally fine.