Is there an Army regulation thats says i cannot wear my PT fleece cap inside?

I have been in the Army for 6 years and have never been told to take my pt cap off while indoors. Recently i was told to and that since its considered head gear you must remove it. I need help.