They do get hot. If too hot, the windings might be shorted a bit. It is cheap enough and easy enough to replace if it is a concern and will be left on for extended periods of time.
I've got a few with burnt paper that are probably past due for replacement, but they still work...