Yes, it's normal that, when the dehumidifier is working, it releases slightly warmer air than the room temperature.

The dehumidifier is not an air conditioner and does not produce cold air.