Babies should not get too hot or cold.  The ideal room temperature for a baby is 16-20oC.  If the room is hotter you will need to check your baby and remove bedding or clothing if they seem too hot.  If the room is cooler you may need to add clothing or bedding.