The region you are in and the time of day affect the climate around you, which also influences your body temperature.
When your body temperature falls outside its ideal range, Stamina will drain more quickly and recover more slowly. In extreme conditions, even harsher penalties may apply, so always be aware of your surroundings.
Equipment and Food that grant Fire or Ice Resistance will help you endure the harshest climates.