The correct reasoning is:
The walls of the house are warmer during the summer. Therefore, they radiate more infrared light that can serve to warm our body.
During the summer, the external temperature is higher, causing the walls of the house to absorb heat and subsequently emit more infrared radiation. This increased emission of infrared light contributes to the feeling of warmth, even if the thermostat is set to the same temperature.