Heat and humidity will gradually increase over the next few days, bringing a more summer-like feel to the weather by the weekend.