If this is the manual climate control, may be a problem behind the control knob with the wiring being cracked or the knob being loose. This is a common problem with this generation Highlander. Also, you have a 3.3 V6, the 3.0 V6 wasn't used in Highlander after 2003 model year.