blower works on 1,2,3; not High

Could this also be the blower resistor block? From what I've read it seems that the most common problem with the block is it only works on high and not the lower speeds. My problem is reversed. '03 LX 2.7
Thanks