04 expedition power window

Do I have to remove the whole right rear door panel to get to the power window switch on a 2004 expedition , or doe's the switch panel lift out ? If so what is the procedure?

The switch bezel pops out and you can replace the switch. Be careful prying up on the bezel as the plastic locking tabs are easily broken.

Does that apply to the front passenger window switch also????

Yep.