certainly sounds like a faulty switch
Im just looking into the wiring diagrams now but its confusing me a little lol, it looks like there are 3 fuses for hte elec windows for some reason? and 1 relay.
Can it be the switch?? i mean because it doesnt work from the drivers side etc.. or does the drivers side somehow power the passenger side? lol