Analog switch inconsistencies

[JeWe37]

Recently I asked for a way to spoof the HD Audio connector's jack detection networks so as to be able to manually switch them(further details in that post). I subsequently was recommended to use an analog switch, for which purpose I chose the TS5A23159, as it can handle up to 5V and has the required low On-Resistance so as to not mess with the detection. It is set up as shown in this image:

A few days ago I got the PCBs and soldered them, however when attempting to test the circuit I noticed erratic behavior from the switch. More detailed investigation revealed that the switch seemed to not be turning off properly once Vcc had been removed and not turning on immediately when it was applied, but did generally seem to be switching. This is behavior that I would expect if there were no proper pull-down resistors, however as is evident from the schematic, they are indeed present and 10kΩ should be sufficient to quickly discharge any stray capacitances or similar. I am at a loss for what might be causing the instability I have observed. Does anyone have a clue as to what might be going on?