First pass, sounds like an EMI problem. Filtering, lots of filtering. A common mode choke, capacitor, differential mode choke, capacitor is a classic method for basic filtering. You could build the emi filter up in a dusb dongle style for testing. Depending on current draw and voltage requirements, a previous suggestion of an LDO on the MEMS rail could be acceptable, especially one with a high power supply rejection ratio.