More is almost always better. The only reason it might not be, is if it screws with the power supply controller's response time (and it breaks into oscillation or something bad like that).
For the same reason, high performance, low ESR caps may not be ideal, either -- these sorts of circuits are a triumph not only of engineering to a cost, but to a time as well!
Tim