Your best bet seems to be the idea of angle brackets, firmly attached on either side. Don't rely on the PCB alone, or especially the pin headers, to provide the strength you need.
In fact, I'd be sure that the angle brackets were as close to the pushbuttons as I could get them. They don't have to be particularly large, but they do need to take the stress off the boards.