Talking about me, I don't know why there must be something wrong with the fingers(1) of my left hand, but I do find the CAPslock key so freaky terrible in a keyboard because I too often accidentally press it rather than pressing the tab key! So I seriously appreciated the HHKB of my friend for not having the CAPslock key at all.
Some keyboards do not have gaps between keys, and it's harder to hit the right key by touch. This is not the case, however I do press the tab key something like 10 times in a minute, and you can calculate the probability of collision with the CAPslock key.
I am surprised the key is present in the Ultimate Hacking Keyboard. It shouldn't be there, because "hacking" should means the keyboard is designed for text editors rather than wordprocessors.
The terrible big CAPSlock key is also present in my Cherry keyboard, just in the place where it can collide with the pressure of the tab key. And how did I fix it? With a silicone drop under the key so it cannot be accidentally pressed as it usually happens when I type
edit:
(1) I do press the tab key with the ring finger, the finger next to the little finger.