It's not just credit cards but gas cards, store cards, gift cards, membership cards, etc. etc. etc. - I have given up on the idea of a small wallet and just go for the biggest one with the most slots.
I have the same problem. Debit card, credit card, driver's license, Costco card, health insurance card, a couple of different supermarket cards, library card, Orca (bus pass) card, keycard that lets me into the office, assorted gift cards, it all adds up. Never really bothered me though, I feel naked without my wallet in my pocket, I like to be able to feel that it's there.
I was actually annoyed when I finally bought a new wallet recently that I couldn't even find one that *wasn't* RFID blocking. I need to see if I can cut out some of the shielding material so I can scan my bus pass and office keycard without taking them out of my wallet. I wouldn't really care if the driver's license compartment was shielded, although I'm not paranoid enough to really care. It's stupid that the entire wallet is shielded though, most people I see just bump their wallet against the reader on the bus and at work I've been in the habit of just bumping my butt up against the card reader to open the door.