Build it and see. Anything is better than the hundreds of theoretical designs discussed in Internet forums!
Personally, for portable use I wouldn't bother with external transistors, I'd stick to a pair of op-amps, or a TPA6120 (current feedback amp, needs reasonable PCB design), but like I say, the best headphone amp is the one you actually build, not the one sat on a drawing board.