Depends on this power supply you speak of. There are a vast number of incredibly cheap USB supplies out there, some are surprisingly good for the price, but some won't provide anywhere near the rated current without severe voltage sag or laughable ripple.
Some maths:
Say your boost is 80% efficiency.
Your "LCD driver" draws.. 12*1 = 12W.
The input would therefore be: 12W/0.8 = 15W.
For a 5V input: 15W/5V = 3A.
I don't think I've seen a 3A USB power supply. Try using a lab power supply first - or something that can supply >3A. What kind of boost converter are you using?
If you're "only getting 180mA on the 12V side" then this is all your LCD driver is drawing. If you try to draw too much current from a boost converter, often its voltage will drop, so I suspect it is drawing 180mA, but at a lower output voltage.