It may be possible to charge it with 9v without problems, but I think it wil lower the battery life.
For now I've got a simple lm317K and a few resitors, and it seems to work fine, but there is a voltage drop of 1.5V. And if i have to use a si shottiky, there will be to much voltage drop.
I attached some photo's of the circuit, using a 5W 10 Ohm resistor as battery replacement.