The easiest way to safely charge a multi-cell lipo with your dc power supply is to put a real lipo charger in between the supply and the lipo.
I recently upgraded my lipo charger to
this and are very happy with it. You also have less powerful versions like
this and
this, in case you don't have a very powerful dc power supply to fully make use of it.
The main difference between the newer and older lipo chargers in the budget-range is the way they balance the cells. The typical four-button chargers like the B6/B6AC charge the whole pack until one cell is 4.2 volts, then discharge the cell to the level of the next highest cell, charge the full pack again and keeps at it until all are equal. The isdt chargers actually charges the cells individually instead of discharging them, which makes balancing faster and probably more accurate (?). The balancing current is not as high as the rated charge current, but keep in mind that the balancing current is only used at the very end of the charge cycle unless you have a very badly unbalanced pack.
You can see Dave's video on charging a single cell to get an idea of what is happening per cell when balancing a multi-cell pack: