Cut through both sides, lap the faces so they fit flush, and shim the gap.
Avoid winding wire near the gaps: the losses near the gap are huge.
Even better for compact inductors might be a square core. I've seen these in CMCs and inductors before, though don't know how available they are generally. The relevant shapes are C, R, U and the like.
Tim