What's the advantage of a power op amp over a simple single transistor audio amplifier? Now you don't need to worry about +/- supplies. It's not like you need such precise control over the gain.
The reason I question the use of a regulator is two-fold. First, most any ripple on the supply voltage can be taken out with a simple filtering cap. Second, a regulator is going to try to maintain a constant voltage output. That's not necessarily a good thing. When your op amp gets warm, it draws more current. With a simple resistive supply, the supply voltage drops, protecting the device. Instead, with the regulator, the voltage remains the same. Now the op amp dissipates more power, heats more, draws more current, and we have thermal runaway.
Next problem. Suppose your op amp fails with a short. Your regulator is going to dump the maximum amount of current into the short, causing catastrophic heating and all sorts of other wonderful things.
As far as dropping 24 V to 5 V with a linear supply, it doesn't need to dissipate a lot of power. What does the digital circuitry draw, a few mA?