Years ago, I learned that paper (then) capacitors had the "outside foil" marked for safety purposes. That lead should be connected to the node with lower DC voltage, since the insulation outside the outside foil was minimal.
The issue isn't safety or insulation, it is shielding.
When used in high impedance circuitry (think tube amplifiers), you want the outer foil to be connected to the node with lower impedance to ground. In this way, the outer foil can act as a shield around the inner foil, which is connected to the higher impedance point. For a typical coupling capacitor between 2 tubes, the outer foil goes to the plate of the first stage, with the inner foil connecting to the grid of the next stage.
Quite surprising to see that those "orange drop" caps aren't always properly marked. Why bother putting the band on at all if it doesn't indicate anything?