So why do digital scopes do so poorly in X-Y mode?
DSOs have six problems with X-Y mode:
1. Non-index graded displays cannot be anti-aliased and most DSOs with index graded displays do not anti-alias anyway or anti-alias poorly; this becomes an additional source of quantization noise. Note that the analog examples above show a raster displayed on a vector display device producing further aliasing on the DSOs. A true vector implementation would look better on both types of oscilloscopes.
2. DSOs suffer from quantization noise from the digitizer which is usually handled poorly in X-Y mode. High resolution mode should solve this. Average acquisition mode should also solve this unless it lowers the update rate.
3. Most DSOs produce display updates by batching record length groups of samples. If the vector generation time does not fill the record length evenly, then the display updates either miss or overlap sections. "Phosphor" type DSOs still update the display in batches determined by the number of samples between display updates.
4. DSO display refresh and update rate is orders of magnitude slower than the continuous update rate of an analog oscilloscope. This should not matter above about 60 Hz but combined with 3 above it becomes a problem.
5. Almost all DSO displays have a much lower resolution per area than an analog CRT. Many old CRT DSOs operated at 254dpi (100dpc) and could produce a pretty good vector display in X-Y mode except for the record length and update rate issues described above despite lacking anti-aliasing.
6. Most DSOs do not support a Z-axis (intensity) input so all of the vectors run together. The Rigol example above shows this.
These issues with DSO XY mode could be fixed to produce a display limited only by the display device itself but it is hardly a high priority.