So it looks like the amplitude of a given color signal governs it's intensity. I'm guessing the combination of the HSync markers and the correct sampling frequency get you your individual pixel R, G and B values?
It's a bit more complicated than that, I was displaying 3 color ramp bands first red then green then blue that's why they show nicely on the capture, but if they were combined like any regular pixes normally is, the video signal needs to be split into YIQ or YUV (the difference is just a different coordinate system for the colorspace.
http://en.wikipedia.org/wiki/YIQhttp://en.wikipedia.org/wiki/YUVOnce you have the YIQ or YUV you can convert it to RGB using some simple matrix multiplications.
This article has a more detailed explanation if you want to dig deeper:
http://codeandlife.com/2012/10/09/composite-video-decoding-theory-and-practice/The big gap between the full frame R, G, B bands is the VSync (front porch/back porch)?
On the signal whole signal it goes this way:
Vertical sync | Vertical Back Porch | Video Lines | Vertical Front Porch (repeat next frame)
The Video lines consist of the following:
Horizontal sync | Horizontal Back Porch (Includes Color Burst) | Visible Video | Horizontal Front Porch (repeat next line)
For completion, during Vertical Sync you can put close captioning on the non visible video lines, but that's another story. In Europe they use it for Teletext I think.
Is there any data contained in the initial color burst signal seen before the ramps?
The Color burst does have information about the intensity of the video signal. it's 40 percent of the maximum value peak to peak, so from zero volts to the top of the color burst signal it represents 20 percent of the video signal value.
So the maximum signal will be past the scope screen where I placed the 100.
On top of that the Color Burst contains the color subcarrier , that will help you to find out the pixel clock (315/88 MHz for NTSC) and be able to mix different signals to level the colors based on the amplitude of the color burst of both signals and adjusting for pixel clock rates.
More info:
http://en.wikipedia.org/wiki/ColorburstMore info on dot clock rates (pixel clock) for different gaming systems:
https://pineight.com/mw/index.php?title=Dot_clock_rates