(Just to follow up; I have finally gotten the RGB input with SOG modes to work with proper sync.
I had to
- Adjust SOG level
- remap the AIN/ADC assignments (ADC0-> AIN6, ADC1->AIN4, ADC2->AIN5)
- put the ADV7180 outputs to sleep. (chip is conflicting on the S bus by default and was taking out my red channel... grr)
- set the RGB input bits appropriately. ( I'd been doing this but the ADV7180 conflict was throwing me for a loop so I'd been trying a few different options).
I do see horrible jitter on the HSYNC -> Active video though when using SOG (YPrPB or RGB inputs, 1280x720, 1024x768 and 640x480 modes).
at 1280x720p this jitter amounts to 1-3 pixels! The ENHSPLL isn't cleaning it up; adjusting the SOG_LEVEL /QPUMP factors can make it worse, but I can't eliminate the jitter at all.
Any thoughts? I can start a new thread if you prefer.