Hello.
I have a question about calculating formula to convert full/limited range.
According to "Figure 38. CP Data Path Channel A (Y) for HDMI Mode" of UG-180 Rev.B Page.112,
it seems that the formula is "Input" x "Gain" + "Offset".
But according to actual measurement, in the case of "Case.2" it seems that the formula is ("Input" + "Offset") x "Gain".
e.g.
16 x 1.16 + (-16) = 2.56
(16 + (-16)) x 2.56 = 0 <-- this is correct, I think.
Is my thought right?
Case.1
Input Full range
Output Limited range
Gain 0.86
offset 16
Case.2
Input Limited range
Output Full range
Gain 1.16
offset -16
Best regards.
Kikka