NEC 78K0 User Manual page 234

(4) Zero-scale error
This shows the difference between the actual measurement value of the analog input voltage and the theoretical
value (1/2LSB) when the digital output changes from 0......000 to 0......001.
If the actual measurement value is greater than the theoretical value, it shows the difference between the actual
measurement value of the analog input voltage and the theoretical value (3/2LSB) when the digital output
changes from 0......001 to 0......010.
(5) Full-scale error
This shows the difference between the actual measurement value of the analog input voltage and the theoretical
value (Full-scale − 3/2LSB) when the digital output changes from 1......110 to 1......111.
(6) Integral linearity error
This shows the degree to which the conversion characteristics deviate from the ideal linear relationship. It
expresses the maximum value of the difference between the actual measurement value and the ideal straight line
when the zero-scale error and full-scale error are 0.
(7) Differential linearity error
While the ideal width of code output is 1LSB, this indicates the difference between the actual measurement value
and the ideal value.
Figure 11-14. Zero-Scale Error
111
Ideal line
011
010
001
000
0 1
Analog input (LSB)
Figure 11-16. Integral Linearity Error
1 ...... 1
Ideal line
0 ...... 0
0
234
CHAPTER 11 A/D CONVERTER
Zero-scale error
2 3 AV
REF
Integral linearity
error
AV
REF
Analog input
User's Manual U16227EJ2V0UD
Figure 11-15. Full-Scale Error
Full-scale error
111
110
101
000
0 AV –3 AV –2
REF REF
Analog input (LSB)
Figure 11-17. Differential Linearity Error
1 ...... 1
Ideal 1LSB width
Differential
linearity error
0 ...... 0
0
Analog input
Ideal line
AV –1 AV
REF REF
AV
REF