A/D Conversion Precision Definitions - Hitachi H8/3672 Series Hardware Manual

Single-chip microcomputer
Table of Contents

Advertisement

14.5

A/D Conversion Precision Definitions

This LSI's A/D conversion precision definitions are given below.
• Resolution
The number of A/D converter digital output codes
• Quantization error
The deviation inherent in the A/D converter, given by 1/2 LSB (see figure 14-4).
• Offset error
The deviation of the analog input voltage value from the ideal A/D conversion characteristic
when the digital output changes from the minimum voltage value 0000000000 to 0000000001
(see figure 14-5).
• Full-scale error
The deviation of the analog input voltage value from the ideal A/D conversion characteristic
when the digital output changes from 1111111110 to 1111111111 (see figure 14-5).
• Absolute precision
The deviation between the digital value and the analog input value. Includes offset error, full-
scale error, quantization error, and nonlinearity error.
Figure 14-4 A/D Conversion Precision Definitions (1)
Rev. 1.0, 03/01, page 202 of 280
Digital output
Ideal A/D conversion
characteristic
111
110
101
100
011
010
Quantization error
001
000
1
2
3
4
8
8
8
8
5
6
7
FS
8
8
8
Analog
input voltage

Advertisement

Table of Contents
loading

This manual is also suitable for:

H8/3672f-ztat hd64f3672H8/3670f-ztat hd64f3670

Table of Contents