Table of Contents
Advertisement
4
Front-Panel Operation
Introduction to Offset, Scale, and Linearity Errors
The example in Figure 4-8 assumes no offset error. The formula for scale error yields:
19.9 -19.903
Scale Error=
= -0.000151= -0.0151 %
19.9
Actual
Scale
19.903 V
Error =
19.9 V
-3 mV
Ideal
Calibrator Setting
0
Meter Reading
19.9 V
hhp018.eps
Figure 4-8. Scale Error
Linearity Error
Linearity error occurs when the response curve of a meter deviates from a straight line.
This type of error is measured by fixing zero and near-full-scale endpoints on the
response curve, drawing a line through the points, then measuring how far the meter
response deviates from the straight line at various points. The error value is computed
relative to the selected full-scale point. The formula for linearity error is:
(Nominal setting) – (Adjusted 5730A Setting)
Linearity Error=
(Nominal Full Scale)
Where the "nominal setting" is calculated by subtracting the offset error and a
proportional part of the scale error.
4-37
Advertisement
Table of Contents
