Calibration Verification Limits; Example Reading Limit Calculation; Calculating Resistance Reading Limits - Tektronix KEITHLEY DMM6500 Calibration Manual

6 1/2-digit multimeter with scanning
Table of Contents

Advertisement

Section 2: Performance verification

Calibration verification limits

The calibration verification limits stated in this section have been calculated using only the DMM6500
one-year accuracy specifications and ambient temperature ±5 °C from T
the instrument was calibrated). They do not include test equipment uncertainty. If a particular
measurement falls outside the allowable range, recalculate new limits based on both the DMM6500
specifications and corresponding test equipment specifications.
Specifications and characteristics are subject to change without notice; please refer to the
Instruments website

Example reading limit calculation

Assume you are testing the 10 V dc range using a 10 V input value. Using the DMM6500 one-year
accuracy specification for 10 V dc of ± (25 ppm of reading + 5 ppm of range), the calculated limits are:

Calculating resistance reading limits

Resistance reading limits must be recalculated based on the actual calibration resistance values
supplied by the equipment manufacturer. Calculations are performed in the same manner as shown
in the preceding example. Use the actual calibration resistance values instead of the nominal values
in the example when performing your calculations.
For example, assume that you are testing the 10 kΩ range using an actual 10.03 kΩ calibration
resistance value. Using DMM6500 one-year 10 kΩ range accuracy of ± (75 ppm of reading + 6 ppm
of range), the calculated reading limits are:
2-4
DMM6500 6½-Digit Multimeter with Scanning Calibration and Adjustment Manual
(tek.com/keithley) for the most recent specifications.
Reading limits = 10 V ± [(10 V × 25 ppm) + (10 V × 5 ppm)]
Reading limits = 10 V ± (0.00025 + 0.00005) V
Reading limits = 10 V ± 0.00030 V
Reading limits = 9.99970 V to 10.00030 V
Reading limits = 10.03 kΩ ± [(10.03 kΩ x 75 ppm) + (10 kΩ x 6 ppm)]
Reading limits = 10.03 kΩ ± [(0.7523) + (0.06)] Ω
Reading limits = 10.03 kΩ ± 0.8123 Ω
Reading limits = 10.029188 kΩ to 10.030812 kΩ
(the temperature at which
CAL
Keithley
DMM6500-905-01 Rev. E June 2021

Advertisement

Table of Contents
loading

Table of Contents