Accuracy Specifications - Agilent Technologies 34420A User Manual

ACCURACY SPECIFICATIONS ± (% of reading + % of range)
Function Range
DC Voltage 1.0000000 mV
[3]
10.000000 mV
[3]
100.00000 mV
1.0000000 V
10.000000 V
100.00000 V
[5]
Resistance 1.0000000
10.000000
100.00000
1.0000000 K
10.000000 K
100.00000 K
1.0000000 M
Low Power 1.0000000
[5]
Resistance 10.000000
100.00000
1.0000000 K
10.000000 K
100.00000 K
1.0000000 M
Voltage 10.000000
Limited 100.00000
[5][6]
Resistance
Channel 1 / Channel 2 (DCV Ratio)
Channel 1 - Channel 2 (DCV Difference)
Temperature (resolution = 0.001° C)
[7]
Thermocouple
Thermistor
RTD
[1] Specifications are for Channel 1 or Channel 2, after 2-hour warm-up, resolution at 7.5 digits (100 NPLC), with FILTERS off.
RESISTANCE specifications are for 4-wire ohms or 2-wire ohms using Null. Without Null, add 0.2
function. With Analog Filter ON, add 0.002% of reading to listed specifications.
[2] 20% overrange on all ranges except 5% on Voltage Limited Resistance.
[3] After using Null. If Null is not used add 100 nanovolts.
[4] Channel 1 only.
[5] Channel 1 only. Resistance measurements, for NPLC <1, add 160
[6] Voltage limit can be set to 20 mV (default), 100 mV, or 500 mV. Measured resistance plus Channel 1 HI and LO lead resistance is
limited to 10.5 on the 10
[7] For fixed reference junction. Add 0.3° C for external reference junction, add 2° C for internal reference junction.
Chapter 8 Specifications
34420A Nano Volt/Micro Ohm Meter
Test 24 Hour
[2]
23°C ± 1°C
Current
0.0025 + .0020
0.0025 + .0002
0.0015 + .0003
0.0010 + .0003
0.0002 + .0001
0.0010 + .0004
[4]
10 mA 0.0015 + .0002
10 mA 0.0015 + .0002
10 mA 0.0015 + .0002
1 mA 0.0015 + .0002
100 A 0.0015 + .0002
10 A 0.0015 + .0003
5 A
0.0020 + .0003
10 mA 0.0015 + .0002
10 mA 0.0015 + .0002
1 mA 0.0015 + .0002
100 A 0.0015 + .0002
10 A 0.0015 + .0004
5 A 0.0015 + .0012
5 A 0.0020 + .0003
1 mA 0.0020 + .0002
100 A 0.0025 + .0002
Ratio Error % = Channel 1 accuracy in % + Channel 2 accuracy in %
Difference Error = Channel 1 (% of reading + % of range) + Channel 2 (% of reading + %
of range)
Thermocouple probe accuracy + 0.2° C
Thermistor probe accuracy + 0.1° C
RTD probe accuracy + 0.05° C
range and 105 on the 100
276
90 Day 1 Year
23°C ± 5°C 23°C ± 5°C
0.0040 + .0020 0.0050 + .0020
0.0040 + .0002 0.0050 + .0003
0.0030 + .0004 0.0040 + .0004
0.0025 + .0004 0.0035 + .0004
0.0020 + .0004 0.0030 + .0004
0.0025 + .0005 0.0035 + .0005
0.0050 + .0002 0.0070 + .0002
0.0040 + .0002 0.0060 + .0002
0.0040 + .0002 0.0060 + .0002
0.0040 + .0002 0.0060 + .0002
0.0040 + .0002 0.0060 + .0002
0.0040 + .0004 0.0060 + .0004
0.0050 + .0004 0.0070 + .0004
0.0050 + .0002 0.0070 + .0002
0.0040 + .0002 0.0060 + .0002
0.0040 + .0002 0.0060 + .0002
0.0040 + .0002 0.0060 + .0002
0.0040 + .0004 0.0060 + .0004
0.0040 + .0015 0.0060 + .0015
0.0050 + .0004 0.0070 + .0004
0.0050 + .0002 0.0070 + .0002
0.0050 + .0002 0.0070 + .0002
RMS noise.
range.
[1]
Temperature
Maximum
Coefficient
Per Lead
0°C - 18°C Resistance
28°C - 55°C
0.0004 + .0001
0.0004 + .00002
0.0004 + .00006
0.0004 + .00004
0.0001 + .00002
0.0004 + .00005
0.0005 + .00002
0.0005 + .00001
0.0005 + .00001 10
100
0.0005 + .00001
0.0005 + .00001 1 K
0.0005 + .00002 1 K
1 K
0.0006 + .00003
0.0005 + .00002
0.0005 + .00001
0.0005 + .00001 10
0.0005 + .00001 100
0.0005 + .00003 1 K
0.0005 + .00003 1 K
0.0006 + .00003 1 K
0.0005 + .00002
0.0005 + .00002
additional error in 2-wire ohms
1
1
1
1
1
5