Specifications; Resistance Measurement - Teledyne T3MIL50 User Manual

Specifications

Conditions
Background

Resistance Measurement

50000 counts
Range
5mΩ
50mΩ
500mΩ
5Ω
50Ω
500Ω
5kΩ
50kΩ
500kΩ
T3MIL50X Only
5MΩ
T3MIL50 Only
5MΩ
*When use 5mΩ range, in order to obtain a stable value, it is recommended to
use 10 times average and fixed connection method such as lock.
*When the instrument is set to 5mΩ or 50mΩ or 500mΩ ranges, the
resistance value will be changed while connecting or disconnecting the test
The specifications are applicable under the following
conditions:
 A 1-year calibration cycle.
 An operating temperature of 18 to 28 ˚C (64.4 to
82.4˚F).
 Relative humidity not exceeding 80%.
 Accuracy is expressed as ± (percentage of reading +
percentage of range).
 The instrument requires 30 minutes warm-up time
and must be operated at the slow measurement rate
to achieve rated accuracy.
 The power cord protective grounding conductor
must be connected to ground.
Resolution Measuring
Current
0.1μΩ 1A
1 μΩ
1A
10 μΩ
100mA
100 μΩ
100mA
1mΩ 10mA
10mΩ 1mA
100mΩ 100μA
1Ω 100μA
10Ω 10μA
100Ω 1μA
100Ω 1μA
Accuracy Open-Termi
nal Voltage
~6.25V
±(0.1%+0.2%)
~6.25V
±(0.1%+0.02%)
±(0.05%+0.02%) ~6.25V
±(0.05%+0.02%) ~6.25V
±(0.05%+0.02%) ~6.25V
±(0.05%+0.008%) ~6.25V
±(0.05%+0.008%) ~6.25V
±(0.05%+0.008%) ~6.25V
±(0.05%+0.008%) ~6.25V
±(0.5%+0.008%) ~6.25V
±(0.2%+0.008%) ~6.25V
APPENDIX
145