Resolution - Beckhoff EL3692 Manual

Commissioning
Fig. 157: Calculated maximum relative measuring error relative to the current measured value in the
respective measuring range
Example from above: 50 Ω -> max. error 0.5 Ω, corresponding to 1% relative measuring error. The grey area
is only shown for illustration and is not a valid measuring range.
5.8.6

Resolution

The following table shows the resolution for each measuring range.
Measuring range
-1 (0xFF/255)
0
1
2
3
4
5
6
7
156
Measured variable
0 - 0.1 Ω
100 mΩ - 1 Ω
1 Ω - 10 Ω
10 Ω - 100 Ω
100 Ω - 1 kΩ
1 kΩ - 10 kΩ
10 kΩ - 100 kΩ
100 kΩ - 1 MΩ
1 MΩ - 10 MΩ
Version: 3.1
Resolution
11.9 nΩ/Digit
119 nΩ/Digit
1.19 µΩ/Digit
11.9 µΩ/Digit
119 µΩ/Digit
1.19 mΩ/Digit
11.9 mΩ/Digit
119 mΩ/Digit
1.19 Ω/Digit
EL3692