Calculation Range; Decimal Numbers; Hexadecimal Numbers - Canon F-73P Instructions Manual

Table of Contents

Advertisement

4. Calculation Range
4-1 Decimal Numbers
A maximum of 10 digits in the mantissa, or 8
digits in the mantissa with 2 digits in the expo-
nent,
can be entered or displayed. A negative
value is indicated by adding a minus (-) sign.
The calculation range is defined as
follows:
+
1
x
1
o1oo
"t
Out of Range
~+~9~
.
9~9~99~9=9
7
99~9~X~10~ 9 ~ 9 --~---
Positive Value
I
+1X10
-
99
---
-- - - 0
Negative
Value
-1
x
1
o-
99
-
9.
999999999
X
1 0
99
Calculation
Range
-1
0
x
10
100
.J
Out of Range
• If the result of a calculation is out of the above range,
an error
occurs.
• For the calculation range during function calculation,
refer to 4-4, Range and Accuracy of Functions.
26
4-2 Hexadecimal Numbers
A maximum of 1 0 hexadecimal digits can be en-
tered and
displayed.
Negative hexadecimal
values are expressed by their two's compliment.
The calculation range is defined as follows:
8000000000
7FF
FF
FFFF
F
I
Positive Value
1
0
FF
FF
FF
FFF
F
Negative Value
800000000
1
8000000000
"t
Out of Range
Calculation
Range
.J
Out of Range
• If the result of a calculation is out of the above range
an error occurs.
The hexadecimal numbers A to Fare displayed as
follows:
A
1
,q
B
1
b
c
1
c
D
1
d
F
1
F
27

Hide quick links:

Advertisement

Table of Contents
loading

Table of Contents