Calculation Ranges, Number Of Digits, And Precision - Casio FX-300ES PLUS User Manual

Hide thumbs Also See for FX-300ES PLUS:
Table of Contents

Advertisement

Note: • The maximum number of rows in the generated number table depends
on the setup menu table setting. Up to 30 rows are supported for the "f(x)"
setting, while 20 rows are supported for the "f(x),g(x)" setting. • You can
use the number table screen for viewing values only. Table contents cannot
be edited. • The number table generation operation causes the contents of
variable X to be changed.
Important: The function you input for number table generation is deleted
whenever you display the setup menu in the TABLE Mode and switch between
Natural Display and Linear Display.
Calculation Ranges, Number of Digits,
and Precision
The calculation range, number of digits used for internal calculation, and
calculation precision depend on the type of calculation you are performing.
Calculation Range and Precision
Calculation Range
Number of Digits for Internal
Calculation
Precision
Function Calculation Input Ranges and Precision
Functions
x
x
sin
cos
x
tan
x
x
–1
–1
sin
cos
x
–1
tan
x
sinh
x
cosh
x
–1
sinh
x
–1
cosh
x
tanh
x
–1
tanh
x
x
log
/ln
x
10
x
e
'
x
|
|
x
0
DEG
|
|
x
0
RAD
|
|
x
0
GRA
Same as sin
DEG
Same as sin
RAD
Same as sin
GRA
|
|
x
0
1
|
|
9.999999999 × 10
x
0
|
|
x
0
230.2585092
|
|
4.999999999 × 10
x
0
4.999999999 × 10
x
1
|
|
9.999999999 × 10
x
0
|
|
9.999999999 × 10
x
0
9.999999999 × 10
x
0
–9.999999999 × 10
–9.999999999 × 10
1 × 10
x
0
± 1 × 10
to ± 9.999999999 × 10
–99
15 digits
In general, ± 1 at the 10th digit for a single
calculation. Precision for exponential
display is ± 1 at the least significant digit.
Errors are cumulative in the case of
consecutive calculations.
Input Range
9 × 10
9
157079632.7
1 × 10
10
, except when |
x
, except when |
x
, except when |
x
99
99
99
99
–1
99
x
99
99.99999999
x
99
230.2585092
100
E-26
99
or 0
| = (2
–1) × 90.
x
n
| = (2
–1) × π /2.
x
n
| = (2
–1) × 100.
x
n

Advertisement

Table of Contents
loading

Table of Contents