Estimating Calculation Results - Radio Shack EC-252 Owner's Manual

Metric conversion calculator
Table of Contents

Advertisement

65-538.fm Page 9 Monday, December 13, 1999 9:15 AM

Estimating Calculation Results

If you perform a calculation that results in
an overflow error, you can estimate the cor-
rect result (to 8 significant digits) by follow-
ing these steps.
1. Count the number of digits displayed
to the left of the decimal point.
2. Remove the decimal point.
3. Add as many zeros to the right of the
number as there were digits to the left
of the decimal point.
For example, the displayed value
1.0142064
101,420,640.
is
estimated
ERROR
to
equal
9

Advertisement

Table of Contents
loading

Table of Contents