Appendix 6 Numerical Type Comparison Accuracy - Mitsubishi Electric MELSEC iQ-R Series User Manual

Appendix 6
Numerical Type Comparison Accuracy
When a numerical type (integer type and float type) data value and a constant are compared with a comparison operator ("=",
"", "", ""), the fractional part of the data value is rounded off to the number of digits matched with the one for the
comparison target constant.
A data value used for scaling is rounded off after the scaling.
Example) When a data value is: 11.23465673, and a comparison operator is: ""
■When a comparison target constant is: 11.23
The data value is rounded off to 11.23, and the condition (11.2311.23) is established.
■When a comparison target constant is: 11.230
The data value is rounded off to 11.235, and the condition (11.23511.230) is not established.
A
APPX
343

Appendix 6 Numerical Type Comparison Accuracy