Jump to content

Precision (numbers)

From Simple English Wikipedia, the free encyclopedia
Revision as of 05:35, 1 June 2024 by imported>Codename Noreste (Reverted edits by 2600:8801:2A9C:CB00:A5BD:53B:7A82:B2B (talk) to last version by 9m3gvdk: unexplained content removal)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)

In mathematics, precision describes the level of exactness in a number's digits. For example, the number 54.6 has precision 1 (one decimal digit). A number with end zeroes ("00") has a negative precision, such as 500 having precision -2, or 4,000 as precision -3. A whole number (not ending in "0") has precision 0.

The level of precision differs from the word "accuracy" of a number, which means the correctness or truth of a number as used to describe an item or count.