Macaulay2 » Documentation
Packages » Macaulay2Doc » The Macaulay2 language » Thing » Number » InexactNumber » precision

next | previous | forward | backward | up | index | toc

precision

Usage:

precision x
Inputs:
- x, a ring, a matrix, a ring element, or a number
Outputs:
- an integer, the precision to which x or its instances are stored

Description

i1 : precision 3p111

o1 = 111

i2 : precision (RR[x])

o2 = 53

i3 : precision 3

o3 = infinity

o3 : InfiniteNumber

Ways to use precision:

precision(FractionField)
precision(GaloisField)
precision(InexactField)
precision(InexactNumber)
precision(Matrix)
precision(MutableMatrix)
precision(Number)
precision(PolynomialRing)
precision(QuotientRing)
precision(Ring)
precision(RingElement)

For the programmer

The object precision is a method function.

The source of this document is in Macaulay2Doc/doc3.m2:103:0.