Opened 3 years ago

Closed 7 weeks ago

#758 closed enhancement (fixed)

Evaluate the use of fixed number of decimal places in numeric representations

Reported by: pcampalani Owned by: vmerticariu
Priority: major Milestone: Future
Component: petascope Version: development
Keywords: significant figures decimal digits Cc: dmisev, pbaumann, vmerticariu
Complexity: Medium


While the current policy on numerical representations (both coordinates and data values) is to reach the highest precision possible, it is common practice to deliver data with a fixed number of either decimal places or significant figures.

As far as I understand, a fixed representation is useful when interpreting the data uncertainty, and it can help a software implementation choosing the best data type to use (float, double, etc) to store values associated to a given data component.

Regarding data values, this feature should be embedded in the encoding phase of rasdaman directly (via a parameter which shall be taken from petascopedb::ps_quantity.significant_figures).

Regarding coordinates (both absolute and relative), a deeper inspection should be done. Maybe using fixed 15 decimal places like GDAL does.

Change History (5)

comment:1 Changed 3 years ago by pbaumann

sounds like an interesting idea to deliberate in the future. Tricky numeric effects are luring, so serious investigations will be required for sure.

comment:2 Changed 2 years ago by dmisev

  • Cc vmerticariu added; abeccati removed
  • Milestone changed from 9.1 to 9.2

comment:3 Changed 22 months ago by dmisev

  • Owner changed from pcampalani to vmerticariu
  • Status changed from new to assigned

comment:4 Changed 10 months ago by dmisev

  • Milestone changed from 9.2 to Future

comment:5 Changed 7 weeks ago by bphamhuu

  • Resolution set to fixed
  • Status changed from assigned to closed

It has been used BigDecimal? in Petascope for a long time, so can be closed here.

Note: See TracTickets for help on using tickets.