1. Institut für Technische Optik Avatar Institut für Technische Optik
  2. itom
  3. designerPlugins
  4. Issues

Picker of float32/float64 object of itom1dqwtplot shows rounded values instead of precise values

Issue #36 resolved
M. Gronle created an issue

Example code:

‌

a = dataObject([1,5], 'float32', data=(170.1, 170.3, 170, 169.8, 170.1))
plot1(a)

‌

The displayed value is 170, although it should be 170.1 for the first point.

Comments (2)

  1. M. Gronle reporter

    itom1dqwtplot: improved number representation of the value picker and the coordinates in the toolbar. Numbers < 100000 will be displayed with three decimal digits, other values will be displayed using the +-9.99E100 representation. This fixes issue #36.

    → <<cset 60c22de5ebe1>>

  2. M. Gronle reporter

    itom1dqwtplot: improved number representation of the value picker and the coordinates in the toolbar. Numbers < 100000 will be displayed with three decimal digits, other values will be displayed using the +-9.99E100 representation. This fixes issue #36.

    → <<cset 829fbfc971c4>>

  3. Log in to comment
Assignee
Institut für Technische Optik
Type
bug
Priority
major
Status
resolved
Votes
0
Watchers
2
Jira: the preferred issue tracker for Bitbucket. Join the team!