Forum

Author Topic: Raster Calculator omits multipliers with floating point (1.7.3 Pro)  (Read 2247 times)

nprp

  • Newbie
  • *
  • Posts: 7
    • View Profile
I've just noticed that Raster Calculator delivers incorrect result in case there is at least one floating point multiplier in the transform formula.

For example, let's compare the following:
1. 1.5*B1 vs (3/2)*B1   
(1.5*B1 results the same as B1 )

2. 2.99*B1 vs 3*B1   -  I can see that 2.99*B1 results the same as 2*B1


Alexey Pasumansky

  • Agisoft Technical Support
  • Hero Member
  • *****
  • Posts: 14813
    • View Profile
Re: Raster Calculator omits multipliers with floating point (1.7.3 Pro)
« Reply #1 on: August 27, 2021, 08:10:22 PM »
Hello nprp,

I've tried to reproduce the problem in 1.7.4 version, but floating point multipliers seem to be treated properly.

How are you checking or comparing the results?
Best regards,
Alexey Pasumansky,
Agisoft LLC

nprp

  • Newbie
  • *
  • Posts: 7
    • View Profile
Re: Raster Calculator omits multipliers with floating point (1.7.3 Pro)
« Reply #2 on: August 30, 2021, 11:01:45 AM »
I've just updated to 1.7.4 and the problem is gone!  8) Thanks.

For a record: I had been comparing histogram values and general appearance of the orthomosaic after applying different formulae.