Search found 2 matches

by tmac2
Thu Aug 09, 2018 7:18 pm
Forum: VCL
Topic: TeePoly epsilon value
Replies: 3
Views: 9788

Re: TeePoly epsilon value

Further testing seems to indicate that the original Error value for GaussianFitting is fine as long as it is defined based on the type of floating point value used. The Math.IsZero uses an epsilon that may not be optimal for the PolyFitting procedure. With this concept, only these two changes to the...
by tmac2
Tue Aug 07, 2018 4:48 pm
Forum: VCL
Topic: TeePoly epsilon value
Replies: 3
Views: 9788

TeePoly epsilon value

TeeChart Pro v2018.24.180321, Delphi Tokyo 10.2.3. TeePoly defines Float as Extended. The call in PolyFitting to GaussianFitting uses a fixed epsilon of 1.0e-15. When TeePoly is compiled for x64, Extended is mapped to Double by the compiler. This causes the epsilon to have different results for Exte...