Search found 2 matches
- Thu Aug 09, 2018 7:18 pm
- Forum: VCL
- Topic: TeePoly epsilon value
- Replies: 3
- Views: 10229
Re: TeePoly epsilon value
Further testing seems to indicate that the original Error value for GaussianFitting is fine as long as it is defined based on the type of floating point value used. The Math.IsZero uses an epsilon that may not be optimal for the PolyFitting procedure. With this concept, only these two changes to the...
- Tue Aug 07, 2018 4:48 pm
- Forum: VCL
- Topic: TeePoly epsilon value
- Replies: 3
- Views: 10229
TeePoly epsilon value
TeeChart Pro v2018.24.180321, Delphi Tokyo 10.2.3. TeePoly defines Float as Extended. The call in PolyFitting to GaussianFitting uses a fixed epsilon of 1.0e-15. When TeePoly is compiled for x64, Extended is mapped to Double by the compiler. This causes the epsilon to have different results for Exte...