Journal Article

Data boundary fitting using a generalized least-squares method

N. Cardiel

in Monthly Notices of the Royal Astronomical Society

Published on behalf of The Royal Astronomical Society

Volume 396, issue 2, pages 680-695
Published in print June 2009 | ISSN: 0035-8711
Published online June 2009 | e-ISSN: 1365-2966 | DOI:
Data boundary fitting using a generalized least-squares method

More Like This

Show all results sharing this subject:

  • Astronomy and Astrophysics


Show Summary Details


In many astronomical problems one often needs to determine the upper and/or lower boundary of a given data set. An automatic and objective approach consists in fitting the data using a generalized least-squares method, where the function to be minimized is defined to handle asymmetrically the data at both sides of the boundary. In order to minimize the cost function, a numerical approach, based on the popular downhill simplex method, is employed. The procedure is valid for any numerically computable function. Simple polynomials provide good boundaries in common situations. For data exhibiting a complex behaviour, the use of adaptive splines gives excellent results. Since the described method is sensitive to extreme data points, the simultaneous introduction of error weighting and the flexibility of allowing some points to fall outside of the fitted frontier, supplies the parameters that help to tune the boundary fitting depending on the nature of the considered problem. Two simple examples are presented, namely the estimation of spectra pseudo-continuum and the segregation of scattered data into ranges. The normalization of the data ranges prior to the fitting computation typically reduces both the numerical errors and the number of iterations required during the iterative minimization procedure.

Keywords: methods: data analysis; methods: numerical

Journal Article.  12066 words.  Illustrated.

Subjects: Astronomy and Astrophysics

Full text: subscription required

How to subscribe Recommend to my Librarian

Users without a subscription are not able to see the full content. Please, subscribe or login to access all content.