The concept of least-squares observer is revisited. Robustness properties of this class of observers with respect to norm-bounded measurement noise are investigated and shown to be very much dependent on the operator chosen for the observer implementation. For the case of a harmonic oscillator, an explicit observer parameterization in terms of the implementation operator and the oscillator frequency is obtained, and observer's existence conditions are proven and analyzed.