8.6 Sinusoidal harmonic modeling

Sinusoid harmonic modeling

We would like to capture the “typical” spectrum for each instrument, independent of the pitch beingproduced. This allows us to classify a signal using our model without providing the pitch as another parameter to the model. (Wenote that this method is not without consequences, as the frequency response of the instrument changes the spectrum depending on thenote being played. For example, very low and very high notes are more likely to vary than notes at mid-range. We decided to go withthis approach to save time in model training and hopefully reduce the dimensionality of our problem.)

Sinusoidal harmonic modeling (SHM) captures the harmonic envelope of a signal (as opposed to its spectralenvelope) and is ideal for tonal sounds produced by wind instruments, as most of the spectral energy is captured in theharmonics. Given a spectrum, SHM finds the fundamental frequency and estimates the harmonics and the harmonic amplitudes, eventuallyproducing a amplitude versus harmonic graph.

From this representation, we can then determine characteristic features of the instrument. For example,qualitatively, we can tell that the spectrum of a clarinet declines rather fast, and that most of the energy is in the odd harmonics.Similarly, we can tell that the saxophone declines slower, and that the trumpet has its harmonic energies relatively distributed amongthe odd and even indices.