8.9 Experimental data and results

Experimental data

Training

For our training set, we used purely monophonic recordings to ease manual classification. One fullchromatic scale was recorded for each of our three instruments. We note that our training is weak, as we only provided one recordingfor each instrument. By covering the full range of the instrument, we give roughly equal weights to every note, whereas mostinstruments have a standard playing range and rarely play in the lower or upper limits or their range. Since the spectrum is moreapt to skewing effects in the extreme ranges, our average spectral envelope and training features are also negatively affected.

Finally, if we wanted our training set to perform better with polyphonic recordings, we would in practicealso provide a few polyphonic recordings as part of our training set. This would allow features unique to polyphonic environments tobe modeled as well. For example, a clarinet and trumpet usually cover the melody and are therefore more predominant than a tenorsaxophone.

Testing

One short monophonic tune per instrument was recorded, as well as two short polyphonic tunes with eachinstrument combination (clarinet + saxophone, clarinet + trumpet, saxophone + trumpet, all), generating a total of 9recordings.

Results

Self-validation

We first tested our GMM with the training set to determine how accurate it would be at classifying the data thattrained it. The confusion matrix is shown below. (Our confusion matrix shows the actual classification at the left, and thepredicted classification at the top.)

Monophonic recordings

Satisfied that our GMM could classify the training data accurately, we then tested it on a new set ofmonophonic recordings.

Average instrument identification using our GMM was 75%, whereas pure guessing would land us at 33.3%. We alsosee that in our test data, the clarinet and saxophone are confused the most often and can therefore be considered the most similar.This makes sense as both belong to the same instrument family (woodwinds), whereas a trumpet is a brass instrument. In contrast,the clarinet and the trumpet were confused the least often, which is also as expected since their spectrum represent the two extremeswithin our tested instruments. We are unsure of why the clarinet is often mistaken as a trumpet, but a trumpet is not mistaken as aclarinet, but we believe part of the problem may lie again in our training data, as the self-validation tests showed that theclarinet and trumpet were almost exclusive of one another, and our GMM may have started to memorize the training data.

The following figures show the performed piece of music and the results of our detection and classificationalgorithm. We note that some discrepancies are due to player error (key fumbles, incorrect rhythmic counting, etc). We follow ourcoloring scheme of blue representing clarinet, green saxophone, and red trumpet.

Polyphonic recordings

Finally, we input some polyphonic recordings and compared the experimental outputs to the input music.Quantitative validation is not provided, as it would require us to manually feed into the validation program which instruments at whattime. Visually however, we can clearly see that our algorithm correctly separates the melody line, as played by the clarinet,from the lower harmony line, as played by the tenor saxophone.