A couple more things:
Setting up an alert, I enabled the option for the sound to be looped while the trigger was active. When the trigger became active, the sound played as expected but when the trigger became inactive, the sound continued playing. Editing the alert, I noticed that the option to look wasn't showing as checked - setting it, saving and then going back in showed that it wasn't remembering the setting. Meanwhile, the sound is still playing, so it looks like I'll have to shut down the program to stop it...