Attached is a circuit that might work. I say might because it depends on how the bluetooth button actually works ( connects a positive voltage to ground, etc ) and how the piezo buzzer is driven, if it even has enough voltage to charge the capacitor, if not you want to amplify it with another transistor. Also on what resistance the bluetooth device recognizes as pressed vs not pressed.
Depending on all of those you're going to want to choose different values for the cap, resistors + different MOSFET
Connect piezo on the left, and bluetooth button on the right.