I'm not too bothered with small stuff. I went on a fire safety day course a while back plus I've stabbed a few fully charged packs to see what would happen which is quite interesting.
If it goes up, it goes up. The thing to do is plan for worst case. For me this is all exits clear, no charging unattended (that includes asleep at night - everything goes off!!!), fire plan, proper smoke and CO2 detectors in the house and suitable fire extinguishers. You can't really fight a lithium fire without a class D fire extinguisher and those are really expensive so best thing is let it burn but prevent spread so treat what's around it like it's already on fire. Then wait for the professionals to turn up.
The killers are very high energy density packs like storage. The average laptop or phone will burn out in a few seconds. RC lipo packs or above need protective storage IMHO.