I have found the wisp of flux fumes that rises from the joint is almost magnetically attracted to my face. My first cure for this is to have a small, low speed fan blowing gently sideways across the work so it moves the fumes away and they don't come towards me. The second part is to work in a large, ventilated space. You must have outside ventilation whenever fumes are being produced, whether solder fumes, solvent fumes, paint fumes, or anything like that. I think you should look into an extractor fan and ducting, perhaps a bathroom extractor or kitchen extractor leading to the outside.
One important thing about the "small Weller fan". Small fans only work effectively when blowing. They are nearly useless when sucking. So to avoid smoke in your nose, eyes and lungs, make sure you have a fan flowing the fumes away from your face. If your basement is large enough they will disperse and natural ventilation will do the rest.