You've just put a yellow square on the schematic, that doesn't tell us how you've connected the fan.
If you connected the fan +v to where the yellow square is, and the -ve to ground then the fan is connected directly across the power rails. The only way the fan speed could be controlled in that case is if you have made an error in the construction and the BD140 is actually shunting the power supply and causing the voltage to drop, though this would reverse the control law