There is this ongoing another thread about "intermittent problems". Yours is not intermittent, but the same applies:
You need to add visibility to the system and investigate systematically.
Some slaves do not respond. Possible causes:
* They do respond, but master does not hear them
* They actually do not respond
Let's assume the latter... Why don't they respond?
* They don't see the poll command
* They do see it, but fail to reply correctly
You see where this is leading? You need to know what part of your code is running. Simplest way: make the thing switch an IO pin to a different state when it receives the command. Look at the pin with an oscilloscope. You can also use UART printing, or a debugger, adding a breakpoint. Many different ways, but the troubleshooting strategy is important.