Semiconductors - however doped - are electrically neutral. For every proton, there's an electron. So no net charge. Period. (If there was any residual charge they'd attract each other like magnets, pick up fluff, be used as batteries etc.)
What the doping does is create dangling atomic bonds. In pure silicon, each atom forms 4 bonds, but when doped it can't quite do that because some atoms will want to make 3 or 5 bonds instead. When there's an excess of 5-bond atoms it's N type. These dangling electrons are still attracted to their parent atom, but because they're not forming a complete bond with the surrounding silicon (or germanium) they are relatively easy to dislodge. They then become a mobile charge carriers which give rise to a current.
Their parent atoms are now positively charged ions and will try to grab a electrons from somewhere nearby. The application of a voltage therefore causes a leap-frog of electrons through the crystal, and that's roughly how it works. Swap the electrons for holes for P type.