How could the engineering process be any clearer?
Desire to design a universal serial interface to replace the hodgepodge of connectors currently in use such as DB25 and DB9 serial and parallel ports, DB15 game ports, SCSI ports, PS/2 kb/mouse, bus mouse, etc while also providing power to the devices. The standard USB connectors were made to be robust and foolproof, easy to manufacture, sturdy, easy to insert and remove, durable enough to handle loads of insert/removal cycles, designed to connect power before data, the USB A and B connectors are what they came up with.
Now fast forward 10-15 years, USB is widely adopted, now in addition to scanners, printers, joysticks, zip drives, CD-ROM drives, 3.5" hard drives and other peripherals we start seeing small portable devices like 2.5" hard drives, digital cameras and MP3 players, later PDAs, the crude ancestors of modern tablets. Initially these devices used proprietary miniature connectors but then someone had the bright idea of making a miniaturized USB connector that would be standardized. It sacrifices some mechanical robustness in exchange for small size but that's ok because the devices it's intended for are very small and light weight compared to previous peripherals so it doesn't have to be as strong.
Move forward a few years further and we have even smaller, thinner devices. Soon it becomes apparent that an even thinner USB connector would be nice to have for these devices, so now we have micro USB. This further sacrifices mechanical strength in exchange for even smaller size but again this is ok because the devices have gotten even smaller and lighter.
There's really no mystery here, needs came along followed by new needs and each time engineers did what engineers do and came up with solutions to those needs.