It's always brown-red or red-orange that gives me the most problem, much more if it's old fading part. Some use better, easily discernible paint than others. Some use certain shade of base paint that exacerbate things.
My other problem is with 1% resistors. I always not sure if it's read one way or the other way around.
Both of these, although mine is more to do with brown-orange.
Keep in mind for us oldies that parts are smaller nowadays and five band codes are way more common, that might have an affect on ease of recognition.
For example, I keep a selection of a couple of hundred resistors in the E3 series ready for solderless breadboarding from 1 ohm to 10M ohm in a transparent ziplock bag, some are four band and some five band. Some are 1/4W and some are 1/8W size. The four band I have no problem at all recognising just by glance, it’s the five banders, in both sizes, that I seem to have a slight recognition dyslexia with, I have to think a bit unlike the four banders.
The only thing I struggle with memory-wise is the gold and silver multiplier, I mix thise up, that’s the only time I find myself resorting to a meter.
I learned the rainbow based way when I was a kid, figuring that out by myself. Just like riding a bicycle, I found that you don’t forget. The resistor colour codes were also often used in ribbon cables back in the 80s but I haven’t seem this as much recently. On wiring jobs in the microprocessor era I tended to follow bus signal numbers with the resistor colour code when wiring up stuff off the board.
The EIA96 SMD resistor codes on 0603 and larger that don’t follow the rainbow code I have little clue about and have to refer to the datasheets on the odd occasion I need to figure out a value: often a meter is faster in that instance especially out of circuit.