RTFDS.
Typically, resistors have a rectangular SOA (safe operating area), with maximum voltage and current across the family regardless of value, and a power limit cutting across that rectangle. So you get a truncated hyperbola region. (Hyperbola being, for constant power, V and I are inversely proportional, so it's a section of the 1/x curve, scaled appropriately.)
This is true even for "zero ohm" jumper types. The limit might simply be convenience, but might also be limited by materials ("zero ohm" jumpers are typically some 10s of mohm; a full solid layer of resistive material, not an actual short), construction (typically resistors are laser-trimmed, blasting away a slot of material; the inside corners of that slot can get VERY hot at ratings), leads (THT resistors typically use tin-plated steel leads) and so on.
How much, depends on the type. There are typical ratings for typical parts/styles (e.g., axial 1/4W carbon film, usually 300V or so), but safer not to make assumptions. Also, if you're buying eBay/Ali/Amazon specials, all bets are off...
Interestingly, I've seen chip resistors as small as 0603 with multi-kV ratings -- sounds unbelievable, right? You're right to think so; they only achieve that rating when encapsulated in potting. Read the datasheet carefully.
Tim