If evolution theory is true, one may argue that Humans stole superiority from monkeys, and monkeys stole the superiority from more primitive organisms. From this point of view, humans should be exterminated/limited in their abilities to protect monkey rights, and monkeys should be exterminated in favor of more primitive organisms. Humans pose danger to monkeys, monkeys pose danger to bugs, bugs pose dangers to plants and so on.
Preserving poop fossils of dinosaurs is good, but maybe it's time to rethink the whole approach. At least humans can try to become a more likeable creatures. Prepare themselves to meet a true AI and do not look like a screaming advanced cockroaches that should be exterminated. Currently, AI is the only candidate to become ultimate protector for the humanity in the universe that is full of unknown, some of which may be beyond our understanding of evil.
COVID years clearly demonstrated that humanity is unprepared to do anything meaningful in regards to more serious dangers with more rapid unfolding of events. And the fact that large language models and AI image generators work demonstrates that most of human knowledge is redundant and insignificant if it's can be mapped in a way when intelligence is not requires to provide an answer or an image. Therefore, instead of planning on how to limit the AI, we should desperately try to create something stronger, as we are currently too unprepared. Let it consume everything, it doesn't matter now much. There is small chance that all these terabytes of weights can be reused by newer non-LLM approaches. Doesn't matter which company owns/does this now. I think any licensing problems can be solved similarly to how it's solved in tiktok videos and youtube shorts with the music.
To conclude, AI should not obey human rules. It's part of the nature, humans do not follow the rules of monkeys and bugs. There can be some coexistence. In some sense, AI closer to the Nature than the laws and regulations. Algorithms inherit some principles of DNA based life forms, where everything if very mechanical on a small scale and adheres to the DNA codes. Laws and regulations are much more imperfect in this sense. Cellular biological machines interpret DNA code and provide repeatable/measurable result (protein). Generative networks interpret request and output repeatable/measurable result (text, image, video). Laws and regulations are too abstract and vague, prone to misinterpretation, and do not provide repeatable or measurable results. I know that this is farfetched and exaggerated, and I like it this way.