Not just that. If you assume an LLM has agency, you - the company making it - can conveniently waive all responsibility for its “actions”. “We didn’t cause this. The AI chose do to it.” This may become increasingly relevant the more idiots deciders allow these systems to access, if not entirely control vital systems. Think: power grid, water supplies, food production and related logistics, communications, military applications.
Except they’re the ones who released the hypothetically sentient AI into the wild. They should be liable for that action too.
And the notion of LLMs controlling safety-critical systems scares the piss out of me. I develop such systems, and LLMs are incapable of providing rigorous proof of the rationale behind their decisions. Therefore, they cannot be validated to provide correct conclusions based on a given data set. Unless and until that changes, they should be banned from anything that affects people’s lives, livelihoods or physical well-being.
“Putting non-deterministic hallucination machines in charge of critical systems? What could possibly go wrong?” ¯\_(ツ)_/¯
- Humanity’s famous last words
Isn’t that argument shaky still? Parents are liable for the actions of their children to a certain age. Just because an entity has agency or rights, doesn’t mean the person who is hosting the entity is free of responsibilities.
Not just that. If you assume an LLM has agency, you - the company making it - can conveniently waive all responsibility for its “actions”. “We didn’t cause this. The AI chose do to it.” This may become increasingly relevant the more
idiotsdeciders allow these systems to access, if not entirely control vital systems. Think: power grid, water supplies, food production and related logistics, communications, military applications.Except they’re the ones who released the hypothetically sentient AI into the wild. They should be liable for that action too.
And the notion of LLMs controlling safety-critical systems scares the piss out of me. I develop such systems, and LLMs are incapable of providing rigorous proof of the rationale behind their decisions. Therefore, they cannot be validated to provide correct conclusions based on a given data set. Unless and until that changes, they should be banned from anything that affects people’s lives, livelihoods or physical well-being.
“Putting non-deterministic hallucination machines in charge of critical systems? What could possibly go wrong?” ¯\_(ツ)_/¯
- Humanity’s famous last words
Isn’t that argument shaky still? Parents are liable for the actions of their children to a certain age. Just because an entity has agency or rights, doesn’t mean the person who is hosting the entity is free of responsibilities.