Me when I get a request for PII pertaining to a suspected corruption case: Have one of our corporate lawyers give me a written and explicit statement of what data I’m supposed to send to whom or get bent. I’m not touching that with a ten foot pole and gloves unless I have a legally solid affirmation that what I’m doing won’t come back to bite me, and that our workers’ council knows about it and will back me up.
I’m reluctant to even confirm that I can get that information in the first place. I mean, I’m the one with full access to the audit tool, so I probably do, but I’d have to access that data in the first place to check. I don’t think that anyone would notice or care so long as I don’t share that information, but as you said: dangerously radioactive; don’t touch if I can help it.
LLMs are the embodiment of “close enough”. They’re suitable if you want something resembling a certain mode of speech, formal tone or whatever without having to write it yourself.
When using it to train other LLMs, you’re basically training them to get “close enough” to “close enough”, with each generation getting a little further from “actually good” until, at some point, it’s just not longer close enough.