#ai-poisoning

[ follow ]
Artificial intelligence
fromFast Company
1 week ago

What are AI tarpits? Understanding the tools people are using to poison LLMs

AI poisoning corrupts chatbot models by injecting misleading data during training, degrading output quality and potentially driving users away.
fromTheregister
7 months ago

Data quantity doesn't matter when poisoning an LLM

Researchers at the US AI firm, working with the UK AI Security Institute, Alan Turing Institute, and other academic institutions, said today that it takes only 250 specially crafted documents to force a generative AI model to spit out gibberish when presented with a certain trigger phrase. For those unfamiliar with AI poisoning, it's an attack that relies on introducing malicious information into AI training datasets that convinces them to return, say, faulty code snippets or exfiltrate sensitive data.
Artificial intelligence
[ Load more ]