"Law firm Cozen O'Connor has a rule against using publicly available chatbots to draft legal filings. But after a judge penalized two of its lawyers for citing fake cases, the firm is adding some extra protection: an AI hallucination detector. Cozen O'Connor is now testing software, made by a startup called Clearbrief, that scans legal briefs for made-up facts and produces a report. Think spell-check, except instead of flagging typos, it spots the fictional cases and citations that generative tools sometimes invent."
"Stung by embarrassing AI hallucinations, the legal field has adopted bans on general-use chatbots and AI assistants. But it's hard to stop a curious associate from pasting a draft into a free, browser-based chatbot like ChatGPT, Claude, or Gemini. Now law firms and legal tech companies are scrambling to lower the risk of bogus citations and catch those that sneak through before they land in front of a judge."
"Two of Cozen O'Connor's defense lawyers in September admitted they had filed a document riddled with fake cases after one of them used ChatGPT to draft it, against firm policy. A Nevada district court judge gave the firm a choice: remove the lawyers from the case and pay $2,500 in sanctions each, or have the pair write to their former law school deans and bar authorities explaining the fiasco and offering to speak in seminars on topics like "professional conduct.""
Cozen O'Connor prohibits use of publicly available chatbots for drafting legal filings and is testing Clearbrief, software that scans briefs for made-up facts and generates reports. Law firms have instituted bans on general-use chatbots and AI assistants after courts increasingly found bogus citations in filings. Curious associates can still paste drafts into free browser-based chatbots such as ChatGPT, Claude, or Gemini, creating hallucination risks. Legal tech companies and firms are deploying detection tools to flag fictional cases and citations before filings reach judges. A Nevada judge penalized two lawyers for filing a document with fabricated cases, prompting internal discipline.
Read at Business Insider
Unable to calculate read time
Collection
[
|
...
]