Anthropic's Lawyer Apologizes After Claude Hallucinates Legal Citation

In a recent development, a lawyer representing Anthropic acknowledged the use of an incorrect citation generated by the company’s Claude AI chatbot during its ongoing legal dispute with music publishers. The admission came via a court filing in a Northern California courtroom on Thursday.
Anthropic stated in the filing, first reported by Bloomberg, that Claude had fabricated the citation with both an incorrect title and author details. The company's lawyers admitted that their routine citation checks failed to detect the error, along with several other inaccuracies caused by Claude's "hallucinations."
Apologizing for the oversight, Anthropic described the incident as "an honest citation mistake and not a fabrication of authority."
Earlier this week, attorneys for Universal Music Group and other music publishers accused Anthropic’s expert witness, employee Olivia Chen, of referencing fabricated articles in her testimony, allegedly using Claude. Following this, Federal Judge Susan van Keulen requested a response from Anthropic regarding these claims.
The lawsuit brought forth by the music publishers is part of multiple conflicts between copyright holders and tech firms over the alleged misuse of their content to develop generative AI tools.
This marks yet another instance where the use of AI in legal proceedings has led to unintended consequences. Earlier this week, a California judge criticized two law firms for submitting "phony AI-generated research" in his court. In January, an Australian attorney was exposed for utilizing ChatGPT in drafting court documents, resulting in flawed citations.
Despite such incidents, startups continue to attract significant funding to automate legal processes. Harvey, which employs generative AI models to aid lawyers, is reportedly in discussions to secure over $250 million at a valuation exceeding $5 billion.
Techcrunch event ### Join us at TechCrunch Sessions: AI
Reserve your spot at our premier AI industry event featuring speakers from OpenAI, Anthropic, and Cohere. For a limited period, tickets are priced at just $292 for a full day of expert presentations, workshops, and valuable networking opportunities.
Exhibit at TechCrunch Sessions: AI
Book your展位 at TC Sessions: AI and showcase your innovations to 1,200+ decision-makers without breaking the bank. Available until May 9 or while spots last.
Berkeley, CA | June 5 REGISTER NOW
Related article
Anthropic Enters AI Legal Tech Market as Competition Intensifies
Anthropic unveiled a suite of new chatbot capabilities on Tuesday, aimed at delivering automated support to legal practices. These enhancements expand upon Claude for Legal, the firm-specific platform introduced earlier this year, by adding specializ
Anthropic launches Opus 4.8 featuring new dynamic workflow tool
Anthropic unveiled Opus 4.8 on Thursday, marking the latest iteration of its premier public model. Priced identically to its predecessor, this update is now accessible across all platforms.Releasing just 41 days after Opus 4.7, Anthropic has accelera
Anthropic debuts Claude Fable 5, a public version of Mythos
Anthropic is making its most powerful AI model available to the general public for the first time — but with safety measures in place.
On Tuesday, the company launched Claude Fable 5, the first public release of its Mythos model. According to Anthrop
Related Special Topic Recommendations
Comments (3)
0/500
Claudeが法廷で出典を間違えたって、さすがにまずいよね😅 AIの過信は危険だわ。弁護士が謝罪したってことは、実害があったってことだよね。技術の進歩は速いけど、信頼性が追いついてないのが現実。もっと慎重に検証する仕組みが必要だと思う。 #Anthropic #AI
Kann jemand erklären, warum selbst Top-LLMs noch Halluzinationen produzieren? Besonders bei Rechtsthemen ist das echt kritisch. Die Entschuldigung ist ein Schritt, aber wie werden solche Fehler in Zukunft verhindert? 🤔 Bin gespannt, ob sich da bald branchenweite Standards durchsetzen.

In a recent development, a lawyer representing Anthropic acknowledged the use of an incorrect citation generated by the company’s Claude AI chatbot during its ongoing legal dispute with music publishers. The admission came via a court filing in a Northern California courtroom on Thursday.
Anthropic stated in the filing, first reported by Bloomberg, that Claude had fabricated the citation with both an incorrect title and author details. The company's lawyers admitted that their routine citation checks failed to detect the error, along with several other inaccuracies caused by Claude's "hallucinations."
Apologizing for the oversight, Anthropic described the incident as "an honest citation mistake and not a fabrication of authority."
Earlier this week, attorneys for Universal Music Group and other music publishers accused Anthropic’s expert witness, employee Olivia Chen, of referencing fabricated articles in her testimony, allegedly using Claude. Following this, Federal Judge Susan van Keulen requested a response from Anthropic regarding these claims.
The lawsuit brought forth by the music publishers is part of multiple conflicts between copyright holders and tech firms over the alleged misuse of their content to develop generative AI tools.
This marks yet another instance where the use of AI in legal proceedings has led to unintended consequences. Earlier this week, a California judge criticized two law firms for submitting "phony AI-generated research" in his court. In January, an Australian attorney was exposed for utilizing ChatGPT in drafting court documents, resulting in flawed citations.
Despite such incidents, startups continue to attract significant funding to automate legal processes. Harvey, which employs generative AI models to aid lawyers, is reportedly in discussions to secure over $250 million at a valuation exceeding $5 billion.
Techcrunch event ### Join us at TechCrunch Sessions: AI
Reserve your spot at our premier AI industry event featuring speakers from OpenAI, Anthropic, and Cohere. For a limited period, tickets are priced at just $292 for a full day of expert presentations, workshops, and valuable networking opportunities.
Exhibit at TechCrunch Sessions: AI
Book your展位 at TC Sessions: AI and showcase your innovations to 1,200+ decision-makers without breaking the bank. Available until May 9 or while spots last.
Berkeley, CA | June 5 REGISTER NOW
Anthropic Enters AI Legal Tech Market as Competition Intensifies
Anthropic unveiled a suite of new chatbot capabilities on Tuesday, aimed at delivering automated support to legal practices. These enhancements expand upon Claude for Legal, the firm-specific platform introduced earlier this year, by adding specializ
Anthropic launches Opus 4.8 featuring new dynamic workflow tool
Anthropic unveiled Opus 4.8 on Thursday, marking the latest iteration of its premier public model. Priced identically to its predecessor, this update is now accessible across all platforms.Releasing just 41 days after Opus 4.7, Anthropic has accelera
Anthropic debuts Claude Fable 5, a public version of Mythos
Anthropic is making its most powerful AI model available to the general public for the first time — but with safety measures in place.
On Tuesday, the company launched Claude Fable 5, the first public release of its Mythos model. According to Anthrop
Claudeが法廷で出典を間違えたって、さすがにまずいよね😅 AIの過信は危険だわ。弁護士が謝罪したってことは、実害があったってことだよね。技術の進歩は速いけど、信頼性が追いついてないのが現実。もっと慎重に検証する仕組みが必要だと思う。 #Anthropic #AI
Kann jemand erklären, warum selbst Top-LLMs noch Halluzinationen produzieren? Besonders bei Rechtsthemen ist das echt kritisch. Die Entschuldigung ist ein Schritt, aber wie werden solche Fehler in Zukunft verhindert? 🤔 Bin gespannt, ob sich da bald branchenweite Standards durchsetzen.





Home






