Judge slams lawyers for ‘bogus AI-generated research’

Judge Penalizes Law Firms for Using AI Without Disclosure
In a recent ruling, California Judge Michael Wilner slapped two prominent law firms with a hefty fine of $31,000 for secretly relying on artificial intelligence during a civil lawsuit. According to Judge Wilner, the firms submitted a brief packed with “false, inaccurate, and misleading legal citations and quotations.” As reported by law professors Eric Goldman and Blake Reid on Bluesky, the judge expressed his frustration over what he deemed a reckless disregard for professional standards.
“I trusted the brief I read,” Judge Wilner wrote in his ruling. “I was convinced by the authorities they referenced, so I dug deeper to explore those cases myself. But they didn’t exist. It was terrifying. I nearly signed off on a judicial order based on fake information.”
According to court documents, the trouble began when a plaintiff’s legal team hired an AI tool to craft an outline for a supplemental brief. This outline, however, was riddled with fabricated content when it was handed over to K&L Gates, another law firm involved in the case. Unfortunately, neither firm bothered to fact-check or verify the information before submitting it.
Judge Wilner discovered that “at least two of the cited authorities were entirely nonexistent.” When pressed for clarification, K&L Gates refiled the brief, only for the judge to uncover even more fabricated references. In response, he issued an Order to Show Cause, prompting both sides to admit the truth under oath. The lawyer responsible for creating the original outline confessed to using Google Gemini and legal research tools like Westlaw Precision with CoCounsel.
A Pattern of Misuse
This isn’t the first instance of lawyers getting into hot water over AI misuse. Former Trump attorney Michael Cohen once cited non-existent court cases after mistakenly treating Google Gemini, then known as Bard, as a regular search engine. Similarly, a judge in Colombia found that attorneys suing an airline had sprinkled their brief with bogus cases generated by ChatGPT.
“This whole episode has been nothing short of alarming,” Judge Wilner concluded. “The initial decision to rely on AI without disclosure was unacceptable. Sending such flawed material to other professionals without warning them about its questionable origin put everyone at risk.”
The Broader Implications
The ruling highlights a growing concern among legal professionals about the ethical implications of using AI in court filings. While AI tools promise efficiency and accuracy, they also carry the risk of spreading misinformation if not properly vetted. As Judge Wilner emphasized, “No reasonably competent attorney should outsource their research or writing to an algorithm without verifying its output.”
The case serves as a stark reminder of the importance of transparency and accountability in legal practice. As AI continues to evolve, it remains crucial for practitioners to tread carefully, ensuring that technology enhances—not undermines—the integrity of the justice system.
Related article
Google Tests Remy AI Agent for Gemini as Focus Shifts to User Control
According to Business Insider, Google is testing Remy, a new AI personal agent for Gemini. This tool aims to execute tasks on behalf of users, streamlining both professional workflows and daily routines.Currently, Remy is undergoing testing in an int
Ollie bets privacy focus to win AI assistant race
To be genuinely helpful, an AI assistant must understand its user deeply. Ollie, a personal assistant designed for daily life, operates on the premise that this doesn’t require surrendering your data or compromising your privacy.While certain enterpr
How AI LIVE: London Will Explore AI & Industrial Automation
The summit will convene C-suite executives from around the globe to address pressing challenges in global industries, ranging from AI-driven disruption to economic volatility.AI LIVE: The London Summit will gather over 2,000 international leaders und
Related Special Topic Recommendations
Comments (4)
0/500
This AI fiasco in court is wild! Lawyers thought they could sneak in AI-generated research and not get caught? $31k fine is a wake-up call—bet they’ll think twice before pulling that stunt again. 😬

Judge Penalizes Law Firms for Using AI Without Disclosure
In a recent ruling, California Judge Michael Wilner slapped two prominent law firms with a hefty fine of $31,000 for secretly relying on artificial intelligence during a civil lawsuit. According to Judge Wilner, the firms submitted a brief packed with “false, inaccurate, and misleading legal citations and quotations.” As reported by law professors Eric Goldman and Blake Reid on Bluesky, the judge expressed his frustration over what he deemed a reckless disregard for professional standards. “I trusted the brief I read,” Judge Wilner wrote in his ruling. “I was convinced by the authorities they referenced, so I dug deeper to explore those cases myself. But they didn’t exist. It was terrifying. I nearly signed off on a judicial order based on fake information.” According to court documents, the trouble began when a plaintiff’s legal team hired an AI tool to craft an outline for a supplemental brief. This outline, however, was riddled with fabricated content when it was handed over to K&L Gates, another law firm involved in the case. Unfortunately, neither firm bothered to fact-check or verify the information before submitting it. Judge Wilner discovered that “at least two of the cited authorities were entirely nonexistent.” When pressed for clarification, K&L Gates refiled the brief, only for the judge to uncover even more fabricated references. In response, he issued an Order to Show Cause, prompting both sides to admit the truth under oath. The lawyer responsible for creating the original outline confessed to using Google Gemini and legal research tools like Westlaw Precision with CoCounsel.A Pattern of Misuse
This isn’t the first instance of lawyers getting into hot water over AI misuse. Former Trump attorney Michael Cohen once cited non-existent court cases after mistakenly treating Google Gemini, then known as Bard, as a regular search engine. Similarly, a judge in Colombia found that attorneys suing an airline had sprinkled their brief with bogus cases generated by ChatGPT. “This whole episode has been nothing short of alarming,” Judge Wilner concluded. “The initial decision to rely on AI without disclosure was unacceptable. Sending such flawed material to other professionals without warning them about its questionable origin put everyone at risk.”The Broader Implications
The ruling highlights a growing concern among legal professionals about the ethical implications of using AI in court filings. While AI tools promise efficiency and accuracy, they also carry the risk of spreading misinformation if not properly vetted. As Judge Wilner emphasized, “No reasonably competent attorney should outsource their research or writing to an algorithm without verifying its output.” The case serves as a stark reminder of the importance of transparency and accountability in legal practice. As AI continues to evolve, it remains crucial for practitioners to tread carefully, ensuring that technology enhances—not undermines—the integrity of the justice system.
Ollie bets privacy focus to win AI assistant race
To be genuinely helpful, an AI assistant must understand its user deeply. Ollie, a personal assistant designed for daily life, operates on the premise that this doesn’t require surrendering your data or compromising your privacy.While certain enterpr
How AI LIVE: London Will Explore AI & Industrial Automation
The summit will convene C-suite executives from around the globe to address pressing challenges in global industries, ranging from AI-driven disruption to economic volatility.AI LIVE: The London Summit will gather over 2,000 international leaders und
This AI fiasco in court is wild! Lawyers thought they could sneak in AI-generated research and not get caught? $31k fine is a wake-up call—bet they’ll think twice before pulling that stunt again. 😬





Home






