AI’s Ethical Pitfalls Prompt Law Firms to Consider Bans

When lawyers submit fake citations and hallucinated case law to court because they trusted AI without verification, the professional consequences can include fines, sanctions, and temporary disbarment-raising questions about whether blanket AI bans are the only way to protect clients and avoid ethical catastrophe.

Bronze statue of blindfolded woman symbolizing justice amid concerns over AI ethics in law firms

Law firms are facing a stark choice. They can embrace artificial intelligence and hope their attorneys rigorously verify every output, or they can ban the technology altogether and avoid the mounting risk of professional discipline. Recent court cases show that AI-generated hallucinations continue to plague legal filings across the country, with attorneys paying steep prices for errors they didn’t personally create but remain fully responsible for. The professional ethics framework is clear: lawyers bear complete accountability for the work product they submit, regardless of which tool helped produce it. That reality is forcing uncomfortable conversations in firms nationwide about whether AI adoption is worth the liability.

Hallucinations Are Not Rare Edge Cases

The problem isn’t hypothetical anymore. In February 2025, a Wyoming federal judge sanctioned three attorneys in Wadsworth v. Walmart after a filing produced with the firm’s own AI platform cited eight cases that didn’t exist. The attorney who drafted the document paid a $3,000 fine and lost his admission to practice in that case. Two other attorneys each faced $1,000 fines. Earlier that same year, a Mississippi judge sanctioned four lawyers in Withers v. City of Aberdeen when both sides submitted filings containing hallucinated citations. Two attorneys were barred from appearing in that district for two years.

A Thomson Reuters study conducted between June and August 2025 identified 22 separate cases where courts or opposing parties discovered non-existent case citations in legal filings. These weren’t isolated mistakes by inexperienced solo practitioners-they represented a pattern across jurisdictions, practice areas, and firm sizes. In Pennsylvania alone, at least 13 cases in 2025 contained confirmed or suspected AI hallucinations. Commonwealth Court Judge Matthew Wolf confronted attorneys about citation errors in one brief, asking directly whether it contained artificial intelligence hallucinations. The lawyers involved faced embarrassment and had to file corrected briefs.

The frequency of these errors suggests that AI hallucination isn’t a bug that will be patched in the next software update. It’s a fundamental characteristic of how generative AI works. These systems don’t understand law-they predict text based on patterns. When asked for a citation, they’ll generate something that looks like a citation, even if that case never existed. Legal professionals who don’t grasp this distinction are putting their licenses at risk every time they hit submit.

Synopsis

Generative AI is creating a difficult governance choice for law firms: ban the technology to reduce immediate ethical exposure or permit it under meaningful controls. Confirmed hallucinations and resulting sanctions show that lawyers cannot rely on AI-generated citations or analysis without independent verification, while the efficiency and training costs of prohibition make blanket bans difficult to sustain. The strongest path is a risk-based policy that limits high-risk uses, protects confidentiality, requires human review, and holds attorneys accountable.

Most Firms Have No Written AI Policy

The regulatory response to AI adoption has been fragmented and inconsistent. A New York City Bar Association paper published in August examined guidance across 21 jurisdictions and found lawyers operating without any single, industrywide approach. Courts and professional bodies have developed their own rules and recommendations, creating a patchwork that’s difficult for multi-state firms to navigate.

More troubling is the gap between AI usage and formal governance. A survey of more than 1,300 legal professionals found that 69 percent were using general purpose AI for work tasks. Only 9 percent of firms had a written, enforced AI policy. That means the vast majority of attorneys using AI tools are doing so without clear institutional guidelines about what’s permitted, what verification steps are required, or how client confidentiality must be protected.

The Ohio Board of Professional Conduct published an ethics guide in June 2026 that emphasized mandatory human review of all AI outputs, warning that AI lacks the experience and judgment of human lawyers. Several states including New York, California, Florida, and Texas have issued formal opinions stressing that AI doesn’t change underlying ethical obligations. Lawyers must maintain competence, protect confidentiality, supervise AI tools, and verify accuracy before submitting work to courts or clients.

But formal opinions and guidance documents don’t translate automatically into day-to-day compliance. Cliff McKinney, a legal ethics lawyer at Quattlebaum, Grooms & Tull, told Newsweek that the lack of consistent guidance creates compliance challenges, particularly around confidentiality and attorney-client privilege. He added that most problems with AI use boil down to the failure of attorneys to verify accuracy. Michael Salzman, chair of the New York City Bar’s Professional Ethics Committee, identified risks around fabricated citations, incorrect legal analysis, false factual claims, and potential confidentiality breaches when lawyers use general purpose AI systems.

The message from ethics committees is consistent: lawyers are responsible. But without firm-level policies that establish verification protocols, training requirements, and consequences for violations, that responsibility rests entirely on individual attorneys who may lack the technical knowledge to assess AI reliability.

The Case for Outright Bans

Given the pervasive risk of hallucinations, the absence of firm policies, and the severe professional consequences for errors, a blanket ban on AI starts to look reasonable. Some firms have already taken this route. According to discussions among legal professionals, at least one Am Law 200 firm has banned everything except Westlaw’s AI-assisted research and Microsoft Co-Pilot, with no training provided to attorneys on proper use.

A ban eliminates the compliance burden. Firms don’t need to draft detailed AI usage policies, train staff on verification protocols, assess vendor security practices, or update engagement letters to disclose AI involvement. There’s no risk that an associate working late will paste confidential client information into ChatGPT to speed up a research task. There’s no chance that a partner will submit a brief containing fake citations because they trusted AI output without checking.

From a risk management perspective, prohibition is simpler than regulation. Professional liability insurers are still figuring out how AI-related errors affect coverage. If a client suffers harm because a lawyer relied on hallucinated case law, the malpractice claim could be substantial. Firms that banned AI altogether have a clear defense: their attorneys weren’t authorized to use the technology, so any violation represents individual misconduct rather than institutional failure.

The ethical stakes are too high to leave AI adoption to individual judgment. Lawyers owe clients a duty of competence, and that duty includes understanding the limitations of any tool they use. But most attorneys aren’t technologists. They don’t know how large language models work, what training data was used, or why hallucinations occur. Expecting every lawyer to develop technical competence in AI while also maintaining expertise in their practice area is unrealistic. A firm-wide ban removes that expectation and the liability it creates.

Hot Take

A blanket AI ban may protect a firm from authorized misuse, but it cannot protect a firm from unmanaged reality if attorneys use the tools in secret.

Prohibition is simplest when measured against policy drafting and oversight. But transparent guardrails are more durable than silence: they give lawyers a safe channel for permitted uses and give firms a chance to detect, correct, and discipline misconduct.

The Hidden Costs of AI Prohibition

Banning AI sounds prudent until firms consider what they’re giving up. AI can handle time-consuming tasks that don’t require legal judgment-summarizing documents, organizing exhibits, translating technical language, building timelines from records. John Rajaee, a lawyer at RMD Law, described his firm’s use of AI for summarizing medical records, organizing documents, and translating complicated medical or insurance language. He compared AI to a very good paralegal, emphasizing that humans must check anything that matters.

Firms that prohibit AI lose that efficiency. Associates spend hours on tasks that AI could complete in minutes, increasing billable hours for clients and reducing time available for substantive legal work. In competitive markets, firms that can deliver faster turnarounds and lower costs have an advantage. Blanket bans put firms at a disadvantage against competitors who’ve figured out how to use AI responsibly.

There’s also the shadow AI problem. When firms ban technology that employees find useful, those employees often use it anyway-just without institutional oversight. An attorney working from home might use ChatGPT to draft a motion, then edit it to remove obvious AI markers before submitting it through official channels. That creates more risk than a transparent policy with clear verification requirements, because the firm has no ability to audit or supervise what’s happening.

Professional development is another concern. Legal practice is increasingly technology-driven. Young lawyers entering firms today will work their entire careers alongside AI tools. Firms that ban AI deny their attorneys the opportunity to develop competence in a skill that will be fundamental to future practice. When those attorneys eventually move to firms or clients that do use AI, they’ll be starting from scratch.

Why AI Policy Beats AI Prohibition

The alternative to a blanket ban is a risk-based policy that permits AI use under specific conditions. Several experts advocate for a traffic light system that classifies AI tasks by risk level. Green tasks-like summarizing publicly available information or organizing documents-might be permitted with minimal oversight. Yellow tasks-such as legal research or drafting routine correspondence-require human verification before use. Red tasks-including anything involving confidential client information in public AI systems or final court submissions-are either prohibited or subject to multiple levels of review.

This approach lets firms capture AI’s efficiency for low-risk tasks while maintaining strict controls where errors could cause serious harm. It also creates clear guidelines for attorneys, removing the guesswork about what’s acceptable. Training becomes targeted: lawyers learn which tasks AI can handle, what verification steps are required, and when they must avoid AI altogether.

Client communication is part of responsible AI policy. Engagement letters should disclose that the firm uses AI tools to enhance efficiency while maintaining human oversight and protecting confidentiality. Clients deserve to know how their legal work is being produced, and transparency builds trust. Some clients may object to AI use, and firms need protocols for handling those situations.

Vendor assessment matters too. Not all AI tools handle data the same way. Some general-purpose systems like ChatGPT train on user inputs, creating confidentiality risks. Other tools designed for legal practice include contractual protections against data retention and training. Firms need to evaluate vendors, understand data flows, and select tools that align with ethical obligations.

Enforcement is where many AI policies fail. Writing a policy document doesn’t change behavior unless there are consequences for violations and systems to detect them. Firms need to monitor AI use, audit outputs, and discipline attorneys who skip verification steps. Leadership buy-in matters-if partners ignore the policy, associates will too.

The Uncomfortable Middle Ground

The legal profession is stuck in an uncomfortable transition. AI offers real benefits for efficiency and cost reduction, but the technology isn’t reliable enough to trust without verification. Ethical obligations remain unchanged-lawyers are responsible for accuracy, confidentiality, and competence-but the tools available to meet those obligations are evolving faster than institutional policies.

Blanket bans solve the immediate risk problem but create long-term disadvantages. Firms that prohibit AI lose efficiency, competitiveness, and opportunities to train their attorneys in essential future skills. They also encourage shadow usage, where AI gets deployed without oversight.

Permissive policies with weak enforcement create different problems. When firms tell attorneys to use their judgment about AI without clear guidelines, verification requirements, or training, they set up individual lawyers to fail. The court cases from 2025 and 2026 demonstrate that trusting AI outputs without checking them leads directly to sanctions, fines, and professional discipline.

The middle path requires effort. Firms must draft detailed policies, classify tasks by risk level, train attorneys on verification protocols, assess vendor security, update engagement letters, monitor compliance, and enforce consequences for violations. That’s a substantial investment of time and resources, particularly for small firms without dedicated compliance staff.

But the alternative-either banning a transformative technology or allowing unregulated use-carries bigger long-term costs. Firms that figure out responsible AI governance will have competitive advantages in efficiency, cost, and talent development. Firms that don’t will face a choice between irrelevance and professional liability.

The devil’s advocate position has real merit. Given widespread hallucinations, minimal firm policies, and severe consequences for errors, prohibition looks safer than permission. But safety isn’t the only consideration. Law firms also need to serve clients efficiently, develop attorney skills, and compete in evolving markets. The question isn’t whether AI is safe-it clearly isn’t, without proper controls. The question is whether firms can build those controls or whether the technology is simply too risky to use at all.

Right now, the evidence suggests that most firms haven’t figured it out. Court sanctions continue, hallucinations remain pervasive, and the vast majority of firms lack written AI policies. Until that changes, the devil’s advocate argument for blanket bans will keep getting stronger.

Frequently Asked Questions

Why are law firms concerned about using AI?
Law firms are concerned because AI can fabricate case law, citations, legal analysis, and factual claims, while lawyers remain responsible for verifying everything they submit. Courts have sanctioned attorneys for AI-generated errors, including fines and limits on practice, and firms also face confidentiality and attorney-client privilege risks when client information is entered into general-purpose systems. As the Thomson Reuters source “GenAI hallucinations are still pervasive in legal filings, but courts and litigants are catching them” (https://www.thomsonreuters.com/en/institute/articles/genai-hallucinations) notes, hallucinated citations continue to appear in court filings, while the American Bar Association’s “Highlight of the Issues” (https://www.americanbar.org/groups/centers_commissions/center-for-innovation/artificial-intelligence/issues/) identifies related concerns involving confidentiality, competence, supervision, and honesty.[1][2]
How often have AI hallucinations appeared in legal filings?
There is no single nationwide count, but the article reports that a Thomson Reuters study found 22 separate cases involving non-existent legal citations in filings between June and August 2025. In Pennsylvania alone, at least 13 cases in 2025 contained confirmed or suspected AI hallucinations, suggesting the problem was recurring rather than rare. (Sources: Thomson Reuters, “GenAI hallucinations are still pervasive in legal filings,” https://www.thomsonreuters.com/en/institute/articles/genai-hallucinations; Spotlight PA, “Judges find suspected AI hallucinations in PA court cases,” https://www.spotlightpa.org/news/2026/01/pennsylvania-commonwealth-court-ai-hallucinations-allegations-justice-system/)[1][2]
What penalties have lawyers faced for submitting AI-generated errors?
Lawyers have faced court sanctions, fines, and limits on their ability to practice after submitting AI-generated errors. In *Wadsworth v. Walmart*, one attorney was fined $3,000 and lost admission to practice in that case, while two others were fined $1,000 each; in *Withers v. City of Aberdeen*, two lawyers were barred from appearing in the district for two years. The broader risks of fabricated citations and sanctions are also described by Thomson Reuters in “GenAI hallucinations are still pervasive in legal filings” (https://www.thomsonreuters.com/en/institute/articles/genai-hallucinations) and Purdue Global Law School in “AI in Legal Practice: Risks, Ethics & Client Impact” (https://www.purduegloballawschool.edu/blog/news/ai-legal-practice-risks).[1][2]
Do most law firms have written policies governing AI use?
No. The article draft reports that only 9% of firms had a written, enforced AI policy, meaning the vast majority did not. The Texas Bar Practice “AI Policy and Governance” guide similarly treats an internal policy as a key foundation for responsible adoption: https://www.texasbarpractice.com/ai-policy-and-governance/[1]
What ethical responsibilities do lawyers retain when using AI?
Lawyers remain responsible for the accuracy and integrity of work produced with AI: they must understand its limitations, independently verify outputs and citations, and apply human judgment before submitting work to courts or clients. They must also maintain competence, protect client confidentiality, supervise AI use, and assess how vendors handle data; as the [Ohio Board of Professional Conduct’s “Law and AI: Ethics Guidance Delivered to Ohio Lawyers”](https://www.courtnewsohio.gov/happening/2026/AIEthics_063026.asp) and Justia’s [“AI and Attorney Ethics Rules: 50-State Survey”](https://www.justia.com/trials-litigation/ai-and-attorney-ethics-rules-50-state-survey/) emphasize, AI does not change those underlying ethical duties.[1][2]
What are the arguments for banning AI in law firms?
The main argument for banning AI is risk reduction: generative AI can fabricate case law, citations, holdings, and other facts, while lawyers remain fully responsible for anything they submit. Those errors can harm clients and lead to sanctions, fines, or professional discipline; as the Thomson Reuters source, “GenAI hallucinations are still pervasive in legal filings, but courts and litigants are catching them,” documents, hallucinated citations continue to appear in court filings (https://www.thomsonreuters.com/en/institute/articles/genai-hallucinations). A blanket ban also avoids confidentiality, competence, supervision, and data-flow risks identified by the American Bar Association’s “Highlight of the Issues” (https://www.americanbar.org/groups/centers_commissions/center-for-innovation/artificial-intelligence/issues/) and is simpler than creating, training for, monitoring, and enforcing detailed firm policies.[1][2]
What are the drawbacks of banning AI outright?
An outright ban sacrifices AI’s potential to summarize records, organize documents, translate technical language, reduce costs, and free lawyers for substantive work. It can also leave firms less competitive, prevent attorneys from developing future-ready skills, and encourage “shadow AI” use outside institutional oversight—why the North Carolina Bar Association’s “Beyond the Ban” guidance favors a realistic policy approach (https://www.ncbar.org/2026/01/13/beyond-the-ban-why-your-law-firm-needs-a-realistic-ai-policy-in-2026/).[1]
What does a risk-based AI policy for law firms look like?
A risk-based AI policy uses a traffic-light system: low-risk tasks such as summarizing public information may be allowed with minimal oversight; medium-risk work such as legal research requires human verification; and high-risk activities, including entering confidential information into public AI systems or producing final court submissions, are prohibited or require multiple reviews. The policy should also require attorney training, vendor and data-flow assessments, client disclosure through engagement letters, audits of AI outputs, and consequences for skipping verification. This approach reflects the guidance in “AI Policy and Governance | AI Toolkit” and “Beyond the Ban: Why Your Law Firm Needs a Realistic AI Policy in 2026,” while “Law and AI: Ethics Guidance Delivered to Ohio Lawyers” emphasizes human review of AI outputs.[1][2][3]
What steps should firms take to use AI responsibly?
Firms should adopt a written, risk-based AI policy that classifies tasks by risk, requires human review and verification—especially of citations, legal analysis, and court filings—and prohibits entering confidential information into unsuitable public systems. They should train lawyers, assess vendors and data flows, disclose AI use in engagement letters, monitor and audit compliance, and enforce consequences for violations. This approach reflects the guidance in “Law and AI: Ethics Guidance Delivered to Ohio Lawyers” (https://www.courtnewsohio.gov/happening/2026/AIEthics_063026.asp), “AI Policy and Governance | AI Toolkit” (https://www.texasbarpractice.com/ai-policy-and-governance/), and “Beyond the Ban: Why Your Law Firm Needs a Realistic AI Policy in 2026” (https://www.ncbar.org/2026/01/13/beyond-the-ban-why-your-law-firm-needs-a-realistic-ai-policy-in-2026/).[1][2][3]
Categories: ,