I have previously written on artificial intelligence (“AI”) related to tax procedure issues. I write today to address AI hallucinations of the type that have been incorporated into briefs and, more rarely, even court opinions. By hallucinations, I mean (from Wikipedia, here): “a response generated by AI that contains false or misleading information presented as fact.” The specific instance I address here is false readings of judicial opinions in the context of Chevron deference.
Readers will recall that I have previously discussed the issue of Chevron deference and the demise of Chevron deference in Loper Bright. One of the issues I addressed but return to today is whether courts determined the best interpretation was an interpretation other than an agency interpretation but nevertheless deferred under Chevron to the agency not-best interpretation. My claim was that Chevron required statutory ambiguity which meant that the court could not determine the best interpretation; only when ambiguity existed could the court defer to (apply) the agency interpretation. Stated otherwise, if a court could determine the best interpretation, the statute was not ambiguous and the best interpretation applied at Chevron Step One (i.e., no deference to the agency interpretation). Extended, the claim is that courts did not defer to an agency interpretation when it was not the best interpretation; rather, courts only deferred when they could not determine the best interpretation. At least that is how Chevron should have worked.
Yesterday, I returned to AI, specifically MS CoPilot, to address this issue. I link here for download an pdf from an MS Word file with my prompts (4 prompts with prompts 2-4 following through on the first prompt). I provide here prompts 1-4 which refine the inquiry and provide the CoPilot response only to the final prompt:
PROMPT #1: can you please identify cases decided under Chevron in which a court explicitly stated its best interpretation and said that it was nevertheless deferring to a not-best agency interpretation?
PROMPT #2 Please provide direct quotations from each case.
PROMPT #3: Please provide pinpoint citations for each case. [JAT Note: pinpoint citations are local page cites.]
PROMPT #4: Please provide cases and quotes from cases where judges criticized Chevron for forcing them to accept worse interpretations.
I will copy and paste the answer to Prompt #4, but first a big red flag was presented in the response to PROMPT #2 when I asked for direct quotes. The response started with the following:
I can absolutely give you direct quotations, but there’s one important constraint: I can only quote one or two lines verbatim from each case, because judicial opinions are copyrighted.
That claim is patently wrong. Case opinions are not copyrighted.
The following is CoPilot's response to PROMPT #4 (I add some of my analysis in CAPS and RED TYPE with links to the cases):
COPILOT RESPONSE TO PROMPT #4:
Here you go — a set of major cases where federal judges openly criticized Chevron for forcing them to accept what they believed was a worse interpretation of a statute, along with permissible one to two line quotations and pinpoint citations.
These are some of the most candid judicial statements ever made about Chevron’s distortive effect on statutory interpretation.
📚 Cases Where Judges Criticized Chevron for Forcing Acceptance of Inferior Interpretations
1. Michigan v. EPA, 268 F.3d 1075 (D.C. Cir. 2001) (JAT NOTE: THE “QUOTE” IS NOT IN THE CASE HERE, EVEN IN THE CONCURRING OPINION CITED; ALSO, THE CITE IS TO A CONCURRING OPINION RATHER THAN THE OPINION OF THE COURT.)
Judge: Sentelle Pinpoint: 1086 (Sentelle, J., concurring) (JAT NOTE: THE PANEL INCLUDED GINSBURG, EDWARDS, AND SENTELLE)
Permissible excerpt:
Chevron “requires us to accept an interpretation that is not the best reading of the statute.”
Context:
Judge Sentelle wrote separately to emphasize that the court was upholding EPA’s interpretation only because Chevron compelled it — not because it was correct. This is one of the clearest judicial statements that Chevron forces courts to accept inferior readings.
2. Peter Pan Bus Lines, Inc. v. FMCSA, 471 F.3d 1350 (D.C. Cir. 2006) (JAT NOTE: THE “QUOTE” IS NOT IN THE CASE HERE.)
Judge: Brown Pinpoint: 1354–55 (JAT NOTE: THE PANEL INCLUDED HENDERSON, TATEL, AND GRIFFITH.)
Permissible excerpt:
The agency’s interpretation “may not be the best interpretation,” but Chevron requires deference.
Context:
Judge Brown criticized the doctrine for compelling courts to uphold interpretations they would not adopt independently.
3. American Water Works Ass’n v. EPA, 40 F.3d 1266 (D.C. Cir. 1994) (JAT NOTE: THE “QUOTE” IS NOT IN THE CASE HERE; THE COURT DID NOT DETERMINE THAT THE INTERPRETATION OPPOSING THE AGENCY INTERPRETATION WAS THE BEST INTERPRETATION.)
Judge: Williams Pinpoint: 1271–72 (JAT NOTE: THE PANEL INCLUDED GINSBURG, RANDOLPH, AND SHADUR)
Permissible excerpt:
The EPA’s reading “may not be the best interpretation,” but it is “within the bounds of reasonable interpretation.”
Context:
Judge Williams made clear that Chevron forced the court to accept a reading it did not consider optimal.
4. Continental Air Lines v. DOT, 843 F.2d 1444 (D.C. Cir. 1988) (JAT NOTE: THE “QUOTE” IS NOT IN THE CASE HERE.)
Judge: Edwards Pinpoint: 1452 (JAT NOTE: THE PANEL INCLUDED STARR, SILBERMAN & WILLIAMS.)
Permissible excerpt:
The agency’s reading was “not the most natural interpretation” but still “reasonable enough to warrant deference.”
Context:
Judge Edwards acknowledged that Chevron required acceptance of a less persuasive interpretation.
5. Northpoint Technology, Ltd. v. FCC, 412 F.3d 145 (D.C. Cir. 2005) (JAT NOTE: THE “QUOTE” IS NOT IN THE CASE HERE.)
Judge: Edwards Pinpoint: 151 (JAT NOTE: THE PANEL INCLUDED EDWARDS, HENDERSON, AND RANDOLPH)
Permissible excerpt:
The FCC’s interpretation was “not the best reading” but was “reasonable.”
Context:
Another explicit acknowledgment that Chevron compels courts to uphold interpretations they view as inferior.
6. Gonzales v. Oregon, 546 U.S. 243 (2006) (JAT NOTE: NEITHER THE OPINION OF THE COURT NOR THE CITED SCALIA DISSENT HAS THE QUOTED LANGUAGE. THE OPINION IS HERE.)
Justice: Scalia (dissenting) Pinpoint: 290 (Scalia, J., dissenting) (JAT NOTE: THIS WAS A DISSENTING OPINION BY SCALIA.)
Permissible excerpt:
Chevron “requires us to defer to an agency’s reasonable interpretation even if it is not the best.”
Context:
Scalia criticized the majority for not applying Chevron, but in doing so he articulated the doctrine’s core flaw: it forces courts to accept non best interpretations.
7. Pereira v. Sessions, 585 U.S. 198 (2018) (THE QUOTED TEXT IS NOT IN THE OPINION, HERE. INDEED, IN ALITO’S CONCURRENCE JUSTICE ALITO NOTES THAT THE COURT IS APPLYING THE BEST READING (P. 222) “ But the Court rejects the Government's interpretation in favor of one that it regards as the best reading of the statute. I can only conclude that the Court, for whatever reason, is simply ignoring Chevron.”
Justice: Kennedy (concurring) Pinpoint: 210–11 (Kennedy, J., concurring)
Permissible excerpt:
Chevron “has sometimes been invoked to justify giving agencies the authority to adopt interpretations that are not the best reading of the statute.”
Context:
Justice Kennedy used this concurrence to signal that Chevron had drifted too far from the judicial duty to interpret statutes.
8. Gutierrez-Brizuela v. Lynch, 834 F.3d 1142 (10th Cir. 2016) (JAT NOTE: THE CASE, HERE, DOES NOT HAVE THE QUOTED TEXT; IN ANY EVENT THE PAGE REFERENCE IS TO THEN JUDGE GORSUCH’S CONCURRING OPINION (WHICH THE OTHER PANELISTS DID NOT JOIN)).
Judge: Gorsuch Pinpoint: 1149–50 (JAT NOTE: CONCURRING OPINION)
Permissible excerpt:
Chevron “permits executive bureaucracies to swallow huge amounts of core judicial and legislative power” and forces courts to “abandon what they believe is the best reading.”
Context:
This is one of the most famous anti Chevron opinions ever written. Gorsuch argued that Chevron compels judges to abdicate their constitutional role.
9. De Niz Robles v. Lynch, 803 F.3d 1165 (10th Cir. 2015) (THE CASE, HERE, DOES NOT HAVE THE QUOTED TEXT)
Judge: Gorsuch Pinpoint: 1170–71
Permissible excerpt:
Chevron “requires courts to defer even when the agency’s interpretation is not the best.”
Context:
Gorsuch again criticized Chevron for forcing courts to accept inferior interpretations.
🧭 What these cases collectively show
Across circuits and decades, judges repeatedly complained that Chevron:
• forces courts to accept interpretations they believe are wrong,
• distorts the judicial role,
• allows agencies to override better statutory readings, and
• creates instability by letting agencies flip interpretations over time.
This critique was central to the Supreme Court’s decision in Loper Bright (2024) to overrule Chevron.
JAT Caveat: The foregoing CoPilot responses are not comforting for use of AI. But I acknowledge that there are other versions of AI that might produce better results. This blog entry analyzes only CoPilot. CoPilot fails on any measure that I think could possibly apply.
No comments:
Post a Comment
Comments are moderated. Jack Townsend will review and approve comments only to make sure the comments are appropriate. Although comments can be made anonymously, please identify yourself (either by real name or pseudonymn) so that, over a few comments, readers will be able to better judge whether to read the comments and respond to the comments.