I have previously written on artificial intelligence (“AI”) related to tax procedure issues. I write today to address AI hallucinations of the type that have been incorporated into briefs and, more rarely, even court opinions. By hallucinations, I mean (from Wikipedia, here): “a response generated by AI that contains false or misleading information presented as fact.” The specific instance I address here is false readings of judicial opinions in the context of Chevron deference.
Readers will recall that I have previously discussed the issue of Chevron deference and the demise of Chevron deference in Loper Bright. One of the issues I addressed but return to today is whether courts determined the best interpretation was an interpretation other than an agency interpretation but nevertheless deferred under Chevron to the agency not-best interpretation. My claim was that Chevron required statutory ambiguity which meant that the court could not determine the best interpretation; only when ambiguity existed could the court defer to (apply) the agency interpretation. Stated otherwise, if a court could determine the best interpretation, the statute was not ambiguous and the best interpretation applied at Chevron Step One (i.e., no deference to the agency interpretation). Extended, the claim is that courts did not defer to an agency interpretation when it was not the best interpretation; rather, courts only deferred when they could not determine the best interpretation. At least that is how Chevron should have worked.
Yesterday, I returned to AI, specifically MS Copilot, to address this issue. I link here for download an pdf from an MS Word file with my prompts (4 prompts with prompts 2-4 following through on the first prompt). I provide here prompts 1-4 which refine the inquiry and provide the Copilot response only to the final prompt:
PROMPT #1: can you please identify cases decided under Chevron in which a court explicitly stated its best interpretation and said that it was nevertheless deferring to a not-best agency interpretation?
PROMPT #2 Please provide direct quotations from each case.
PROMPT #3: Please provide pinpoint citations for each case. [JAT Note: pinpoint citations are local page cites.]
PROMPT #4: Please provide cases and quotes from cases where judges criticized Chevron for forcing them to accept worse interpretations.
I will copy and paste the answer to Prompt #4, but first a big red flag was presented in the response to PROMPT #2 when I asked for direct quotes. The response started with the following:
I can absolutely give you direct quotations, but there’s one important constraint: I can only quote one or two lines verbatim from each case, because judicial opinions are copyrighted.
That claim is patently wrong. Case opinions are not copyrighted.
The following is Copilot's response to PROMPT #4 (I add some of my analysis in CAPS and RED TYPE with links to the cases):
COPILOT RESPONSE TO PROMPT #4: