Today, I was reworking the part of my 2027 Working Draft for my Federal Tax Procedure Editions on the problem of cherry-picking or selecting evidence used in constitutional and statutory interpretation. The issue is presented anecdotally by conservative judges trotting out Judge Leventhal’s famous remark that using legislative history is like looking over the crowd and picking your friends. There is a similar phenomenon with so-called “law office history” deployed to support arguments made by advocates and judges in their opinions. Even broader, the same phenomenon is presented for the entire body of law that advocates and judges deploy—such as cases, scholarly treatises, law review articles, etc. The risk is always present that we as lawyers (or judges) pick our friends rather than make a neutral assessment of the evidence.
Continuing my experimentation with AI, I asked ChatGPT Plus about the issue and got what I think are pretty good responses. I presented the issue in two prompts (the second asking for more than the first) noted below in red. The bold face was from the original responses. I checked the citations to the two Supreme Court cases and they are correct (i.e., no hallucinations). I will use the responses in re-working my discussion in the Federal Tax Procedure Editions (not verbatim but to inspire how I state the concepts in my own words which I hope are at least as good as ChatGPT's).
As an introduction, I use the term "law office history." That term commonly describes the phenomenon of lawyers and judges evaluating history as a process of cherry-picking to support arguments. Of course, selecting the evidence is what we all do when making arguments or taking positions; lawyers do that in briefs and oral arguments; judges do that in opinions; we all do that in our daily discourse. Even when a person--say a judge--sees his or her duty to make an objective or fair assessment of the evidence, personal prejudices or preferences may influence the evidence used. I wanted to explore what that may mean.
One caveat: The same phenomenon occurs in factfinding where a judge selects from a body of factual evidence the evidence that he or she finds persuasive to determine facts relevant to the outcome of the case. I don't think factfinding is materially different from lawfinding--selecting among the relevant evidence to reach the outcome.
Prompt #1
Please write a short discussion of the features of "law
office history" and "legislative history" that permit a judge or
lawyer to cherry pick (or as one judge called it to look over a crowd and pick
your friends).
Response to Prompt #1
Here is a short version in a law-review style that
emphasizes the structural similarity between the two problems:
Law-Office History and Legislative History
Both “law-office history” and legislative history
present a similar danger: they often supply the interpreter with a large and
heterogeneous body of material from which supporting evidence can be selected
without any obvious neutral rule for determining what evidence should receive
the greatest weight. Alfred H. Kelly coined “law-office history” to describe
the lawyerly practice of selecting historical data favorable to a position
while failing adequately to confront contrary evidence or evaluate its
significance in historical context. The problem is partly inherent in advocacy.
The historical record is usually extensive, incomplete, and capable of
supporting competing narratives; choices must be made about the relevant
period, the appropriate level of generality, which practices are
representative, and which sources deserve weight. Those choices can permit the
advocate—or judge—to begin with a desired conclusion and assemble a plausible
historical narrative supporting it.
Legislative history presents much the same problem, perhaps in an even more concentrated form. A statute may generate committee reports, sponsor statements, floor debates, hearing testimony, rejected amendments, conference materials, and statements by legislators who supported or opposed the final bill. These materials may point in different directions, and statements by particular legislators do not necessarily represent the understanding of the legislative body that enacted the statute. Moreover, participants aware that courts consult legislative history may have incentives to place favorable statements in the record. The resulting abundance of potentially conflicting material makes selective quotation unusually easy. The Supreme Court has accordingly repeated Judge Harold Leventhal's famous description of using legislative history as akin to “looking over a crowd and picking out your friends.” Exxon Mobil Corp. v. Allapattah Services, Inc., 545 U.S. 546, 568 (2005).