Template:M intro disaster tunnel vision: Difference between revisions
Amwelladmin (talk | contribs) (Created page with "{{quote| “By tunnel vision, we mean that “compendium of common heuristics and logical fallacies,” to which we are all susceptible, that lead actors in the criminal justice system to “focus on a suspect, select and filter the evidence that will ‘build a case’ for conviction, while ignoring or suppressing evidence that points away from guilt.” : — ''The Multiple Dimensions of Tunnel Vision in Criminal Cases'' by Keith Findley and Michael Scott...") |
Amwelladmin (talk | contribs) No edit summary Tags: Mobile edit Mobile web edit Advanced mobile edit |
||
(10 intermediate revisions by the same user not shown) | |||
Line 1: | Line 1: | ||
{{quote| | {{quote| | ||
By tunnel vision, we mean that “compendium of common [[Heuristic|heuristics]] and logical fallacies,” to which we are all susceptible, that lead actors in the criminal justice system to “focus on a suspect, select and filter the evidence that will ‘build a case’ for conviction, while ignoring or suppressing evidence that points away from guilt.” This process leads investigators, prosecutors, judges, and defence lawyers alike to focus on a particular conclusion and then filter all evidence in a case through the lens provided by that conclusion. | |||
: — ''The Multiple Dimensions of Tunnel Vision in Criminal Cases'' by Keith Findley and Michael Scott (2006)}} | : — ''The Multiple Dimensions of Tunnel Vision in Criminal Cases'' by Keith Findley and Michael Scott (2006)}} | ||
{{quote|To a man with a hammer, everything looks like a nail. | |||
:—Abraham Maslow}} | |||
{{d|Prosecutor’s tunnel vision|/ˈprɒsɪkjuːtəz/ /ˈtʌnᵊl/ /ˈvɪʒᵊn/|n}} | |||
{{drop|T|he collection of}} [[bias]]es and misconceptions that can lead ''prosecutors'' — in the widest sense: those who “prosecute” a particular theory of the world — to frame and maintain a view based on one’s starting hypothesis, however starkly it may be at variance with other evidence. | |||
So named because these people are often ''literal'' prosecutors, of crimes, and this kind of tunnel vision has led to notorious miscarriages of justice. The same collection of biases, prejudgments and psychological habits can motivate many kinds of ideology, conspiracy, management theory. They are simplistic solutions to complex problems, in the face of strong . Their appealing simplicity, especially where backed by data, can crowd out sometimes strong contrary argument especially where backed by common sense, intuition or inference. Data is evidence; inference is not. | |||
Criminal law proceeds upon the weight of evidence. A prosecutor must is prove guilt; the accused is not obliged to prove innocence, much less a plausible alternative account of events, for the simple reason that an innocent accused should have no better idea what happened than a anyone else. | |||
But a scenario where tendentious data may be introduced in support of guilt and where there is, for this reason, a total lack of “data” supporting exoneration — only the inadmissible intuition that this seems a highly unlikely turn of events in the abstract — may lead to that confusion. | |||
Still, the same phenomenon can appear elsewhere; the dogma of [[outsourcing]], for example, where the direct cost of an internal operations unit are a matter of accounting principles and therefore easy to measure but the benefits — informal interpersonal networks, employee commitment, institutional knowledge, and depth of experience are not, leading many businesses to make their operational stacks dramatically more fragile, rigid and brittle — worse, for all practical purposes but not accounting ones. | |||
Prosecutor’s tunnel vision therefore is a useful template for screening all kinds of bad [[decision-making]] environments. | |||
[[JC]] draws upon ''{{plainlink|https://media.law.wisc.edu/m/2fjzd/findley_scott_ssrn_copy-1.pdf|The Multiple Dimensions of Tunnel Vision in Criminal Cases}}'' by Keith Findley and Michael Scott in the Wisconsin Law Review (2006) and {{author|Robert Cialdini}}’s {{br|Persuasion}}. To some extent also the madness of crowds and Jon Haidt’s {{br|The Righteous Mind}}. The lesson we draw is that ''we are not as rational as we like to think''. | |||
It may describe ''all'' view-forming of a “conviction” kind. They are like political and religious views in that, once they take root, they are not easily displaced. | |||
The “wrongful conviction” cases are bracing because, with hindsight, armed with a better narrative and not having taken the the cognitive path that led prosecutors to their position, it is so hard to understand how they got there, or why they persist with such plainly untenable views. If we treat prosecutor’s tunnel vision as a variety of political or even religious conviction, we can see better how “prosecutors” can be so energetic in their maintenance of a bad [[model]]. It perhaps explains the gruesome in-house performance in the {{poh}}. | |||
Prosecutors need not be ''literal'' prosecutors: campaigners for innocence, and conspiracy theorists suffer at the hands of the same collection of cognitive traps. Both sides of the public conversation about [[Lucy Letby]] are similarly afflicted with tunnel vision: hence, allegations of conspiracy from both sides. | |||
====The three phases of tunnel vision==== | |||
Tunnel vision has three phases: first, the background conditions arise to make us ''vulnerable'' to tunnel vision in the first place; secondly, lpthose considerations that push us into a given tunnel; the third are those cognitive artefacts that ''keep'' us there. | |||
Call these “setting out”, “getting there” and “staying there”. | |||
In order of appearance: | |||
==Background== | |||
{{Drop|T|o get to}} a position where tunnel vision might toddle hold,we need: | |||
====Anchoring effect==== | |||
When making decisions we tend to rely on the first piece of information we get. Initial impressions can disproportionately influence our strategy and assessment of responsibility. This is the [[anchoring]] effect. | |||
====Overconfidence in expertise==== | |||
Those engaged as [[subject matter expert]]s may overestimate their ability to diagnose and judge subtle problems, especially those that are adjacent (nor nearly adjacent) to an area of expertise. Experts tend to over-emphasise their own domains in forming conclusions — this is an entry condition to any professional calling — when it might be a relatively minor part of the story. | |||
Where we are overly confident in our case — where we see its essential ''rectitude'' — we are less likely to consider alternatives, different models, theories or even evidence. | |||
====To a man with a hammer...==== | |||
Cadets don’t sign up for basic training hoping not to shoot a gun. | |||
The police show up for work to detect crime. Prosecutors to prosecute it. They are primed this way, as we all are: we like to be ''useful'': if presented with a mystery an expert’s ideal outcome is not “there is nothing to see here, folks”, and to pack up her equipment and go home. | |||
The dogged sleuth who smelled something fishy, stuck at it over the objections of her superiors and endured the shadowy machinations unseen malign forces is a literary archetype for a reason. We don’t hear so much about the obsessive geek who hounded an innocent woman to her grave. This is not a story we like to hear. (Survivorship bias). | |||
Someone analogous to the “to a man with a hammer, everything looks like a nail” syndrome: | |||
====Role pressure==== | |||
If there has been some apparent calumny, no-one will be satisfied by an agency who de-escalates. Officials will be under tremendous pressure to get results: West Yorkshire police missed opportunities to apprehend Peter Sutcliffe because of this, despite interviewing him on a number of occasions, because he didn’t meet a profile based on letters from “Wearside Jack”, who turned out to be a hoaxer. The pressure to hasten to convictions may arise due to career aspirations, public expectations, or institutional culture. | |||
The literal meaning of “[[iatrogenic]]” — an illness produced by the treatment. | |||
==Getting there== | |||
====Extrapolation==== | |||
Especially vulnerable are [[subject matter expert]]s. We are natural problem-solvers and model builders and we will easily slip beyond our brief and intrude into matters where we have little experience. A statistician can give us a compelling account of the Bayesian probabilities, but when she strays into the causes of elevated insulin readings in a sample containing an apparently significant cluster of readings. Likewise, a medical expert may opine ''that'' the insulin readings are elevated beyond what would usually be expected, but the forensic question of ''who or what caused the excess insulin levels'' is a question of forensics and not something a diabetes specialist has any better idea about than anyone else. | |||
====Precedent: bad heuristics==== | |||
The greater the expertise, the more grooved the expectations, the stronger the [[heuristic]], the greater the temptation to take that shortcut and ''presume'' that this is one of those cases. In the great preponderance of cases, this is a handy, efficient shortcut, but in the rare case that presents in a certain way but is an exception, it can be dangerous. Heuristics are excellent, efficient devices (as Gerd Gigernzer notes, they help us to catch balls without needing to perform differential equations), but when the model is wrong they can lead to trouble. | |||
====Confirmation bias==== | |||
Professor A J Chalmers noted that observation is theory dependent: scientists must first have a hypothesis to test before they can gather evidence, for otherwise you cannot know what evidence is even relevant. If observing cars to form laws of motion, is their colour relevant?<ref>Yes, is the counterintuitive answer. The “doppler effect” shifts the visible wavelength of light. But you have to have a theory that predicts this before you even know to look for it.</ref> | |||
Having picked a bad [[heuristic]], we tend to seek out, interpret, and best remember information that confirms it. We may overweight evidence that supports our theory and disregard or minimise anything that contradicts it. | |||
====Selective information processing==== | |||
Focusing on certain pieces of evidence while ignoring others. Prosecutors might only present evidence that strengthens their case and neglect exculpatory evidence that could help the defense. | |||
====Groupthink==== | |||
Thinking or making decisions as a group in a way that discourages creativity or individual responsibility: Prosecutors might conform to the prevailing opinion within their office, stifling dissenting views and critical analysis of the case. See also [[Dan Davies]]’ idea of “[[accountability sink]]s”. {{poh}} is perhaps the archetypal example of groupthink. | |||
====Reductionism==== | |||
Drilling deep into technical details that, by themselves, and shorn of all context, seem to lead to one conclusion — especially one you are already [[anchor]]ed to — notwithstanding the wider picture making the hypothesis unlikely. Especially in cases with no direct evidence, there is a great risk of this. | |||
Prosecutors’ focus on “blood” sprayed up in the footwell of the Chamberlains car led them to a theory that Azaria was murdered there, despite no evidence supporting the theory, and quite a lot — principally, the lack of time for Lindy Chamberlain to do any such thing. The prosecution case started with “murder in the car” as the anchoring evidence, and hypothesised a whole story around it, for which there was no supporting evidence but also no contradiucting evidence, so it was “possible”. There is a ''lot'' of this in the Lucy Letby case, on both sides. | |||
==Staying there== | |||
==== Hindsight bias and the reiteration effect ==== | |||
In hindsight, people tend to think an eventual outcome was inevitable, or more likely or predictable, than they might have before it happened. “What is the chance that that nice woman you met at the campsite just now will, in three hours, brutally murder her own nine-week old infant?” versus “Given that this nine-week old child has disappeared from the campsite, and the police suspect the mother of foul play, what is the prospect that her mother brutally murdered the child?” | |||
Through “hindsight bias” we project new knowledge (of actual outcomes) onto our knowledge of the past (observed behaviour), without realising that the perception of the past has been tainted by the subsequent information. | |||
Once a person becomes a prime suspect and prosecutors arrive at an outcome in their own determination of who ''they'' believe is guilty — hindsight bias suggests that, upon reflection, the suspect was the inevitable and likely suspect from the beginning. Evidence is malleable in light of this “realisation”. | |||
This is compounded by a “reiteration” effect. Our confidence in a theory increases the more we hear it, independent of its truth or falsity. The longer that police, prosecutors and witnesses live with a conclusion of guilt, the more entrenched their conclusion becomes, and the more obvious it appears that all evidence pointed to that conclusion from the very beginning. This “reiteration effect” makes it increasingly difficult for police and prosecutors to consider alternative perpetrators or theories of a crime. | |||
====Outcome bias==== | |||
Like hindsight bias, “outcome bias” involves projecting subsequent “outcomes” onto observed behaviour, only about the quality of a suspect’s decision. Subjects are more likely to judge as bad a suspect’s decision to operate when they are told the patient died during surgery than when told the patient survived. This is the operator error presumption from {{fieldguide}} | |||
====Sunk cost fallacy==== | |||
The inclination to continue an endeavour once money, effort, time ''or credibility'' has been invested, even when new evidence suggests the defendant might be innocent. (see also [[commitment]] when talking about [[persuasion]]) | |||
==Antidotes== | |||
{{quote| | |||
Q: How many psychiatrists does it take to change a light bulb? <br> | |||
A: Just one; but the light bulb really has to want to change.}} | |||
Some strategies to counteract the effect, but the predominant one is to ''want'' to keep an open mind. | |||
====Hanlon’s, and Otto’s razor==== | |||
{{quote|“Do not attribute to ''malice'' things that can just as well be explained by ''stupidity''.” | |||
:—''[[Hanlon’s razor]]''}} | |||
Don’t assume malice where stupidity will do; likewise, per Otto’s razor, don’t attribute to ''virtue'' something that could equally be attributed to self-interest; or to ''skill'' something that could equally be attributed to dumb ''luck''. |
Revision as of 07:47, 11 July 2024
By tunnel vision, we mean that “compendium of common heuristics and logical fallacies,” to which we are all susceptible, that lead actors in the criminal justice system to “focus on a suspect, select and filter the evidence that will ‘build a case’ for conviction, while ignoring or suppressing evidence that points away from guilt.” This process leads investigators, prosecutors, judges, and defence lawyers alike to focus on a particular conclusion and then filter all evidence in a case through the lens provided by that conclusion.
- — The Multiple Dimensions of Tunnel Vision in Criminal Cases by Keith Findley and Michael Scott (2006)
To a man with a hammer, everything looks like a nail.
- —Abraham Maslow
Prosecutor’s tunnel vision
/ˈprɒsɪkjuːtəz/ /ˈtʌnᵊl/ /ˈvɪʒᵊn/ (n.)
The collection of biases and misconceptions that can lead prosecutors — in the widest sense: those who “prosecute” a particular theory of the world — to frame and maintain a view based on one’s starting hypothesis, however starkly it may be at variance with other evidence.
So named because these people are often literal prosecutors, of crimes, and this kind of tunnel vision has led to notorious miscarriages of justice. The same collection of biases, prejudgments and psychological habits can motivate many kinds of ideology, conspiracy, management theory. They are simplistic solutions to complex problems, in the face of strong . Their appealing simplicity, especially where backed by data, can crowd out sometimes strong contrary argument especially where backed by common sense, intuition or inference. Data is evidence; inference is not.
Criminal law proceeds upon the weight of evidence. A prosecutor must is prove guilt; the accused is not obliged to prove innocence, much less a plausible alternative account of events, for the simple reason that an innocent accused should have no better idea what happened than a anyone else.
But a scenario where tendentious data may be introduced in support of guilt and where there is, for this reason, a total lack of “data” supporting exoneration — only the inadmissible intuition that this seems a highly unlikely turn of events in the abstract — may lead to that confusion.
Still, the same phenomenon can appear elsewhere; the dogma of outsourcing, for example, where the direct cost of an internal operations unit are a matter of accounting principles and therefore easy to measure but the benefits — informal interpersonal networks, employee commitment, institutional knowledge, and depth of experience are not, leading many businesses to make their operational stacks dramatically more fragile, rigid and brittle — worse, for all practical purposes but not accounting ones.
Prosecutor’s tunnel vision therefore is a useful template for screening all kinds of bad decision-making environments.
JC draws upon The Multiple Dimensions of Tunnel Vision in Criminal Cases by Keith Findley and Michael Scott in the Wisconsin Law Review (2006) and Robert Cialdini’s Persuasion. To some extent also the madness of crowds and Jon Haidt’s The Righteous Mind. The lesson we draw is that we are not as rational as we like to think.
It may describe all view-forming of a “conviction” kind. They are like political and religious views in that, once they take root, they are not easily displaced.
The “wrongful conviction” cases are bracing because, with hindsight, armed with a better narrative and not having taken the the cognitive path that led prosecutors to their position, it is so hard to understand how they got there, or why they persist with such plainly untenable views. If we treat prosecutor’s tunnel vision as a variety of political or even religious conviction, we can see better how “prosecutors” can be so energetic in their maintenance of a bad model. It perhaps explains the gruesome in-house performance in the Post Office Horizon IT scandal.
Prosecutors need not be literal prosecutors: campaigners for innocence, and conspiracy theorists suffer at the hands of the same collection of cognitive traps. Both sides of the public conversation about Lucy Letby are similarly afflicted with tunnel vision: hence, allegations of conspiracy from both sides.
The three phases of tunnel vision
Tunnel vision has three phases: first, the background conditions arise to make us vulnerable to tunnel vision in the first place; secondly, lpthose considerations that push us into a given tunnel; the third are those cognitive artefacts that keep us there.
Call these “setting out”, “getting there” and “staying there”.
In order of appearance:
Background
To get to a position where tunnel vision might toddle hold,we need:
Anchoring effect
When making decisions we tend to rely on the first piece of information we get. Initial impressions can disproportionately influence our strategy and assessment of responsibility. This is the anchoring effect.
Overconfidence in expertise
Those engaged as subject matter experts may overestimate their ability to diagnose and judge subtle problems, especially those that are adjacent (nor nearly adjacent) to an area of expertise. Experts tend to over-emphasise their own domains in forming conclusions — this is an entry condition to any professional calling — when it might be a relatively minor part of the story.
Where we are overly confident in our case — where we see its essential rectitude — we are less likely to consider alternatives, different models, theories or even evidence.
To a man with a hammer...
Cadets don’t sign up for basic training hoping not to shoot a gun.
The police show up for work to detect crime. Prosecutors to prosecute it. They are primed this way, as we all are: we like to be useful: if presented with a mystery an expert’s ideal outcome is not “there is nothing to see here, folks”, and to pack up her equipment and go home.
The dogged sleuth who smelled something fishy, stuck at it over the objections of her superiors and endured the shadowy machinations unseen malign forces is a literary archetype for a reason. We don’t hear so much about the obsessive geek who hounded an innocent woman to her grave. This is not a story we like to hear. (Survivorship bias).
Someone analogous to the “to a man with a hammer, everything looks like a nail” syndrome:
Role pressure
If there has been some apparent calumny, no-one will be satisfied by an agency who de-escalates. Officials will be under tremendous pressure to get results: West Yorkshire police missed opportunities to apprehend Peter Sutcliffe because of this, despite interviewing him on a number of occasions, because he didn’t meet a profile based on letters from “Wearside Jack”, who turned out to be a hoaxer. The pressure to hasten to convictions may arise due to career aspirations, public expectations, or institutional culture.
The literal meaning of “iatrogenic” — an illness produced by the treatment.
Getting there
Extrapolation
Especially vulnerable are subject matter experts. We are natural problem-solvers and model builders and we will easily slip beyond our brief and intrude into matters where we have little experience. A statistician can give us a compelling account of the Bayesian probabilities, but when she strays into the causes of elevated insulin readings in a sample containing an apparently significant cluster of readings. Likewise, a medical expert may opine that the insulin readings are elevated beyond what would usually be expected, but the forensic question of who or what caused the excess insulin levels is a question of forensics and not something a diabetes specialist has any better idea about than anyone else.
Precedent: bad heuristics
The greater the expertise, the more grooved the expectations, the stronger the heuristic, the greater the temptation to take that shortcut and presume that this is one of those cases. In the great preponderance of cases, this is a handy, efficient shortcut, but in the rare case that presents in a certain way but is an exception, it can be dangerous. Heuristics are excellent, efficient devices (as Gerd Gigernzer notes, they help us to catch balls without needing to perform differential equations), but when the model is wrong they can lead to trouble.
Confirmation bias
Professor A J Chalmers noted that observation is theory dependent: scientists must first have a hypothesis to test before they can gather evidence, for otherwise you cannot know what evidence is even relevant. If observing cars to form laws of motion, is their colour relevant?[1] Having picked a bad heuristic, we tend to seek out, interpret, and best remember information that confirms it. We may overweight evidence that supports our theory and disregard or minimise anything that contradicts it.
Selective information processing
Focusing on certain pieces of evidence while ignoring others. Prosecutors might only present evidence that strengthens their case and neglect exculpatory evidence that could help the defense.
Groupthink
Thinking or making decisions as a group in a way that discourages creativity or individual responsibility: Prosecutors might conform to the prevailing opinion within their office, stifling dissenting views and critical analysis of the case. See also Dan Davies’ idea of “accountability sinks”. Post Office Horizon IT scandal is perhaps the archetypal example of groupthink.
Reductionism
Drilling deep into technical details that, by themselves, and shorn of all context, seem to lead to one conclusion — especially one you are already anchored to — notwithstanding the wider picture making the hypothesis unlikely. Especially in cases with no direct evidence, there is a great risk of this.
Prosecutors’ focus on “blood” sprayed up in the footwell of the Chamberlains car led them to a theory that Azaria was murdered there, despite no evidence supporting the theory, and quite a lot — principally, the lack of time for Lindy Chamberlain to do any such thing. The prosecution case started with “murder in the car” as the anchoring evidence, and hypothesised a whole story around it, for which there was no supporting evidence but also no contradiucting evidence, so it was “possible”. There is a lot of this in the Lucy Letby case, on both sides.
Staying there
Hindsight bias and the reiteration effect
In hindsight, people tend to think an eventual outcome was inevitable, or more likely or predictable, than they might have before it happened. “What is the chance that that nice woman you met at the campsite just now will, in three hours, brutally murder her own nine-week old infant?” versus “Given that this nine-week old child has disappeared from the campsite, and the police suspect the mother of foul play, what is the prospect that her mother brutally murdered the child?”
Through “hindsight bias” we project new knowledge (of actual outcomes) onto our knowledge of the past (observed behaviour), without realising that the perception of the past has been tainted by the subsequent information.
Once a person becomes a prime suspect and prosecutors arrive at an outcome in their own determination of who they believe is guilty — hindsight bias suggests that, upon reflection, the suspect was the inevitable and likely suspect from the beginning. Evidence is malleable in light of this “realisation”.
This is compounded by a “reiteration” effect. Our confidence in a theory increases the more we hear it, independent of its truth or falsity. The longer that police, prosecutors and witnesses live with a conclusion of guilt, the more entrenched their conclusion becomes, and the more obvious it appears that all evidence pointed to that conclusion from the very beginning. This “reiteration effect” makes it increasingly difficult for police and prosecutors to consider alternative perpetrators or theories of a crime.
Outcome bias
Like hindsight bias, “outcome bias” involves projecting subsequent “outcomes” onto observed behaviour, only about the quality of a suspect’s decision. Subjects are more likely to judge as bad a suspect’s decision to operate when they are told the patient died during surgery than when told the patient survived. This is the operator error presumption from Sidney Dekker’s The Field Guide to Human Error Investigations
Sunk cost fallacy
The inclination to continue an endeavour once money, effort, time or credibility has been invested, even when new evidence suggests the defendant might be innocent. (see also commitment when talking about persuasion)
Antidotes
Q: How many psychiatrists does it take to change a light bulb?
A: Just one; but the light bulb really has to want to change.
Some strategies to counteract the effect, but the predominant one is to want to keep an open mind.
Hanlon’s, and Otto’s razor
“Do not attribute to malice things that can just as well be explained by stupidity.”
Don’t assume malice where stupidity will do; likewise, per Otto’s razor, don’t attribute to virtue something that could equally be attributed to self-interest; or to skill something that could equally be attributed to dumb luck.
- ↑ Yes, is the counterintuitive answer. The “doppler effect” shifts the visible wavelength of light. But you have to have a theory that predicts this before you even know to look for it.