Trolley problem: Difference between revisions

From The Jolly Contrarian
Jump to navigation Jump to search
No edit summary
No edit summary
 
(7 intermediate revisions by the same user not shown)
Line 5: Line 5:
}}
}}


{{drop|P|hilosophy ''loves'' condundrums}} like the trolley problem. Philippa Foot invented it in the 1960s,<ref>''The Problem of Abortion and the Doctrine of the Double Effect'' (1967)</ref> as a thought experiment to explore the difference in moral qualities between ''co''mmission and ''o''mission. We might, Foot thought, consider it morally permissible to divert the trolley away from the workers, as the death is a foreseeable but unwanted consequence of the action, but not to push someone onto the tracks to stop the trolley even though the outcome would be the same.  
{{drop|P|hilosophy ''loves'' conundrums}} like the trolley problem. Philippa Foot invented it in the 1960s<ref>''The Problem of Abortion and the Doctrine of the Double Effect'' (1967)</ref> as a thought experiment to compare the moral qualities of ''co''mmission and ''o''mission. We might, Foot thought, think it acceptable to divert a runaway trolley away from the larger group of workers, as the desired action is “steering ''away'' from these victims” rather than toward the single worker. While the consequence of doing so (the single worker’s death) is foreseeable, it is an unwanted contingency flowing from the action rather than its intended effect. On the other hand, pushing an innocent bystander onto the first track to stop the trolley before it gets to the six workers is directly to intend one person’s death, which is ''not'' acceptable, even though the outcome would be the same.  


This is a narrow point, long since lost on modern denizens who trot the problem out while holding forth on real, not metaphorical, runaway trolleys: driverless cars. The trolley problem presents in public debate as a live moral dilemma, in need of a solution.  
This is a neat challenge to extreme utilitarianism but, still, a narrow point, long since lost on netizens who now trot the problem out when discussing real, not metaphorical, runaway trolleys: driverless cars.


That was not its original point.
====Driverless cars====
{{quote|What if a child runs out in front of an autonomous vehicle? What if the vehicle can avoid the child, but only at the cost of causing some other damage or injury? How should it be programmed? Where all outcomes are unconscionable, how can the vehicle operator ''avoid'' moral culpability?}}


{{quote|What if a child runs out in front of an autonomous vehicle? What if it can avoid the obstacle, but only at the cost of some other damage? Should the car be programmed to avoid the child and swerve into oncoming vehicles, or pedestrians? Or carry on, possibly killing the child?}}
{{Drop|H|ere, the trolley}} problem is not a metaphorical analogy, but a live practical dilemma. With autonomous vehicles, we are told, this could happen so we must choose, in the abstract and without time pressure, between imagined unconscionable outcome ''A'' and imagined unconscionable outcome ''B'', but without recourse to any solution ''C'', which is to redesign the system to avoid outcomes ''A'' ''and'' ''B''.


The dilemma asks us to choose between unconscionable outcome ''A'' and unconscionable outcome ''B''. There is no good option. Which should we take?
We can see at once this is an emotive but essentially sterile question to which, by design, there’s no good answer. A hypothetical in which someone dies however it pans out holds no moral lesson other than ''fix it, so there is another outcome''.  


We can see at once this is an emotive but essentially sterile question. There’s no good answer.
But, explicitly, we aren’t allowed that choice.


Is this a problem in need of solving? Or is this just philosophical trolling?
====Parallel worlds of science and philosophy====
{{Drop|S|cientists live in}} this [[Simple system|simple]], stable world filled to the brim with countless, benign little engines — “[[nomological machine]]s” — by which everything reliably ''works''. In this idealised world, we can predict the period of a swinging pendulum with Galileo’s equation. We can calculate the pressure and volume of a quantity of gas with Boyle’s law. We can explain the accelerating expansion of the universe with dark matter, dark energy and an arbitrary cosmological constant. [''I don’t think this last one is a great example — Ed'']


There are many problems to solve and risks to allocate before autonomous vehicles go mainstream, but this ''highly'' artificial hypothetical is not one of them. This is a ''thought experiment'' dreamed up for a philosophy journal. It is not meant to address real-world problems.
In the scientists’s world, ''everything'' runs like clockwork.<ref>This clockwork world is a beguiling lie, as [[Nancy Cartwright]] argues.</ref>


====Parallel worlds of science and philosophy====
Philosophers inhabit, more or less, a dark inversion of the scientists’ world. Theirs is, instead, a universe of ''insoluble conundrums''. They also fill their space with [[Nomological machine|ingenious devices]], only malicious ones: “thought experiments” invented ''specifically to bugger everything up''.  
{{Drop|S|cientists live in}} this [[Simple system|simple]], stable world filled to the brim with countless, benign little “[[nomological machine]]s” they have designed, by which everything reliably ''works''. They can predict the period of a swinging object with the pendulum equation, t = 2π√(l/g). They know the pressure and volume of a quantity of gas thanks to Boyle’s law. They can explain the accelerating expansion of the universe with dark matter, dark energy and an arbitrary cosmological constant. [''I don’t think this last one is a great example — Ed''] In the scientists’s world, ''everything'' runs like clockwork.


Philosophers inhabit, more or less, a dark inversion of the scientists’ world. Theirs is, instead, a universe of ''insoluble conundrum''. They also fill their space with [[Nomological machine|ingenious devices]], only malicious ones: philosophical contraptions invented ''specifically to bugger everything up''. In the philosophers’ world, ''nothing'' goes according to plan.  
In the scientist’s world, everything goes to plan. In the philosophers’ world, ''nothing'' does.  


For each scientific axiom, whirring happily away in its intricate cage, reliably plotting out the forward progress of the world, the philosophers have their obstreperous counterpoints: here, a ''brain in a vat'', there, a ''Chinese room'', over yonder, a ''parallel universe'' — designed to throw the whole edifice into confusion. The ideal world for philosophers is one where nothing works. It affords a licence to sit around arguing ''why the hell not''. This is why they turn up.
For every scientific axiom, whirring happily away in its intricate cage, plotting out the reliable progress of the world, the philosophers have their obstreperous demonic contraptions: here, a ''brain in a vat'', there, a ''Chinese room'', over yonder, a ''parallel universe'' — designed to throw the whole edifice into confusion.  


====Negative-Lindy effect====
====Negative-Lindy effect====
{{drop|I|f a philosophical}} conundrum ever cropped up in real life, someone practical would have to ''solve'' it. This would spoil it: a solved thought experiment is like a drunk bottle: all the fun’s gone out of it: it can’t teach you anything. The best way of resisting solution is to not show up in the first place. To keep out of the way of practical people, and make your home in the minds of academic philosophers. To have lasting value, therefore, a philosophical thought experiment must have some kind of ''negative'' “[[Lindy effect]]”.  
{{drop|J|ust as science}} is designed to explain the world as we experience it, philosophy questions our basic assumptions about reality. Philosophical thought experiments are designed to draw out that confusion. But since we perceive the world to be reliable, constant and consistent — it is these regularities that our scientific “engines” explain — philosophical thought experiments must have the unalterable property of being ''entirely hypothetical''.
 
If a philosophical conundrum ever cropped up in real life, someone would have to ''solve'' it. This would spoil it: a solved thought experiment is like a drunk bottle: all the fun’s gone out of it: it can’t teach you anything. The best way of resisting solution by practical people is, naturally, to not show up in the first place: to make your exclusive home in the minds of academic philosophers. To have lasting value, therefore, a philosophical thought experiment must have some kind of ''negative'' “[[Lindy effect]]”.  


The ''real'' [[Lindy effect]] is a measure of [[Antifragile|antifragility]]: things are “road tested” that have taken a beating at the hands of children, animals and practical people over time and are still working — are less likely to break in the future. If they had a critical weakness, someone would have found it. Untested, new things are more likely to break. We don’t know yet whether they are fragile. If you had to bet which would last longer, the Pyramids of Giza or the Las Vegas Sphere?
The ''real'' [[Lindy effect]] is a measure of [[Antifragile|antifragility]]: things like scientific experiments must be “road tested”. Ideas that have taken a beating at the hands of children, animals and practical people over time and that ''still work'' — are less likely to fail in the future. If they had a critical weakness, someone would have found it. The longer an idea has been round, the more resilient we can expect it to be.
 
Untested, new ideas are more likely to break. We don’t yet know their vulnerabilities. We don’t know how fragile they are. If you had to bet which would last longer, the Pyramids of Giza or the Las Vegas Sphere?


The endurance test for philosophical thought experiments is the opposite:
The endurance test for philosophical thought experiments is the opposite:
Line 37: Line 42:
{{quote|The Negative Lindy Effect: the longer a philosophical thought experiment can survive ''without'' presenting in real life to actual people to be tested, the more resilient it will be.}}
{{quote|The Negative Lindy Effect: the longer a philosophical thought experiment can survive ''without'' presenting in real life to actual people to be tested, the more resilient it will be.}}


Descartes’ brain in a vat. Excellent. Berkeley’s falling tree in a forest. Brilliant. Fully untestable.  
Descartes’ brain in a vat: ''excellent''. Berkeley’s falling tree in a forest: ''brilliant''. (By definition, no one can ever experience it!) Fully untestable.  


The Trolley Problem seemed like just such an excellent thought experiment: what kind of real-world event could have all the following qualities? A set of determined future outcomes, unfolding over a period that is long enough for the subject to be able to definitively act with moral clarity in a way that is partly ''but not fully'' remedial, and yet not quite long enough that the subject can problem-solve, engineer a superior outcome, or just warn anyone, while all the time there is no supervening moral agency from anyone else involved in the scenario?
The Trolley Problem ''seemed'' like just such an untestable thought experiment: a subject is presented with a set of alternative [[Unknowns|known knowns]] over a period both long enough for the subject to act with definitive moral clarity but yet not entirely avoid bad outcomes, but not long enough for her to problem-solve, while all the time no-one else with any moral responsibility for the scenario has the practical ability to do anything to prevent it.


Just one person can act, and they can only pull a switch, or not pull it.
Just one person can act, they can only pull a switch, or not pull it, and someone dies either way.


This is about as artificial as a problem could be.
This is about as artificial as a problem could be, isn’t it?


=====Artificial certainty=====
=====Artificial certainty=====
Line 63: Line 68:
This is to impose a [[simple system]] on a [[Complexity|complex problem]]. The real world would not tolerate such an approach: if we can foresee an adverse outcome — and we can; we are expostulating about it — ''we are obliged to fix it''. This is a minimum standard of system design. Not redesigning the system is the moral failure, not “pulling or failing to pull a lever”.
This is to impose a [[simple system]] on a [[Complexity|complex problem]]. The real world would not tolerate such an approach: if we can foresee an adverse outcome — and we can; we are expostulating about it — ''we are obliged to fix it''. This is a minimum standard of system design. Not redesigning the system is the moral failure, not “pulling or failing to pull a lever”.


If we ''know'' there is an inherent “trolley problem” in our system design we cannot wait for a ''literally'' foreseen calamity to happen before acting to stop it.  
If we ''know'' there is an inherent “trolley problem” in our system design we cannot wait for a ''literally foreseen'' calamity to happen before acting to stop it.  


Realising there is a risk and running it anyway is the definition of “[[Reckless|recklessness]]”: someone ''would'' be guilty of murder in this hypothetical.
By the way: realising there is a risk and running it anyway is the legal definition of “[[Reckless|recklessness]]”: someone ''would'' be guilty of murder in this hypothetical.


=====Artificial (lack of) social context =====
=====Artificial (lack of) social context =====
The trolley problem also strips away all social and institutional contexts. Why have we designed the system this way? How have we managed to get to this point without anyone foreseeing it?  
The trolley problem also strips away all social and institutional contexts. Why have we designed the system this way? How have we managed to get to this point without anyone foreseeing it?  


Trolley problems do not occur in the real world because this social context will intervene to prevent them from arising. We build systems to anticipate problems. We encounter design flaws once and solve them. This is the (good) [[Lindy effect]]: ''Bad designs get junked''. Good ones stand the test of time.
Trolley problems do not occur in the real world because this social context will  
prevent them. We build systems to anticipate problems. We encounter design flaws once and solve them. This is the (good) [[Lindy effect]]: ''Bad designs get junked''. ''Good'' ones stand the test of time.


=====Artificial moral agency vacuum=====
=====Artificial moral agency vacuum=====
By being made to focus on the switch-puller’s choice, we are forced to overlook real moral failures that led to the situation. The points operator is, by comparison, a random bystander. Despite bearing ''no'' responsibility for the situation — she neither designed the track, nor operated it, nor scheduled the workers, nor trained them, nor did she cause the runaway trolley — the poor points operator is expected to be omniscient while everyone else with any part in this incipient tragedy is ''entirely, and justifiably, [[Inadvertence|inadvertent]]''.
By focussing on the switch-puller’s choice, we overlook real moral failures that must have led to the situation. The points operator is, for all intents, a random bystander. She bears ''no'' responsibility for the situation — she neither designed the track, nor scheduled the workers, nor trained them, nor did she cause the runaway trolley — yet she alone is expected to be omniscient while everyone else with any part in this incipient tragedy is ''entirely, and justifiably, [[Inadvertence|inadvertent]]''.


Who designed such an inept system? Who assigned the workers to those dangerous conditions? Who lost control of the trolley? Why weren’t they looking out? Why were there no fail-safes, warning procedures or circuit breakers? Why was the track not designed to prevent accidents like this? Did no one think this could happen?
Who designed such an inept system? Who assigned the workers to those dangerous conditions? Who lost control of the trolley? Why weren’t they looking out? Why were there no fail-safes, warning procedures or circuit breakers? Why was the track not designed to prevent accidents like this? Did no one think this could happen?


====False paradox====
====False paradox====
Line 81: Line 87:
{{small|80}}
{{small|80}}
{{tabletopflex|100}}
{{tabletopflex|100}}
|+ Caption text
{{aligntop}}
{{aligntop}}
! Rowspan="3" | Player !! Rowspan="3" | Responsible for !! Colspan="3"| Time of awareness  
! Rowspan="3" | Player !! Rowspan="3" | Responsible for !! Colspan="3"| Time of awareness  
|-
|-
!! Rowspan="2" |Before Breakaway !! Colspan="2" |After Breakaway
!! Rowspan="2" |Before breakaway !! Colspan="2" |After breakaway
{{aligntop}}
{{aligntop}}
!time to react !! no time to react
!Time to react !! No time to react
{{aligntop}}
{{aligntop}}
| System Designer || System design safety, foreseeable failure modes ||Could implement: fail-safes, emergency brakes, worker safety zones, warning systems|| Could activate: emergency protocols, backup systems|| Too late
| System Designer || System design safety, foreseeable failure modes. ||Implement fail-safes, emergency brakes, worker safety zones, warning systems.|| Could activate: emergency protocols, backup systems|| Too late.
{{aligntop}}
{{aligntop}}
| System Operator || Worker safety, track access, safe rostering, risk assessment||Could ensure: safe work procedures, worker positioning, track access control Maintenance schedule|| Could initiate: emergency protocols, worker evacuation, system shutdown|| Too late
| System Operator || Worker safety, track access, safe rostering, risk assessment. ||Ensure safe work procedures, worker positioning, track access control, maintenance.|| Could initiate: emergency protocols, worker evacuation, system shutdown|| Too late.
{{aligntop}}
{{aligntop}}
| Track workers || Challenging unsafe conditions, being experts, keeping a lookout for danger. || Raise issues. Quit! || Evacuate track || Pray
| Track workers || Challenging unsafe conditions, being experts, keeping a lookout for danger. || Raise issues. Quit! || Evacuate track. || Too late.
{{aligntop}}
{{aligntop}}
| Switch Operator || Looking after his switch
| Switch Operator || Looking after switch.
||Make sure the switch is working. || Call for help || Pull switch!
||Make sureswitch  is working. || Raise alarm. Call for help. || Pull switch!
|}
|}
</div>
</div>
Of all these moral, practical and systems considerations here — there are a lot — the hapless switch operator’s position is the ''least'' vexed. If it gets to the point where the only judgment remaining is “whether or not to throw the switch” and ''no one else'' is already fully culpable for putting the switch operator in that position, and if, [[Q.E.D.]], the switch operator has no time to think about it either, then it necessarily follows that the switch operator will not be blamed for doing nothing.  
Of all these moral, practical and systems considerations here — there are a lot — the hapless switch operator’s position is the ''least'' vexed. If it gets to the point where the only judgment remaining is “whether or not to throw the switch” and ''no one else'' is already fully culpable for putting the switch operator in that position, and if, [[Q.E.D.]], the switch operator has no time to think about it either, then it necessarily follows that the switch operator will not be blamed for doing nothing.  


This will just be one of those things. ''Shit happens''. ''Accidents'' happen. The switch operator did not have the time or information to make the moral calculus to intervene, and realistically never would.
This will just be one of those things. ''Accidents happen''. The switch operator did not have the time or information to make the moral calculus to intervene, and realistically never would.
====The driverless cars====
====The driverless cars====
{{drop|A|pplying all this}} to autonomous cars, we see is a false equivalence. Why does the trolley problem not arise, already, for human drivers? Because, unlike TESLAs, humans aren’t perfect rationalising machines. They don’t run on GeForce chips. They cannot flawlessly assimilate, triangulate and arbitrate on terabytes of real-time data within a microsecond — was it a child? A fox? A dog? A balloon? — calculate the brake horsepower, vectors, momentum ''and'' a flawless Rawlsian moral outcome and communicate its executive decision to the drive train in time to vouchsafe the appropriate outcome.  
{{drop|A|pplying all this}} to autonomous cars, we see a false equivalence. Why does the trolley problem not arise, already, for human drivers? Because, unlike AVs, humans aren’t expected to be perfect calculating, rationalising machines. They don’t run on GeForce chips. They cannot flawlessly assimilate, triangulate and arbitrate on terabytes of real-time data within a microsecond — was it a child? A fox? A dog? A balloon? — calculate the brake horsepower, vectors, momentum, apply flawless Rawlsian moral reasoning ''and'' communicate the resulting executive decision to the drive train in time to achieve the appropriate outcome.  


If a human driver reacted at all, he may blindly stomp on the anchors without a conscious thought at all. Most likely he will just flatten whatever ran out in front of him and that will be that. Terrible accident. Humans can’t be judged because they lack the faculties to do any better.  
If a human driver reacted at all, he may blindly slam on the anchors and yank the steering wheel without a conscious thought ''at all''. Most likely, he will just flatten whatever ran out in front of him and that will be that. Terrible accident. But he can’t be judged because he lacks the faculties to do any better.  


So why are we obsessing about autonomous cars? We are already in far a better set of outcomes than humans could produce. We are finding a moral conundrum in a [[fractal]] segment of [[spacetime]] previously inaccessible to moral discourse. It would be long gone before the moral passions arrived on the scene.  
And, realistically, a hyper-intelligent autonomous machine ''still'' wouldn’t be able to identify the obstacle, identify the alternatives, evaluate the potential damage for each outcome, and assess their relative moral consequences and correctly execute the most morally profitable manoeuvre in the split second available.  


And, realistically, a hyper-powered super-intelligent machine ''still'' wouldn’t be able to identify the obstacle, identify the alternatives (veer left? veer right?), evaluate the potential collateral damage for each outcome, and assess their relative moral consequences (Is an adult worth more than a child? Less? What are the criteria? What if they are roughly the same? What if you don’t know?) and correctly execute the most morally profitable manoeuvre.
So why are we obsessing about autonomous cars? Data suggest that driverless cars are materially safer than human-operated ones. They promise a better set of outcomes. Yet because of ''our'' cognitive limitations, humans do not — apparently — suffer from the trolley problem. We are finding a moral conundrum in a [[fractal]] segment of [[spacetime]] previously inaccessible to moral discourse. By obsessing over hypothetical thought experiments, we delay progress on a statistically better outcome.  
 
There are, perhaps, safety issues with driverless cars. However, if, as we are told, their accident rate for autonomous vehicles is ''way'' lower than for humans,then obsessing with hypothetical thought experiments we might prolong a statistically better outcome.  
{{quote|''Le mieux est l'ennemi du bien.''}}
{{quote|''Le mieux est l'ennemi du bien.''}}


====Too cute====
====Too cute====
{{drop|T|he trolley problem}} is ''too'' cute to be a useful [[nomological machine]], even for philosophers. By pitting dramatically unequal moral outcomes against each other makes it easy for ''philosophers'' to get worked up about it, but at the same time creates artificial clarity where none would exist in the wild. This is the ideal negative Lindy effect. Ethical choices do not present themselves as arithmetic. Moral calculus is ''hard''
{{drop|T|he trolley problem}} is ''too'' cute to be a useful [[nomological machine]] in this context, even for philosophers. By pitting dramatically unequal moral outcomes against each other — ''six'' deaths here, ''one'' there — it is easy for philosophers to get worked up, but exaggerates the already artificial clarity of the dilemma. This is a truly impossible scenario: the ''ideal'' [[negative Lindy effect]]. Tough ethical choices do not manifest as arithmetic. Moral calculus is ''hard''.  
 
Let’s rework the dilemma: what if there were ''one'' child on each track? You could save ''this'' one, at the expense of ''that'' one? What if one were a girl, the other a boy? What if one were rich, one poor? What if one were from a marginalised community? What if they both were, from ''different'' marginalised communities? What if the required moral calculus were genuinely ''ambiguous''? 
 
For, surely these ambivalent cases would greatly outnumber those where a neat utilitarian outcome was beyond doubt.  


Some might say we can draw useful metaphors from the trolley problem — that it is a useful tool for exploring moral intuitions about action versus inaction, and ''intended'' versus ''foreseen'' consequences. But there are better ways of doing that, that would resonate in real-world scenarios, and without absurd mechanical artefacts to distract from the core ethical question.
So, let’s rework the dilemma: what if the alternatives were broadly comparable: what if there were ''one'' child on each track? You could save ''this'' one, at the expense of ''that'' one? What if the alternatives weren’t comparable ''at all''? What if one were a girl, the other a boy? What if one were rich, one poor? What if one were from a marginalised community? What if ''both'' were, from ''different'' marginalised communities? How would we configure that into an algorithm to be operated at a moment’s notice? What if the required moral calculus were genuinely ''ambiguous''?


For, surely these are how cases would present in real life: there would be no neat utilitarian computation which would put the moral outcome beyond doubt.


{{nld}}
You might say we can draw useful metaphors from the trolley problem — it is a useful tool for exploring moral intuitions about action versus inaction, and ''intended'' versus ''foreseen'' consequences. Sure. But there are better ways of doing that, that would resonate in real-world scenarios, and without absurd mechanical artefacts to distract from the core ethical question.
{{nlp}}

Latest revision as of 13:05, 21 November 2024

Lies, Damn Lies and Statistics
Index: Click to expand:
Tell me more
Sign up for our newsletter — or just get in touch: for ½ a weekly 🍺 you get to consult JC. Ask about it here.

Le mieux est l'ennemi du bien.

—Voltaire

A runaway trolley is hurtling down a track toward five workers who will certainly be killed if it continues on its course. You are standing next to a point switch. You can divert the trolley onto a side track, saving the five workers, but only at the certain cost of a sixth, who is working on the spur line. Should you pull the switch to divert the trolley, proactively saving five lives, at the certain cost of one?

Philosophy loves conundrums like the trolley problem. Philippa Foot invented it in the 1960s[1] as a thought experiment to compare the moral qualities of commission and omission. We might, Foot thought, think it acceptable to divert a runaway trolley away from the larger group of workers, as the desired action is “steering away from these victims” rather than toward the single worker. While the consequence of doing so (the single worker’s death) is foreseeable, it is an unwanted contingency flowing from the action rather than its intended effect. On the other hand, pushing an innocent bystander onto the first track to stop the trolley before it gets to the six workers is directly to intend one person’s death, which is not acceptable, even though the outcome would be the same.

This is a neat challenge to extreme utilitarianism but, still, a narrow point, long since lost on netizens who now trot the problem out when discussing real, not metaphorical, runaway trolleys: driverless cars.

Driverless cars

What if a child runs out in front of an autonomous vehicle? What if the vehicle can avoid the child, but only at the cost of causing some other damage or injury? How should it be programmed? Where all outcomes are unconscionable, how can the vehicle operator avoid moral culpability?

Here, the trolley problem is not a metaphorical analogy, but a live practical dilemma. With autonomous vehicles, we are told, this could happen so we must choose, in the abstract and without time pressure, between imagined unconscionable outcome A and imagined unconscionable outcome B, but without recourse to any solution C, which is to redesign the system to avoid outcomes A and B.

We can see at once this is an emotive but essentially sterile question to which, by design, there’s no good answer. A hypothetical in which someone dies however it pans out holds no moral lesson other than fix it, so there is another outcome.

But, explicitly, we aren’t allowed that choice.

Parallel worlds of science and philosophy

Scientists live in this simple, stable world filled to the brim with countless, benign little engines — “nomological machines” — by which everything reliably works. In this idealised world, we can predict the period of a swinging pendulum with Galileo’s equation. We can calculate the pressure and volume of a quantity of gas with Boyle’s law. We can explain the accelerating expansion of the universe with dark matter, dark energy and an arbitrary cosmological constant. [I don’t think this last one is a great example — Ed]

In the scientists’s world, everything runs like clockwork.[2]

Philosophers inhabit, more or less, a dark inversion of the scientists’ world. Theirs is, instead, a universe of insoluble conundrums. They also fill their space with ingenious devices, only malicious ones: “thought experiments” invented specifically to bugger everything up.

In the scientist’s world, everything goes to plan. In the philosophers’ world, nothing does.

For every scientific axiom, whirring happily away in its intricate cage, plotting out the reliable progress of the world, the philosophers have their obstreperous demonic contraptions: here, a brain in a vat, there, a Chinese room, over yonder, a parallel universe — designed to throw the whole edifice into confusion.

Negative-Lindy effect

Just as science is designed to explain the world as we experience it, philosophy questions our basic assumptions about reality. Philosophical thought experiments are designed to draw out that confusion. But since we perceive the world to be reliable, constant and consistent — it is these regularities that our scientific “engines” explain — philosophical thought experiments must have the unalterable property of being entirely hypothetical.

If a philosophical conundrum ever cropped up in real life, someone would have to solve it. This would spoil it: a solved thought experiment is like a drunk bottle: all the fun’s gone out of it: it can’t teach you anything. The best way of resisting solution by practical people is, naturally, to not show up in the first place: to make your exclusive home in the minds of academic philosophers. To have lasting value, therefore, a philosophical thought experiment must have some kind of negativeLindy effect”.

The real Lindy effect is a measure of antifragility: things like scientific experiments must be “road tested”. Ideas that have taken a beating at the hands of children, animals and practical people over time and that still work — are less likely to fail in the future. If they had a critical weakness, someone would have found it. The longer an idea has been round, the more resilient we can expect it to be.

Untested, new ideas are more likely to break. We don’t yet know their vulnerabilities. We don’t know how fragile they are. If you had to bet which would last longer, the Pyramids of Giza or the Las Vegas Sphere?

The endurance test for philosophical thought experiments is the opposite:

The Negative Lindy Effect: the longer a philosophical thought experiment can survive without presenting in real life to actual people to be tested, the more resilient it will be.

Descartes’ brain in a vat: excellent. Berkeley’s falling tree in a forest: brilliant. (By definition, no one can ever experience it!) Fully untestable.

The Trolley Problem seemed like just such an untestable thought experiment: a subject is presented with a set of alternative known knowns over a period both long enough for the subject to act with definitive moral clarity but yet not entirely avoid bad outcomes, but not long enough for her to problem-solve, while all the time no-one else with any moral responsibility for the scenario has the practical ability to do anything to prevent it.

Just one person can act, they can only pull a switch, or not pull it, and someone dies either way.

This is about as artificial as a problem could be, isn’t it?

Artificial certainty

Firstly, we are asked to accept that the subject has perfect, absolute knowledge of the present state and the future outcomes on both tracks — that the train is coming, that it cannot be stopped, that the only possible intervention is her points operation, that death on one spur or the other is inevitable — and that no-one else in the scenario with any moral agency has any knowledge, either of the current status or the future potential.

The subject must be certain that the impacted workers will die. How? Can she see them? If so, why can’t she communicate with them? Why can’t they see her?

Why can’t the workers see anything? Why don’t they get off the tracks?

How about the track operator: can she not see what is happening?

Artificial timeframe

In real life, there are usually many “intervention points” before a crisis. When there aren’t, nor will there be time for abstract moral calculation.

The Trolley Problem artificially compresses moral deliberation into an instant. It must, to close off opportunities for resourcefulness, problem-solving and communication that would spoil its explanatory force.

The subject must pre-solve a moral dilemma in the abstract but without being allowed to request changes to a necessarily inadequate system to prevent the dilemma from arising in the first place.

This is to impose a simple system on a complex problem. The real world would not tolerate such an approach: if we can foresee an adverse outcome — and we can; we are expostulating about it — we are obliged to fix it. This is a minimum standard of system design. Not redesigning the system is the moral failure, not “pulling or failing to pull a lever”.

If we know there is an inherent “trolley problem” in our system design we cannot wait for a literally foreseen calamity to happen before acting to stop it.

By the way: realising there is a risk and running it anyway is the legal definition of “recklessness”: someone would be guilty of murder in this hypothetical.

Artificial (lack of) social context

The trolley problem also strips away all social and institutional contexts. Why have we designed the system this way? How have we managed to get to this point without anyone foreseeing it?

Trolley problems do not occur in the real world because this social context will prevent them. We build systems to anticipate problems. We encounter design flaws once and solve them. This is the (good) Lindy effect: Bad designs get junked. Good ones stand the test of time.

Artificial moral agency vacuum

By focussing on the switch-puller’s choice, we overlook real moral failures that must have led to the situation. The points operator is, for all intents, a random bystander. She bears no responsibility for the situation — she neither designed the track, nor scheduled the workers, nor trained them, nor did she cause the runaway trolley — yet she alone is expected to be omniscient while everyone else with any part in this incipient tragedy is entirely, and justifiably, inadvertent.

Who designed such an inept system? Who assigned the workers to those dangerous conditions? Who lost control of the trolley? Why weren’t they looking out? Why were there no fail-safes, warning procedures or circuit breakers? Why was the track not designed to prevent accidents like this? Did no one think this could happen?

False paradox

You all know how JC loves a paradox; well, this is a false one. There is no real-world scenario where the trolley problem can play out as a genuine moral conundrum.

Player Responsible for Time of awareness
Before breakaway After breakaway
Time to react No time to react
System Designer System design safety, foreseeable failure modes. Implement fail-safes, emergency brakes, worker safety zones, warning systems. Could activate: emergency protocols, backup systems Too late.
System Operator Worker safety, track access, safe rostering, risk assessment. Ensure safe work procedures, worker positioning, track access control, maintenance. Could initiate: emergency protocols, worker evacuation, system shutdown Too late.
Track workers Challenging unsafe conditions, being experts, keeping a lookout for danger. Raise issues. Quit! Evacuate track. Too late.
Switch Operator Looking after switch. Make sureswitch is working. Raise alarm. Call for help. Pull switch!

Of all these moral, practical and systems considerations here — there are a lot — the hapless switch operator’s position is the least vexed. If it gets to the point where the only judgment remaining is “whether or not to throw the switch” and no one else is already fully culpable for putting the switch operator in that position, and if, Q.E.D., the switch operator has no time to think about it either, then it necessarily follows that the switch operator will not be blamed for doing nothing.

This will just be one of those things. Accidents happen. The switch operator did not have the time or information to make the moral calculus to intervene, and realistically never would.

The driverless cars

Applying all this to autonomous cars, we see a false equivalence. Why does the trolley problem not arise, already, for human drivers? Because, unlike AVs, humans aren’t expected to be perfect calculating, rationalising machines. They don’t run on GeForce chips. They cannot flawlessly assimilate, triangulate and arbitrate on terabytes of real-time data within a microsecond — was it a child? A fox? A dog? A balloon? — calculate the brake horsepower, vectors, momentum, apply flawless Rawlsian moral reasoning and communicate the resulting executive decision to the drive train in time to achieve the appropriate outcome.

If a human driver reacted at all, he may blindly slam on the anchors and yank the steering wheel without a conscious thought at all. Most likely, he will just flatten whatever ran out in front of him and that will be that. Terrible accident. But he can’t be judged because he lacks the faculties to do any better.

And, realistically, a hyper-intelligent autonomous machine still wouldn’t be able to identify the obstacle, identify the alternatives, evaluate the potential damage for each outcome, and assess their relative moral consequences and correctly execute the most morally profitable manoeuvre in the split second available.

So why are we obsessing about autonomous cars? Data suggest that driverless cars are materially safer than human-operated ones. They promise a better set of outcomes. Yet because of our cognitive limitations, humans do not — apparently — suffer from the trolley problem. We are finding a moral conundrum in a fractal segment of spacetime previously inaccessible to moral discourse. By obsessing over hypothetical thought experiments, we delay progress on a statistically better outcome.

Le mieux est l'ennemi du bien.

Too cute

The trolley problem is too cute to be a useful nomological machine in this context, even for philosophers. By pitting dramatically unequal moral outcomes against each other — six deaths here, one there — it is easy for philosophers to get worked up, but exaggerates the already artificial clarity of the dilemma. This is a truly impossible scenario: the ideal negative Lindy effect. Tough ethical choices do not manifest as arithmetic. Moral calculus is hard.

So, let’s rework the dilemma: what if the alternatives were broadly comparable: what if there were one child on each track? You could save this one, at the expense of that one? What if the alternatives weren’t comparable at all? What if one were a girl, the other a boy? What if one were rich, one poor? What if one were from a marginalised community? What if both were, from different marginalised communities? How would we configure that into an algorithm to be operated at a moment’s notice? What if the required moral calculus were genuinely ambiguous?

For, surely these are how cases would present in real life: there would be no neat utilitarian computation which would put the moral outcome beyond doubt.

You might say we can draw useful metaphors from the trolley problem — it is a useful tool for exploring moral intuitions about action versus inaction, and intended versus foreseen consequences. Sure. But there are better ways of doing that, that would resonate in real-world scenarios, and without absurd mechanical artefacts to distract from the core ethical question.

  1. The Problem of Abortion and the Doctrine of the Double Effect (1967)
  2. This clockwork world is a beguiling lie, as Nancy Cartwright argues.