Metric: Difference between revisions

785 bytes added ,  3 May 2023
no edit summary
No edit summary
Tags: Mobile edit Mobile web edit
No edit summary
Tags: Mobile edit Mobile web edit
Line 10: Line 10:
To be contrasted with the ineffable, inarticulable skills that are provided by a [[subject matter expert]].
To be contrasted with the ineffable, inarticulable skills that are provided by a [[subject matter expert]].
===[[Goodhart’s law]]===
===[[Goodhart’s law]]===
An excellent page of resources on [[Goodhart’s law]] to be found [https://modelthinkers.com/mental-model/goodharts-law here].
Not a law of economics or sociology so much as a wry remark — professor Goodhart made it at a symposium in 1975 — that, happens to pierce modern management orthodoxy through the heart.  Thus it can both spur its own industry of academic work in sociology and [[systems theory]], and at the same time go ignored in the upper tiers of corporate management:
Not a law of economics or sociology so much as a wry remark — professor Goodhart made it at a symposium in 1975 — that, happens to pierce modern management orthodoxy through the heart.  Thus it can both spur its own real industry of academic work in sociology and systems theory, and go completely ignored in the upper tiers of corporate management.  
 
{{Quote|When a measure becomes a target, it ceases to be a good measure.}}
 
It is so universal enough to apply even to dolphins. An aquarium in Miami is reported to have dealt with the problem of litter and dead seagulls in the main tank by rewarding dolphins for cleaning them up: a fish for each bird, or piece of litter.
 
Before long the dolphins were observed breaking up pieces of litter and claiming multiple fish for one each, and then stockpiling surplus fish, luring seagulls with them, and killing the seagulls!<ref>[https://open.spotify.com/episode/3y799K1qGOhqxPUGcqXwx0 Rationally Speaking podcast episode 240.</ref>
 
“we should ” as xxx remarked, “bevgrateful dolphins don't have opposable thumbs.”
 
One could, and here I am indebted to  [https://modelthinkers.com/mental-model/goodharts-law this] excellent resource on [[Goodhart’s law]], break the phenomenon down into four types.
 


*'''Regressive''': using a single metric as a proxy to measure a phenomenon that is actually [[multivariate]] — caused by several factors. Here [[Simpson ’s paradox]] is not your friend.
*'''Regressive''': using a single metric as a proxy to measure a phenomenon that is actually [[multivariate]] — caused by several factors. Here [[Simpson ’s paradox]] is not your friend.