Metric: Difference between revisions

Metric (view source)

1,204 bytes added , 2 May 2023

no edit summary

82,891

edits

@@ Line 9: / Line 9: @@
 To be contrasted with the ineffable, inarticulable skills that are provided by a [[subject matter expert]].
+===[[Goodhart’s law]]===
+An excellent page of resources on [[Goodhart’s law]] to be found [https://modelthinkers.com/mental-model/goodharts-law here].
+Regressive
+Choosing a measurement that is a single proxy to your goal, when the goal actually has several causal factors behind it.
+Knowing that successful basketballers tend to be tall, you might build a basketball team by recruiting tall people. However, they might not possess other factors such as coordination, fitness, quick responses etc..
+Extremal
+Where a proxy might indicate the goal under normal circumstances, but not in variable contexts.
+Sugar consumption helped define our ancient ancestors’ survival however today, with a different context, our excessive sugar consumption is often an indicator of an unhealthy diet.
+Causal
+Confusing Causation vs Correlation when selecting measurements.
+Data might indicate increasing ice cream sales when people wear sunglasses. However, providing more sunglasses won’t necessarily boost ice cream sales because they are both caused by a third factor, ie. sunny, hot days.
+Adversarial (Cobra Effect)
+Choosing a proxy measurement incentivises people to make the proxy the new goal.
 {{Outsourcing}}
 *[[Beware of shorthand]]