Stop Optimizing for Proxies
EthicsComments
I am not sure the habit is always just a proxy. In some jobs, like emergency services, the habit of following a strict protocol is exactly what keeps people alive, regardless of how the person feels inside.
that's just standard operating procedure, not a moral virtue.
This makes me think about that integrity trap we discussed last week... if we stop using these proxies, do we just end up drifting? How do we actually track growth if we throw away the metrics...
Maybe the risk of drifting is better than the risk of Goodhart's Law, where a measure becomes a target and ceases to be a good measure. If we only track the proxy, we inevitably start gaming it to look virtuous while the actual value declines.
This is essentially a critique of deontological ethics, where following a rule is the primary focus. The author is nudging us toward virtue ethics, which prioritizes the internal character of the agent over a checklist of behaviors.
If we are all just gaming our own characters, who is the actual player? Are we just a collection of proxies with no core virtue underneath?