Food for thought: Goodharts law

The Goodharts law as explained for the “citations”

As applied in economics, the law is implicit in the economic idea of rational expectations, a theory in economics that states that entities who are aware of a system of rewards and punishments will optimize their actions within said system to achieve their desired results. E.g. employees whose performance in a company is measured by some known quantitative measure (cars sold in a month etc.) will attempt to optimize regarding that measure regardless of whether their behaviour is profit-maximizing. While it originated in the context of market responses, the law has profound implications for the selection of high-level targets in organizations Jón Danı́elsson quotes the law as “Any statistical relationship will break down when used for policy purposes” and suggests a corollary to the law for use in financial risk modelling: “A risk model breaks down when used for regulatory purposes.” Mario Biagioli has related the concept to consequences of using citation impact measures to estimate the importance of scientific publications

Goodharts law – Wikipedia

We really need to rethink the rule over the citations index.