Weapons of Math Destruction

"I came up with a name for these harmful kinds of models: Weapons of Math Destruction, or WMDs for short." WMDs defined.

"I came up with a name for these harmful kinds of models: Weapons of Math Destruction, or WMDs for short." WMDs defined. Weapons of Math Destruction (WMDs) are mathematical models or algorithms that have the potential to cause significant harm to individuals and society. These models are characterized by three key features: Opacity: The inner workings of the model are hidden from those affected by it Scale: The model impacts a large number of people Damage: The model has negative consequences for individuals or groups Real-world impact. WMDs can be found in various domains, including: Education (teacher evaluations) Criminal justice (recidivism prediction) Finance (credit scoring) Employment (automated hiring) Advertising (targeted ads) These algorithms, while often created with good intentions, can perpetuate biases, reinforce inequalities, and make critical decisions about people's lives without proper oversight or accountability.

"Being poor in a world of WMDs is getting more and more dangerous and expensive." Feedback loops. WMDs often create pernicious feedback loops that disproportionately affect low-income individuals and communities. For example: Poor credit scores → Higher interest rates → More debt → Lower credit scores Living in high-crime areas → More policing → More arrests → Higher perceived crime rates Proxies for poverty. Many WMDs use data points that serve as proxies for poverty, such as: Zip codes Education level Employment history These proxies can lead to discriminatory outcomes, even when the model doesn't explicitly consider race or income. Limited recourse. Low-income individuals often lack the resources to challenge or appeal decisions made by WMDs, further entrenching their disadvantaged position.

"The U.S. News college ranking has great scale, inflicts widespread damage, and generates an almost endless spiral of destructive feedback loops." Unintended consequences. The U.S. News & World Report college rankings, while intended to provide useful information to prospective students, have had far-reaching and often detrimental effects on higher education: Colleges prioritize factors that improve their ranking over educational quality Increased focus on standardized test scores and selectivity Inflated tuition costs as colleges invest in amenities to attract high-scoring students Gaming the system. Some institutions have resorted to unethical practices to improve their rankings: Misreporting data Manipulating admissions processes Encouraging low-performing students to transfer before graduation Reinforcing inequality. The rankings system tends to benefit wealthy institutions and students, while disadvantaging less resourced colleges and lower-income applicants.

"The for-profit colleges focused on the other, more vulnerable, side of the population. And the Internet gave them the perfect tool to do so." Targeted marketing. For-profit colleges use sophisticated data analytics to target vulnerable individuals: Low-income communities Military veterans Single parents Unemployed individuals Deceptive…