Library Discover Ideas My library Paths Compare Shelves Collections Method
Algorithms of OppressionSafiya Umoja NobleCover of Algorithms of Oppression by Safiya Umoja Noble
3 min read

Technology & AI

Algorithms of Oppression

How Search Engines Reinforce Racism

Safiya Umoja Noble

Safiya Umoja Noble's study of how search engines encode and amplify racism and sexism, built from years of documenting what commercial search returned for queries about Black women and girls.

First published
2018
Publisher
Audible Studios on Brilliance
Pages
229
Level
Core
ISBN-13
9781721307234
aijusticecritique

Record checked against

Catalogue note

Reads as
TechnicalAssumes and builds craft knowledge.
Level
Core / BuildingAssumes general familiarity with the subject.
Approach
Applied
Written for
Engineers, Readers with some grounding
Your shelf

Saved in this browser only — no account, nothing sent anywhere. My library

Read this if

  • You want to think seriously about what these systems can and cannot do.
  • You want to think harder about what is actually right.
  • You want to understand how power is taken, kept and lost.
  • You work in this area and want depth rather than an overview.
  • You know roughly how the subject works and want the fuller account.
01

The evidence

Noble's originating example is a 2011 search for black girls, which returned pornography on the first page. She documents similar patterns for other racialised and gendered queries over several years.

Her argument is that these are not glitches. Search results are shaped by advertising markets, and a commercial ranking system will surface whatever is most profitably optimised for a term, including by people with an interest in defining a group.

Her case is that the results are not errors. They are what a advertising-funded ranking system produces.

Devmark’s reading — not a quotation from the book
02

The theoretical claim

Noble, an information studies scholar, argues against what she calls the myth of neutrality: the widely held belief that search reflects the web rather than curating it, which makes results feel like facts about the world.

She connects this to older library and classification scholarship on how subject headings encode the assumptions of whoever wrote them.

03

What changed and what did not

Google altered results for several of the specific queries Noble documented after the research received attention, which she treats as evidence for her argument rather than a resolution: individual fixes to individual terms leave the mechanism untouched.

The book predates generative search, and its central claim — that a commercially optimised information system will reproduce existing hierarchy while appearing neutral — has become more rather than less relevant.

Google fixed the specific searches she named, which she treats as proof of the point rather than a solution.

Devmark’s reading — not a quotation from the book
04

Technological redlining

Noble's organising term draws the analogy to housing discrimination deliberately: outcomes produced by systems rather than by individual prejudice, distributed automatically, and defended as the neutral operation of a process. The comparison is doing argumentative work — redlining was also procedural, also deniable, and also devastating.

05

Search is an advertising product

Her structural argument is that a search engine funded by advertising is optimising for commercial outcomes and attention, not for information quality, and that users nonetheless treat results as something closer to a reference work. The mismatch between what the system is for and what people believe it is for is where much of the harm sits.

People consult it as a library. It is funded, built and optimised as an advertising business.

Devmark’s reading — not a quotation from the book
06

Autocomplete and the path in

Noble examines suggested queries as an active shaper of what gets asked, not a passive reflection of what has been asked, and connects this to documented cases in which a search journey led a user into organised extremist material. The mechanism is not that the engine endorses anything; it is that optimisation for engagement builds a route.

07

Why fixing the query is not a fix

Several of the specific searches she documented were altered after publication and after press attention. Noble treats this as confirmation rather than resolution: a system that produces such results, and then corrects them individually when they become embarrassing, is being managed by public relations rather than redesigned. The generating conditions remain.

08

The case for a public alternative

Her constructive proposal comes from library and information science: that finding reliable information is a public good with a long professional tradition behind it, and that handing the function entirely to advertising- funded private systems was a choice that could be revisited. The proposal is sketched rather than detailed.

09

Where it dates

The specific examples are from a particular period and many have changed, which makes the book easy to dismiss on its particulars. The structural argument is not affected by that, but a reader coming to it now should expect to verify individual claims against the current behaviour of the systems rather than assuming they still hold.

10

What to take from it

The durable contribution is the refusal of the neutrality claim: ranking is editorial, the ordering encodes decisions, and "the algorithm did it" names a set of choices rather than excusing them. That framing has since become common, and this book did a substantial amount of the work of making it so.

—

What to take away

  1. 01Documented over yearsSpecific searches recorded repeatedly rather than cited once.
  2. 02Advertising shapes rankingThe commercial mechanism, not a bug in it.
  3. 03The myth of neutralityResults feel like facts because search appears to reflect rather than curate.
  4. 04Classification historyConnected to older scholarship on how subject headings encode assumptions.
  5. 05Patched, not fixedIndividual terms were corrected; the mechanism was not.

Reading journey

A route through this idea

This book is not on a curated path, so the route below is derived from the catalogue: what comes before it, what goes further, and what approaches the same ground differently.

  1. Start hereWeapons of Math DestructionEthics, and it assumes less before you start.
  2. You are hereAlgorithms of Oppression
  3. Go deeperA Theory of JusticeSame ground — Ethics and Politics & power — and it assumes more of you.
  4. A different angleJusticeAlso about Ethics and Politics & power, but it reads as reflective where that one is technical.
  5. Somewhere else entirelyChaosPhysics & cosmos and Artificial intelligence travel together in this library, and this comes at it from the other side.

Nearby on the shelves

Related reading

↑↓ to move↵ to openesc to close