Algorithms of Oppression
How Search Engines Reinforce Racism
Safiya Umoja Noble's study of how search engines encode and amplify racism and sexism, built from years of documenting what commercial search returned for queries about Black women and girls.
- First published
- 2018
- Publisher
- Audible Studios on Brilliance
- Pages
- 229
- Shelf
- Technology
- Level
- Core
- ISBN-13
- 9781721307234
Record checked against
Catalogue note
- Reads as
- TechnicalAssumes and builds craft knowledge.
- Level
- Core / BuildingAssumes general familiarity with the subject.
- Approach
- Applied
- Written for
- Engineers, Readers with some grounding
Saved in this browser only — no account, nothing sent anywhere. My library
Read this if
- You want to think seriously about what these systems can and cannot do.
- You want to think harder about what is actually right.
- You want to understand how power is taken, kept and lost.
- You work in this area and want depth rather than an overview.
- You know roughly how the subject works and want the fuller account.
The evidence
Noble's originating example is a 2011 search for black girls, which returned pornography on the first page. She documents similar patterns for other racialised and gendered queries over several years.
Her argument is that these are not glitches. Search results are shaped by advertising markets, and a commercial ranking system will surface whatever is most profitably optimised for a term, including by people with an interest in defining a group.
Her case is that the results are not errors. They are what a advertising-funded ranking system produces.
Devmark’s reading — not a quotation from the book
The theoretical claim
Noble, an information studies scholar, argues against what she calls the myth of neutrality: the widely held belief that search reflects the web rather than curating it, which makes results feel like facts about the world.
She connects this to older library and classification scholarship on how subject headings encode the assumptions of whoever wrote them.
What changed and what did not
Google altered results for several of the specific queries Noble documented after the research received attention, which she treats as evidence for her argument rather than a resolution: individual fixes to individual terms leave the mechanism untouched.
The book predates generative search, and its central claim — that a commercially optimised information system will reproduce existing hierarchy while appearing neutral — has become more rather than less relevant.
Google fixed the specific searches she named, which she treats as proof of the point rather than a solution.
Devmark’s reading — not a quotation from the book
Technological redlining
Noble's organising term draws the analogy to housing discrimination deliberately: outcomes produced by systems rather than by individual prejudice, distributed automatically, and defended as the neutral operation of a process. The comparison is doing argumentative work — redlining was also procedural, also deniable, and also devastating.
Search is an advertising product
Her structural argument is that a search engine funded by advertising is optimising for commercial outcomes and attention, not for information quality, and that users nonetheless treat results as something closer to a reference work. The mismatch between what the system is for and what people believe it is for is where much of the harm sits.
People consult it as a library. It is funded, built and optimised as an advertising business.
Devmark’s reading — not a quotation from the book
Autocomplete and the path in
Noble examines suggested queries as an active shaper of what gets asked, not a passive reflection of what has been asked, and connects this to documented cases in which a search journey led a user into organised extremist material. The mechanism is not that the engine endorses anything; it is that optimisation for engagement builds a route.
Why fixing the query is not a fix
Several of the specific searches she documented were altered after publication and after press attention. Noble treats this as confirmation rather than resolution: a system that produces such results, and then corrects them individually when they become embarrassing, is being managed by public relations rather than redesigned. The generating conditions remain.
The case for a public alternative
Her constructive proposal comes from library and information science: that finding reliable information is a public good with a long professional tradition behind it, and that handing the function entirely to advertising- funded private systems was a choice that could be revisited. The proposal is sketched rather than detailed.
Where it dates
The specific examples are from a particular period and many have changed, which makes the book easy to dismiss on its particulars. The structural argument is not affected by that, but a reader coming to it now should expect to verify individual claims against the current behaviour of the systems rather than assuming they still hold.
What to take from it
The durable contribution is the refusal of the neutrality claim: ranking is editorial, the ordering encodes decisions, and "the algorithm did it" names a set of choices rather than excusing them. That framing has since become common, and this book did a substantial amount of the work of making it so.
What to take away
- 01Documented over yearsSpecific searches recorded repeatedly rather than cited once.
- 02Advertising shapes rankingThe commercial mechanism, not a bug in it.
- 03The myth of neutralityResults feel like facts because search appears to reflect rather than curate.
- 04Classification historyConnected to older scholarship on how subject headings encode assumptions.
- 05Patched, not fixedIndividual terms were corrected; the mechanism was not.
