What company do words keep? Revisiting the distributional semantics of J.R. Firth & Zellig Harris - Incite at Columbia University
-
Work
What company do words keep? Revisiting the distributional semantics of J.R. Firth & Zellig Harris
- Led by Columbia Center for Oral History Research
- Published July 10, 2022
- Authors Mikael Brunila Jack LaViolette
- Category Paper
- Forum ACL Anthology
- Link doi.org
The power of word embeddings is attributed to the linguistic theory that similar words will appear in similar contexts.
This idea is specifically invoked by noting that “you shall know a word by the company it keeps,” a quote from British linguist J.R. Firth who, along with his American colleague Zellig Harris, is often credited with the invention of “distributional semantics.” While both Firth and Harris are cited in all major NLP textbooks and many foundational papers, the content and differences between their theories is seldom discussed.
Engaging in a close reading of their work, we discover two distinct and in many ways divergent theories of meaning. One focuses exclusively on the internal workings of linguistic forms, while the other invites us to consider words in new company—not just with other linguistic elements, but also in a broader cultural and situational context.
Contrasting these theories from the perspective of current debates in NLP, we discover in Firth a figure who could guide the field towards a more culturally grounded notion of semantics. We consider how an expanded notion of “context” might be modeled in practice through two different strategies: comparative stratification and syntagmatic extension.
Related Works
-
go to the Columbia University students return amid fear Trump antisemitism deal gives away too muchSep 2025Columbia University students return amid fear Trump antisemitism deal gives away too much Cayla BambergerNew York Daily News
-
go to the United for Retail: Care & Support for Retail WorkersSep 2025United for Retail: Care & Support for Retail Workers Adam Reich, Hana Shepherd
-
go to the Relational Organizing CurriculumSep 2025Relational Organizing Curriculum Adam Reich, Hana Shepherd
-
go to the Workplace Networks and the Dynamics of Worker OrganizingAug 2025Workplace Networks and the Dynamics of Worker Organizing Hana Shepherd, Rebecca Roskill, Suresh Naidu, Adam ReichSociological Science
-
go to the Let Them Speak: In Search of the Drowned; Testimonies and Testimonial Fragments of the HolocaustAug 2025Let Them Speak: In Search of the Drowned; Testimonies and Testimonial Fragments of the Holocaust Chris PandzaOral History Review
-
go to the Capturing global investigative journalism's oral historyJul 2025Capturing global investigative journalism's oral history Silas TsangInvestigative Reporters & Editors
-
go to the Columbia's Administrators are Fooling ThemselvesJul 2025Columbia's Administrators are Fooling Themselves Suresh NaiduNew York Times
-
go to the Harrison White and the Practice of SociologyJul 2025Harrison White and the Practice of Sociology Peter Bearman, Ronald L. BreigerSociologica
-
go to the Lindt Dissertation FellowshipJun 2025Lindt Dissertation Fellowship Amy WeissenbachColumbia Graduate School of Arts & Sciences
-
go to the Kohli Prize for SociologyMay 2025Kohli Prize for Sociology Peter BearmanKohli Foundation for Sociology