Online Reviews Are Leading Indicators of Changes in K-12 School Attributes
Linsen Li, Aron Culotta, Douglas N. Harris, Nicholas Mattei
Abstract
School rating websites are increasingly used by parents to assess the quality and fit of U.S. K-12 schools for their children. These online reviews often contain detailed descriptions of a school’s strengths and weaknesses, which both reflect and inform perceptions of a school. Existing work on these text reviews has focused on finding words or themes that underlie these perceptions, but has stopped short of using the textual reviews as leading indicators of school performance. In this paper, we investigate to what extent the language used in online reviews of a school is predictive of changes in the attributes of that school, such as its socio-economic makeup and student test scores. Using over 300K reviews of 70K U.S. schools from a popular ratings website, we apply language processing models to predict whether schools will significantly increase or decrease in an attribute of interest over a future time horizon. We find that using the text improves predictive performance significantly over a baseline model that does not include text but only the historical time-series of the indicators themselves, suggesting that the review text carries predictive power. A qualitative analysis of the most predictive terms and phrases used in the text reviews indicates a number of topics that serve as leading indicators, such as diversity, changes in school leadership, a focus on testing, and school safety.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Your agent calls
Lunesearch_papers
Free to start. No credit card required.
Terminal
Install the CLIlune papers get 0db61bbf-838e-4add-92b4-4d58c8cbdd74Related papers
- Whose Language Counts as High Quality? Measuring Language Ideologies in Text Data SelectionSuchin Gururangan, Dallas Card, Sarah K. Dreier, Emily K. Gade et al.EMNLP 2022 · 41 citations
- Simple Scores are Messy Signals: How Users Interpret Scores on Real Estate PlatformsElizabeth ResorCSCW 2024 · 1 citation
- Conversations Gone Alright: Quantifying and Predicting Prosocial Outcomes in Online ConversationsJiajun Bao, Junjie Wu, Yiming Zhang, Eshwar Chandrasekharan et al.WWW 2021 · 63 citations
- Modeling Organizational Culture with Workplace Experiences Shared on GlassdoorVedant Das Swain, Koustuv Saha, Manikanta D. Reddy, Hemang Rajvanshy et al.CHI 2020 · 56 citations
- Measuring Forecasting Skill from TextShi Zong, Alan Ritter, Eduard H. HovyACL 2020 · 21 citations
