Comparing a BERT Classifier and a GPT classifier for Detecting Connective Language Across Multiple Social Media
Josephine Lukito, Bin Chen, Gina M. Masullo, Natalie Jomini Stroud
Abstract
This study presents an approach for detecting connective language-defined as language that facilitates engagement, understanding, and conversation-from social media discussions. We developed and evaluated two types of classifiers: BERT and GPT-3.5 turbo. Our results demonstrate that the BERT classifier significantly outperforms GPT-3.5 turbo in detecting connective language. Furthermore, our analysis confirms that connective language is distinct from related concepts measuring discourse qualities, such as politeness and toxicity. We also explore the potential of BERT-based classifiers for platform-agnostic tools. This research advances our understanding of the linguistic dimensions of online communication and proposes practical tools for detecting connective language across diverse digital environments.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 3871e809-e43b-45f2-a579-c1cc5f9b5ba9Builds on5
- Systematic Biases in LLM Simulations of DebatesAmir Taubenfeld, Yaniv Dover, Roi Reichart, Ariel GoldsteinEMNLP 2024 · 35 citations
- Embedding Democratic Values into Social Media AIs via Societal Objective FunctionsChenyan Jia, Michelle S. Lam, Minh Chau Mai, Jeffrey T. Hancock et al.CSCW 2024 · 32 citations
- Nudge for Deliberativeness: How Interface Features Influence Online DiscourseSanju Menon, Weiyu Zhang, Simon T. PerraultCHI 2020 · 29 citations
- On the Reliability and Validity of Detecting Approval of Political Actors in TweetsIndira Sen, Fabian Flöck, Claudia WagnerEMNLP 2020 · 23 citations
- The Language of Situational EmpathyKe Zhou, Luca Maria Aiello, Sanja Scepanovic, Daniele Quercia et al.CSCW 2021 · 20 citations
Related papers
- Computational Analysis of Conversation Dynamics through Participant ResponsivityMargaret A. Hughes, Brandon Roy, Elinor Poole-Dayan, Deb Roy et al.EMNLP 2025
- BERT Knows Punta Cana is not just beautiful, it's gorgeous: Ranking Scalar Adjectives with Contextualised RepresentationsAina Garí Soler, Marianna ApidianakiEMNLP 2020 · 1 citation
- Pair programming conversations with agents vs. developers: challenges and opportunities for SE communityPeter Robe, Sandeep Kaur Kuttal, Jake AuBuchon, Jacob C. HartFSE 2022 · 17 citations
- Adjective Scale Probe: Can Language Models Encode Formal Semantics Information?Wei Liu, Ming Xiang, Nai DingAAAI 2023 · 7 citations
- Linguistic Bias in ChatGPT: Language Models Reinforce Dialect DiscriminationEve Fleisig, Genevieve Smith, Madeline Bossi, Ishita Rustagi et al.EMNLP 2024 · 36 citations
