A Comparative Study of News Exposure and Consumption On and Off Facebook

Social media giants like Meta, Google, and X leverage powerful algorithms to personalize user feeds, a practice now under intense public scrutiny. These algorithms can inadvertently skew the information users consume, potentially influencing political opinions and voting decisions. This raises critical questions: Do social media platforms foster misinformation and contribute to echo chambers?

To address this ongoing debate, our study directly compares news exposure on Facebook (where algorithmic influence is strong) with news consumption off-platform (where user behavior plays a larger role). Specifically, we investigate: (1) Are users exposed to more/less misinformation on Facebook compared with their off-platform misinformation consumption? (2) Is news exposure on Facebook more/less diverse than off-platform news consumption? (3) To what extent do socio-demographic and psychological factors influence misinformation exposure on Facebook and consumption off Facebook? (4) Is there a relationship between socio-demographic and psychological factors and news diversity on and off Facebook? and (5) Is users' exposure to misinformation on Facebook correlated to off-platform news consumption?

The longstanding biggest barrier to answering these questions has been the lack of access to data on what information users see and consume while browsing the Internet. In this paper, we use a measurement approach that asks a panel of users to donate data about the content they see online. For this, we designed a tool to collect traces of all news articles that individuals encounter on their desktop Facebook timeline and while they browse the Internet (off Facebook), along with signals about how users interact with them (e.g., clicks, time spent reading). Our tool observes content and interactions on and off Facebook on 4,149 news media domains sourced from Media Bias Fact Check and NewsGuard. Alongside the news post and article collection, we conduct surveys to gather socio-demographic and psychological data from our participants.

Our study of 123,995 news-related posts on Facebook and 70,587 news articles visits off Facebook, collected from 642 users during 12 weeks, reveals the following central findings: (1) Only a small fraction 4% of users' news consumption off Facebook is driven by news exposure on Facebook, and only 5.7% of misinformation consumption off Facebook is driven by news exposure on Facebook. (2) There is a higher prevalence of misinformation in user-received content on Facebook compared to deliberately consumed content off-platform. On Facebook, 5.9% of our users' news exposure comes from sources known for spreading misinformation, while off-platform, only 2.6% of our users' news consumption is from misinformation sources. Conversely, Facebook presents more diverse content -22% of users received content from only one political leaning on Facebook, compared to 36% of users who consumed content from only one political leaning off-platform.

(3) Several socio-demographic and psychological factors showed a statistically significant correlation with misinformation exposure on Facebook but not misinformation consumption off Facebook. (4) The proportion of misinformation consumed off Facebook emerged as a statistically significant predictor of users' exposure to misinformation on Facebook, independent of news consumption on Facebook.