Lune

USENIX Security2023Top-tier venue

Bug Hunters' Perspectives on the Challenges and Benefits of the Bug Bounty Ecosystem

Omer Akgul, Taha Eghtesad, Amit Elazari, Omprakash Gnawali, Jens Grossklags, Michelle L. Mazurek, Daniel Votipka, Aron Laszka

Abstract

Although researchers have characterized the bug-bounty ecosystem from the point of view of platforms and programs, minimal effort has been made to understand the perspectives of the main workers: bug hunters. To improve bug bounties, it is important to understand hunters' motivating factors, challenges, and overall benefits. We address this research gap with three studies: identifying key factors through a free listing survey (n=56), rating each factor's importance with a larger-scale factor-rating survey (n=159), and conducting semi-structured interviews to uncover details (n=24). Of 54 factors that bug hunters listed, we find that rewards and learning opportunities are the most important benefits. Further, we find scope to be the top differentiator between programs. Surprisingly, we find earning reputation to be one of the least important motivators for hunters. Of the challenges we identify, communication problems, such as unresponsiveness and disputes, are the most substantial. We present recommendations to make the bug-bounty ecosystem accommodating to more bug hunters and ultimately increase participation in an underutilized market.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

15 top-tier papers have cited it since. Know what they found before your reviewers do.

Questions to start from

Lune can draw on

the full paper · the top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Lineage

  • The Benefits of Vulnerability Discovery and Bug Bounty Programs: Case Studies of Chromium and Firefox cites Hackers vs. Testers: A Comparison of Software Vulnerability Discovery Processes
  • Unveiling the Hunter-Gatherers: Exploring Threat Hunting Practices and Challenges in Cyber Defense cites Hackers vs. Testers: A Comparison of Software Vulnerability Discovery Processes
  • HackEd: A Pedagogical Analysis of Online Vulnerability Discovery Exercises cites Hackers vs. Testers: A Comparison of Software Vulnerability Discovery Processes
  • ProphetFuzz: Fully Automated Prediction and Fuzzing of High-Risk Option Combinations with Only Documentation via Large Language Model cites Hackers vs. Testers: A Comparison of Software Vulnerability Discovery Processes
  • A Sea of Cyber Threats: Maritime Cybersecurity from the Perspective of Mariners cites Hackers vs. Testers: A Comparison of Software Vulnerability Discovery Processes
Builds onCited byLeft to right by year; the more cited, the higher.

Cited by top-tier papers15

  1. The Benefits of Vulnerability Discovery and Bug Bounty Programs: Case Studies of Chromium and FirefoxSoodeh Atefi, Amutheezan Sivagnanam, Afiya Ayman, Jens Grossklags et al.WWW 2023 · 13 citations
  2. Unveiling the Hunter-Gatherers: Exploring Threat Hunting Practices and Challenges in Cyber DefensePriyanka Badva, Kopo M. Ramokapane, Eleonora Pantano, Awais RashidUSENIX Security 2024 · 13 citations
  3. ProphetFuzz: Fully Automated Prediction and Fuzzing of High-Risk Option Combinations with Only Documentation via Large Language ModelDawei Wang, Geng Zhou, Li Chen, Dan Li et al.CCS 2024 · 9 citations
  4. A Sea of Cyber Threats: Maritime Cybersecurity from the Perspective of MarinersAnna Raymaker, Akshaya Kumar, Miuyin Yong Wong, Ryan Pickren et al.CCS 2025 · 5 citations
  5. Credible Threat Detection? Measuring Contribution Dynamics and Quality Control in a Crowdsourced Threat Detection EcosystemApurva Virkud, Gang Wang, Adam BatesUSENIX Security 2026 · 1 citation

Builds on7

  1. Hackers vs. Testers: A Comparison of Software Vulnerability Discovery ProcessesDaniel Votipka, Rock Stevens, Elissa M. Redmiles, Jeremy Hu et al.S&P 2018 · 151 citations
  2. A Large-Scale Interview Study on Information Security in and Attacks against Small and Medium-sized EnterprisesNicolas Huaman, Bennet von Skarczinski, Christian Stransky, Dominik Wermke et al.USENIX Security 2021 · 30 citations
  3. A Large-Scale Measurement of Cybercrime Against IndividualsCasey F. Breen, Cormac Herley, Elissa M. RedmilesCHI 2022 · 26 citations
  4. HackEd: A Pedagogical Analysis of Online Vulnerability Discovery ExercisesDaniel Votipka, Eric Zhang, Michelle L. MazurekS&P 2021 · 22 citations
  5. The Benefits of Vulnerability Discovery and Bug Bounty Programs: Case Studies of Chromium and FirefoxSoodeh Atefi, Amutheezan Sivagnanam, Afiya Ayman, Jens Grossklags et al.WWW 2023 · 13 citations

Related papers

  1. A Deep Dive into How Open-Source Project Maintainers Review and Resolve Bug Bounty ReportsJessy Ayala, Steven Ngo, Joshua GarciaS&P 2025
  2. Study Club, Labor Union or Start-Up? Characterizing Teams and Collaboration in the Bug Bounty EcosystemYangheran Piao, Temima Hrle, Daniel W. Woods, Ross AndersonS&P 2025
  3. A Mixed-Methods Study of Open-Source Software Maintainers On Vulnerability Management and Platform Security FeaturesJessy Ayala, Yu-Jye Tung, Joshua GarciaUSENIX Security 2025
  4. IoT Bugs and Development ChallengesAmir Makhshari, Ali MesbahICSE 2021 · 76 citations
  5. The Shifting Sands of Motivation: Revisiting What Drives Contributors in Open SourceMarco Aurélio Gerosa, Igor Wiese, Bianca Trinkenreich, Georg Link et al.ICSE 2021 · 4 citations
Dusk over the sea between two cliffs drawn in fine vertical lines