Lune

VLDB2025Top-tier venue

Detecting Schema-Related Logic Bugs in Relational DBMSs via Equivalent Database Construction

Jiansen Song, Wensheng Dou, Yingying Zheng, Yu Gao, Ziyu Cui, Wei Wang, Jun Wei

Abstract

Relational Database Management Systems (DBMSs) provide flexible DDL (Data Definition Language) statements that enable the creation, modification, and deletion of database schemas. In addition to database schemas, relational DBMSs typically manage various schema-related information internally, e.g., schema changes, tablespace allocation, and block-level data layout. However, incorrect implementations related to schema-related information maintenance and utilization can introduce schema-related logic bugs. These bugs can cause DQL (Data Query Language) statements to return incorrect query results and DML (Data Manipulation Language) statements to create incorrect database states. Existing approaches mainly focus on detecting logic bugs in DQL statements, but are ineffective in detecting schema-related logic bugs.

In this paper, we propose a novel and general testing approach, DDLCheck, to effectively detect schema-related logic bugs in relational DBMSs. We first generate a complex DDL sequence

seq gen

that consists of various types of DDL statements, and then synthesize a rather simple DDL sequence

seq syn

, which utilizes CREATE statements to create the same database schema as

seq gen .

Executing the same SQL statements on the two databases created by

seq gen

and

Seq syn

should yield the same execution results. Any discrepancy between their execution results indicates a schema-related logic bug. To improve the testing efficiency of DDLCheck, we further design a DDL-sequence-oriented testing optimization strategy, which can help DDLCheck explore diverse schema-related information and detect schema-related logic bugs quickly. We implement and evaluate DDLCheck on six widely-used relational DBMSs. We have detected 34 bugs in these DBMSs, of which 29 bugs have been confirmed as previously unknown bugs and 9 bugs have been fixed.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

6 top-tier papers have cited it since. Know what they found before your reviewers do.

Questions to start from

Lune can draw on

the full paper · the top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Lineage

  • Detecting Data-Type-Related Logic Bugs in Relational DBMSs via Compatible Database Construction cites Detecting Isolation Anomalies in Relational DBMSs
  • Detecting Data-Type-Related Logic Bugs in Relational DBMSs via Compatible Database Construction cites Finding bugs in database systems via query partitioning
  • Detecting Data-Type-Related Logic Bugs in Relational DBMSs via Compatible Database Construction cites Detecting optimization bugs in database engines via non-optimizing reference engine construction
  • Detecting Data-Type-Related Logic Bugs in Relational DBMSs via Compatible Database Construction cites APOLLO: Automatic Detection and Diagnosis of Performance Regressions in Database Systems
  • Detecting Data-Type-Related Logic Bugs in Relational DBMSs via Compatible Database Construction cites Simple Testing Can Expose Most Critical Transaction Bugs: Understanding and Detecting Write-Specific Serializability Violations in Database Systems
  • Detecting Data-Type-Related Logic Bugs in Relational DBMSs via Compatible Database Construction cites Testing Database Engines via Pivoted Query Synthesis
  • Detecting Isolation Anomalies in Relational DBMSs cites Elle: Inferring Isolation Anomalies from Experimental Observations
  • Detecting Isolation Anomalies in Relational DBMSs cites Finding bugs in database systems via query partitioning
  • Detecting Isolation Anomalies in Relational DBMSs cites Detecting optimization bugs in database engines via non-optimizing reference engine construction
  • Detecting Isolation Anomalies in Relational DBMSs cites Simple Testing Can Expose Most Critical Transaction Bugs: Understanding and Detecting Write-Specific Serializability Violations in Database Systems
  • Simple Testing Can Expose Most Critical Transaction Bugs: Understanding and Detecting Write-Specific Serializability Violations in Database Systems cites Detecting Isolation Anomalies in Relational DBMSs
  • Detecting Isolation Anomalies in Relational DBMSs cites Testing Database Engines via Pivoted Query Synthesis
  • Finding bugs in database systems via query partitioning cites Detecting optimization bugs in database engines via non-optimizing reference engine construction
  • Finding bugs in database systems via query partitioning cites APOLLO: Automatic Detection and Diagnosis of Performance Regressions in Database Systems
  • Finding bugs in database systems via query partitioning cites Testing Database Engines via Pivoted Query Synthesis
  • A Set-Theoretic Approach to Detecting Logic Bugs in DBMS Inner Join Optimizations cites Finding bugs in database systems via query partitioning
  • A Set-Theoretic Approach to Detecting Logic Bugs in DBMS Inner Join Optimizations cites Detecting optimization bugs in database engines via non-optimizing reference engine construction
  • A Set-Theoretic Approach to Detecting Logic Bugs in DBMS Inner Join Optimizations cites APOLLO: Automatic Detection and Diagnosis of Performance Regressions in Database Systems
  • A Set-Theoretic Approach to Detecting Logic Bugs in DBMS Inner Join Optimizations cites Testing Database Engines via Pivoted Query Synthesis
  • Detecting optimization bugs in database engines via non-optimizing reference engine construction cites APOLLO: Automatic Detection and Diagnosis of Performance Regressions in Database Systems
  • Detecting optimization bugs in database engines via non-optimizing reference engine construction cites Testing Database Engines via Pivoted Query Synthesis
  • Automated Discovery of Test Oracles for Database Management Systems Using LLMs cites Finding bugs in database systems via query partitioning
  • Automated Discovery of Test Oracles for Database Management Systems Using LLMs cites Detecting optimization bugs in database engines via non-optimizing reference engine construction
  • Automated Discovery of Test Oracles for Database Management Systems Using LLMs cites APOLLO: Automatic Detection and Diagnosis of Performance Regressions in Database Systems
  • Automated Discovery of Test Oracles for Database Management Systems Using LLMs cites Testing Database Engines via Pivoted Query Synthesis
  • Simple Testing Can Expose Most Critical Transaction Bugs: Understanding and Detecting Write-Specific Serializability Violations in Database Systems cites Elle: Inferring Isolation Anomalies from Experimental Observations
  • Simple Testing Can Expose Most Critical Transaction Bugs: Understanding and Detecting Write-Specific Serializability Violations in Database Systems cites Finding bugs in database systems via query partitioning
  • Simple Testing Can Expose Most Critical Transaction Bugs: Understanding and Detecting Write-Specific Serializability Violations in Database Systems cites Detecting optimization bugs in database engines via non-optimizing reference engine construction
  • Simple Testing Can Expose Most Critical Transaction Bugs: Understanding and Detecting Write-Specific Serializability Violations in Database Systems cites APOLLO: Automatic Detection and Diagnosis of Performance Regressions in Database Systems
  • Simple Testing Can Expose Most Critical Transaction Bugs: Understanding and Detecting Write-Specific Serializability Violations in Database Systems cites Testing Database Engines via Pivoted Query Synthesis
Builds onCited byLeft to right by year; the more cited, the higher.

Cited by top-tier papers6

  1. Simple Testing Can Expose Most Critical Transaction Bugs: Understanding and Detecting Write-Specific Serializability Violations in Database SystemsZiyu Cui, Wensheng Dou, Yu Gao, Rui Yang et al.VLDB 2025 · 4 citations
  2. Detecting Isolation Anomalies in Relational DBMSsRui Yang, Ziyu Cui, Wensheng Dou, Yu Gao et al.ISSTA 2025 · 3 citations
  3. Automated Discovery of Test Oracles for Database Management Systems Using LLMsQiuyang Mang, Runyuan He, Suyang Zhong, Xiaoxuan Liu et al.SIGMOD 2026 · 1 citation
  4. Detecting Data-Type-Related Logic Bugs in Relational DBMSs via Compatible Database ConstructionJiansen Song, Wensheng Dou, Yingying Zheng, Yu Gao et al.VLDB 2026
  5. A Set-Theoretic Approach to Detecting Logic Bugs in DBMS Inner Join OptimizationsCe Lyu, Changzheng Wei, Yanhao Wang, Jie Liang et al.ICDE 2026

Builds on33

  1. Testing Database Engines via Pivoted Query SynthesisManuel Rigger, Zhendong SuOSDI 2020 · 150 citations
  2. Finding bugs in database systems via query partitioningManuel Rigger, Zhendong SuOOPSLA 2020 · 116 citations
  3. Detecting optimization bugs in database engines via non-optimizing reference engine constructionManuel Rigger, Zhendong SuFSE 2020 · 104 citations
  4. Elle: Inferring Isolation Anomalies from Experimental ObservationsPeter Alvaro, Kyle KingsburyVLDB 2021 · 88 citations
  5. APOLLO: Automatic Detection and Diagnosis of Performance Regressions in Database SystemsJinho Jung, Hong Hu, Joy Arulraj, Taesoo Kim et al.VLDB 2020 · 77 citations

Related papers

  1. Testing Database Systems via Differential Query ExecutionJiansen Song, Wensheng Dou, Ziyu Cui, Qianwang Dai et al.ICSE 2023 · 26 citations
  2. Detecting Metadata-Related Logic Bugs in Database Systems via Raw Database ConstructionJiansen Song, Wensheng Dou, Yu Gao, Ziyu Cui et al.VLDB 2024 · 13 citations
  3. Constant Optimization Driven Database System TestingChi Zhang, Manuel RiggerSIGMOD 2025 · 8 citations
  4. Detecting Logic Bugs in Database Engines via Equivalent Expression TransformationZu-Ming Jiang, Zhendong SuOSDI 2024 · 22 citations
  5. EPSC: Testing Database Management Systems via Equivalent Prepared Statement ConstructionChi Zhang, Jie Liang, Zhiyong Wu, Dalong Shi et al.SIGMOD 2026 · 2 citations
Dusk over the sea between two cliffs drawn in fine vertical lines