Accessibility Statement Skip Navigation
  • Back to Global Sites
  • +971 (0) 4 368 1644
  • GDPR
  • Journalists
  • Send a Release
PR Newswire: news distribution, targeting and monitoring
  • News
  • Products
  • Contact
  • Hamburger menu
  • PR Newswire: news distribution, targeting and monitoring
  • Send a Release
    • Telephone

    • +971 (0) 4 368 1644 from 8 AM - 5:30 PM GMT

    • Contact
    • Contact

      +971 (0) 4 368 1644
      from 8 AM - 5:30 PM GMT

  • Request More Information
  • Journalists
  • GDPR
  • Request More Information
  • Journalists
  • GDPR
  • Request More Information
  • Journalists
  • GDPR
  • Request More Information
  • Journalists
  • GDPR

TencentDB TDStore Online DDL: Technological Evolution and Innovations Background & Challenges
  • Middle East - Arabic
  • APAC - English


News provided by

Tencent Cloud

22 Apr, 2025, 12:10 GMT

Share this article

Share toX

Share this article

Share toX

SHENZHEN, China, April 22, 2025 /PRNewswire/ -- Traditional single-node databases (e.g., MySQL) use OnlineDDL and third-party tools (e.g., pt-osc) to enable lock-free schema changes, but face performance bottlenecks and struggle in distributed environments. Tencent Cloud's TDStore, a financial-grade distributed database, addresses these challenges with groundbreaking innovations:

Core Technological Innovations

1.  Multi-Version Schema Mechanism

a. Introduces schema versioning to enable metadata-only modifications in seconds (e.g., adding trailing columns, extending fields). Historical data automatically fills default values, ensuring backward compatibility.

2.  Concurrency Control & State Transition

a.  Thomas Write Rule: Reduces transaction conflicts by ignoring stale writes, improving DDL-DML parallelism.
b.  Google F1 Phased State Design: Divides DDL into three stages (delete-only → write-only → final)  to ensure global consistency and smooth transitions.

3. Write Fence Mechanism

a. Validates request versions at the storage layer, allowing writes only between adjacent states to eliminate data inconsistency risks.

4.  Fast OnlineDDL Acceleration

a.  Distributed Parallel Backfilling: Splits data into SST files for multi-node parallel ingestion via bulk load, bypassing timestamp comparisons to achieve 13x performance gains (10 minutes vs. 2.3 hours).

Practices & Optimizations

1. Performance Comparison

a. Traditional Mode (single-node): 16 threads took 2.3 hours.
b.  Fast Mode (multi-node): 48 threads completed in 10 minutes, showcasing significant efficiency improvements.

2. Partitioning Best Practices

a. Large Tables: Use HASH/KEY partitioning to distribute data evenly, enabling parallel DDL execution.
b. Cold/Hot Separation: Combine RANGE+HASH secondary partitioning for rapid cleanup and elastic scaling.
c. High Concurrency: Align partition keys with frequent query fields; set partition count as multiples of node numbers.

3.  Key Parameter Configuration

a. max_parallel_ddl_degree: Increase parallel threads (≤ total node CPUs).
b. tdsql_ddl_fillback_mode:  Enable IngestBehind mode to unlock multi-node parallel acceleration.

Business Value & Future Roadmap

  • Validated Use Cases: Achieved zero downtime in PB-scale financial systems, with 10x faster execution than third-party tools.
  • Upcoming Enhancements:
    • Optimize partitioned table Copy Table and index backfilling for ordinary tables.
    • Support ultra-large-scale (tens of TB) workloads and hybrid HTAP architectures.

Conclusion

TDStore overcomes traditional OnlineDDL limitations through distributed architecture innovations and engineering practices, delivering high-performance, secure, and seamless schema change capabilities for financial-grade scenarios. It empowers enterprises to tackle massive data challenges effectively.

#DistributedDatabase #TencentCloud #TencentDB #TDSQL #Tencent Cloud BigData

Modal title

Also from this source

Tencent Cloud Recognized as a Challenger in the Gartner® Magic Quadrant™ for Communications Platform as a Service for Third Consecutive Year

Tencent Cloud Recognized as a Challenger in the Gartner® Magic Quadrant™ for Communications Platform as a Service for Third Consecutive Year

Gartner® recently released its 2025 Gartner® Magic Quadrant™ for Communications Platform as a Service (CPaaS) report. Tencent Cloud was the only...

Tencent Cloud Teams Up with C.live to Deliver Seamless, Scalable, and High-Quality Streaming Experiences

Tencent Cloud Teams Up with C.live to Deliver Seamless, Scalable, and High-Quality Streaming Experiences

Tencent Cloud, the cloud business of global leading technology company Tencent, today announced a strategic partnership with C.live, a premier live...

المزيد من الإصدارات من هذا المصدر

Explore

Cloud Computing/Internet of Things

Cloud Computing/Internet of Things

Internet Technology

Internet Technology

Telecommunications Industry

Telecommunications Industry

Computer & Electronics

Computer & Electronics

المزيد من البيانات الصحفية في مواضيع ذات صلة

Contact PR Newswire

  • +971 (0) 4 368 1644
    from 8 AM - 5:30 PM GMT

Global Sites

  • APAC
  • APAC - Traditional Chinese
  • Asia
  • Brazil
  • Canada
  • Czech
  • Denmark
  • Finland
  • France
  • Germany

 

  • India
  • Indonesia
  • Israel
  • Italy
  • Mexico
  • Middle East
  • Middle East - Arabic
  • Netherlands
  • Norway
  • Poland

 

  • Portugal
  • Russia
  • Slovakia
  • Spain
  • Sweden
  • United Kingdom
  • United States

Do not sell or share my personal information:

  • Submit via [email protected] 
  • Call Privacy toll-free: 877-297-8921
Global Sites
  • Asia
  • Brazil
  • Canada
  • Czech
  • Denmark
  • Finland
  • France
  • Germany
  • India
  • Israel
  • Italy
  • Mexico
  • Middle East
  • Netherlands
  • Norway
  • Poland
  • Portugal
  • Russia
  • Slovakia
  • Spain
  • Sweden
  • United Kingdom
  • United States
+971 (0) 4 368 1644
from 8 AM - 5:30 PM GMT
  • Terms of Use
  • Privacy Policy
  • Information Security Policy
  • Site Map
  • Cookie Settings
Copyright © 2025 Cision US Inc.