Quobyte Introduces High-Performance File Query Engine for Large-Scale Storage Clusters and AI Workloads
Quobyte's File Query Engine Redefines Large-Scale Storage Management with High-Performance Metadata Queries
SANTA CLARA, Calif., May 14, 2024 /PRNewswire/ -- Quobyte, the innovator in high-performance storage solutions, has unveiled its new distributed File Query Engine at ISC High Performance 2024, enhancing its storage platform for enterprises and researchers. This engine allows users to query file system metadata at exceptional speeds, making it ideal for environments with massive data sets.
The File Query Engine offers a range of capabilities, including the ability to query user-defined metadata for AI/ML training, enabling users to label files with data directly instead of managing small "metadata files." Additionally, administrators can quickly answer questions such as identifying space-consuming cold files or locating files owned by specific users. The File Query Engine replaces slow file system tree walks ("find"), offering a faster and more efficient alternative for large volumes.
Key to the File Query Engine's performance is its integration with Quobyte's distributed and replicated key-value store, which stores metadata. Unlike other products, Quobyte's File Query Engine does not require an additional database layer, resulting in faster queries and significant resource savings. Queries are executed in parallel across all metadata servers for fast scans across the entire cluster or select volumes. This engine never operates on outdated data.
"The File Query Engine is a game-changer for our customers," said Bjorn Kolbeck, CEO of Quobyte. "It streamlines the process of querying file system metadata, offering fast and efficient results even for large datasets, AI, and machine-learning workloads."
The File Query Engine is part of Quobyte release 3.22 and is automatically available without any configuration. Users can run file metadata queries using the command-line tool "qmgmt," which supports output in CSV or JSON formats. Additionally, queries can be initiated via the Quobyte API, providing flexibility and ease of use.
For more information about Quobyte's File Query Engine and its storage solutions, visit www.quobyte.com.
About Quobyte:
Quobyte provides a unified storage platform engineered for simplicity and high performance, suitable for enterprises and researchers pushing the frontiers of innovation. It ensures exceptional reliability and enterprise-level features, enabling rapid deployment and streamlined operations for organizations of various sizes, making HPC accessible for all. Quobyte empowers small teams to run large-scale infrastructures, advancing today's most groundbreaking research.
Follow Quobyte:
https://www.twitter.com/quobyte
https://www.linkedin.com/company/quobyte
Photo - https://mma.prnewswire.com/media/2412139/Quobyte_High_Performance_File_Query_Engine.jpg
Logo - https://mma.prnewswire.com/media/2276517/Quobyte_Logo.jpg
Dela den här artikeln