Collaboration with Hydra and DuckDB Labs can provide dramatic performance improvements for analytical queries in PostgreSQL
SEATTLE, Oct. 24, 2024 /PRNewswire/ — MotherDuck, in collaboration with Hydra and DuckDB Labs, today announced the beta release of pg_duckdb, a PostgreSQL extension that integrates DuckDB’s analytics engine directly into PostgreSQL. This extension enables organizations to run rapid analytical queries alongside traditional transactional workloads without changing their existing PostgreSQL infrastructure, delivering up to 1500x performance improvements for certain analytical queries and a more realistic 10x improvement for many other queries.
pg_duckdb allows companies to run rapid analytical queries alongside traditional transactional workloads
The pg_duckdb extension addresses a critical challenge faced by PostgreSQL users who need to perform analytics on their transactional data. By bringing DuckDB’s analytical capabilities directly into PostgreSQL, organizations can now:
Execute complex analytical queries up to 1500x faster than native PostgreSQLQuery data directly from Data Lakes and Lakehouses, including AWS S3Seamlessly work with columnar file formats like Parquet and IcebergScale analytics workloads using MotherDuck’s cloud resources
“PostgreSQL excels at transactional workloads but wasn’t specifically designed for analytics,” said Jordan Tigani, CEO and Co-Founder of MotherDuck. “With pg_duckdb, we’re bringing DuckDB’s analytical prowess directly to PostgreSQL users, allowing them to dramatically improve query performance without changing how their data is stored or updated.”
Real-World Performance
Initial testing demonstrates remarkable performance improvements. Using the TPC-DS benchmark suite, a query that took 81.8 seconds in native PostgreSQL completed in just 52 milliseconds using pg_duckdb – a 1500x improvement. When scaled to larger datasets on production hardware, the same query showed even more dramatic results, reducing execution time from over 2 hours to approximately 400 milliseconds.
What’s Next
While pg_duckdb is currently in beta, the development team is actively working on additional features and improvements. Users can track upcoming developments and provide feedback through the project’s GitHub repository.
To start using pg_duckdb, users can access the pre-built Docker image or follow the installation instructions in the repository’s README. For enhanced analytical capabilities, users can combine pg_duckdb with MotherDuck’s cloud resources by signing up at motherduck.com.
About MotherDuck
MotherDuck makes analytics fun, frictionless, and ducking awesome. In partnership with the team building open source database DuckDB, MotherDuck was founded by former leaders at some of the most innovative companies in data. It is on a mission to combine the elegance and speed of DuckDB with the collaboration and scalability of the cloud to provide a serverless, easy to use data warehouse for data small and large.
View original content to download multimedia:https://www.prnewswire.com/news-releases/motherduck-announces-beta-release-of-pgduckdb-brings-duckdbs-analytics-power-to-postgresql-users-302286647.html
SOURCE MotherDuck
