Adarsh Namala
Adarsh is a data professions with 8+ years of experience. He is currently a Sr Data Scientist at A+E Networks
Sessions
12-05
19:30
30min
Scaling Outside the Warehouse Using DuckDB and Python
Adarsh Namala
DuckDB is revolutionizing data processing by enabling in-memory OLAP SQL operations with a lightweight, dependency-free architecture. This talk explores how DuckDB can be leveraged to handle large-scale, massively parallel data processing, ranging from hundreds of gigabytes to terabytes, outside traditional SQL and Spark warehouse systems. We will go over the integration with the Python ecosystem and demonstrate its scaling potential using the cloud compute.
Data/ Data Science Track
Data/ Data Science Track