Gaurav Kumar's Avatar

Gaurav Kumar

@cereal-learner

Scaling Big Data Products for 14 yrs. Senior Staff Engr at Disney+ Hotstar. Previously MakeMyTrip, IBM. Passionate about Data, Rust, Linux, AI linkedin.com/in/gauravkumar37

161
Followers 957
Following 3
Posts 26.10.2024
Joined
Posts Following

Latest posts by Gaurav Kumar @cereal-learner

Preview
New Amazon S3 Tables: Storage optimized for analytics workloads | Amazon Web Services Amazon S3 Tables optimize tabular data storage (like transactions and sensor readings) in Apache Iceberg, enabling high-performance, low-cost queries using Athena, EMR, and Spark.

What are the practical use cases that this is going to unlock? aws.amazon.com/blogs/aws/ne...
Latency from S3 objects to S3 tables is in minutes, so obviously it cannot be a substitute for the metadata layers of ACID formats.

04.12.2024 05:27 👍 6 🔁 0 💬 0 📌 0

I just ran 80,000 simulations and my Rust code was still compiling in all of them!

06.11.2024 07:33 👍 5 🔁 0 💬 0 📌 0

So kinda like branches and tags of versioning in iceberg?

28.10.2024 20:50 👍 1 🔁 0 💬 1 📌 0