Keyvhinng Espinoza

Inside vLLM: Anatomy of a High-Throughput LLM Inference System - Aleksa Gordić From paged attention, continuous batching, prefix caching, specdec, etc. to multi-GPU, multi-node dynamic serving at scale.

If you want to learn vLLM under the hood, this is the post
www.aleksagordic.com/blog/vllm

1000x: The Power of an Interface for Performance by Joran Dirk Greef YouTube video by TigerBeetle

Excellent presentation from @tigerbeetle.com with brilliant insights:
'Those who would trade safety for performance deserve neither safety nor performance.'
www.youtube.com/watch?v=yKgf...

Thanks for sharing 🙏

Was about to ask if there’s an API for this, but just realized you pulled off some clever hacking to make it work. Definitely inspired to try something similar!

Screenshot of the first page of the paper "Amazon MemoryDB: A Fast and Durable Memory-First Cloud Database". https://dl.acm.org/doi/pdf/10.1145/3626246.3653380

The MemoryDB paper shows the power of separating responsibilities through clever composition. I think this DB frontend/execution plus a distributed transaction log pattern can be promising for creating serverless variants of many popular databases. E.g., Aurora adopts a similar decoupling approach.

Node.js Now Supports TypeScript By Default TypeScript is coming to Node 23. Let's break down what that means.

Node.js now supports TypeScript.

Here's everything you need to know:

www.totaltypescript.com/typescript-i...

Ilya Sutskever: "Sequence to sequence learning with neural networks: what a decade" YouTube video by seremot

Even if you are not deep into AI, this talk by Ilya offers incredible insights into the cutting edge of AI capabilities and what the future holds
www.youtube.com/watch?v=1yvB...

chris biscardi Rust, Wasm, Game Development, and cutting edge tech releases.

And chris biscardi's Youtube channel is another good resource
www.youtube.com/@chrisbiscardi

Advent of Code in Rust for the Rest of Us | The RustRover Blog I’m not a competitive programmer – far from it. I never received formal education in advanced algorithms and data structures. In fact, I can’t even implement Dijkstra’s algorithm without referring to

Sure, If you are particularly interested in Rust you can read this blog blog.jetbrains.com/rust/2024/11...

Using the Advent of Code to improve my Rust skills. This is the way ⭐⭐

👋, Perú 🇵🇪