Kaivalya Apte - The Geek Narrator
@thegeeknarrator
The GeekNarrator Podcast - Software Engineering, Distributed systems and Databases.
B+Trees, WAL(write-ahead logging) and LSM trees are core to databases. Most of us look at the interface and talk about SQL vs NoSQL which is useful, but the core database components give the real personality to a database. I created videos on BTrees and WAL long time ago, but…
How to approach performance optimisation problems in a structured way? 1) Measure the current performance. 2) Find the baseline you want to support. 3) Find lowest hanging fruits, ex: simple configuration changes, bumping memory, upgrading versions, tweaking quety etc.…
Simple and highly relevant #cleancode principles: - Write code that's easy to delete. Instead of aiming to write permanent code, write code that is easy to "throw away". This mindset forces you to build small, decoupled modules with minimal dependencies. - Don't Repeat…
The problem with microservice architecture is that it is often taken to an extreme. The same is true for monolithic architecture. The problem with any architectural pattern is that it can be taken to an extreme; the real challenge lies in applying it judiciously. Consider any…
Seems like we have found a more resource intensive way to write same BS code (if not worse), to solve a problem that didn’t really exist while creating new problems. ps: No AI was harmed while writing this.
Does this scale really mean anything if the following information isn’t known? - Peak numbers of clicks - Number of unique links - Number of Hot links (top links) - Number of unique users (think impact of caching right from the browser) On top of that I think OLAP databases…
Your URL shortener is hitting 1B clicks/month 🚀 You need to offer real-time analytics for every link. writing each click to DB -> catastrophic How do you fix this ?
Top Data structures that power your databases: - B(+)Trees youtu.be/dTfR0S_rBGg - Write ahead log youtu.be/yV_Zp0Mi3xs - LSM trees youtu.be/CizxYuq-z6E - Bloom filters youtu.be/NvCuooCaSUs - Hash Index - Inverted Index - Skip Lists - HyperLogLog - Merkle Trees -…
Claude is more reliable (low errors and latency) Gemini seems a little less reliable. Anthropic is on AWS. Gemini is on GCP. Any correlation?
Next video is gonna be on #BloomFilters. Content is finalised. Filled with lots of interesting stuff. Will try to pack it in a ~30min video. It is one of the most interesting and powerful data structure that powers countless databases, caching systems and other large scale…
Learn a lot and fast. Retain a lot and permanent. Create patterns and apply. Repeat.
LSM Compaction Strategies: youtu.be/GWNdw9lRNMo Did you miss the previous video on LSM Trees? Go here: youtu.be/CizxYuq-z6E Like, share and subscribe.
🤓Released a new video on Database Internals: LSM Compaction Strategy We will look into the amplification challenges: write, read and space. And look into various compaction strategies to overcome the challenges. I hope you like it. Don't forget to like and repost. (link…