H2O KV Cache - An Easy Explanation
Heavy Hitter Oracle, the basic idea behind it is that, it retains the tokens which have better attention and evicts the tokens which don't, it also keeps the recent tokens in cache and that is how it

Search for a command to run...
Heavy Hitter Oracle, the basic idea behind it is that, it retains the tokens which have better attention and evicts the tokens which don't, it also keeps the recent tokens in cache and that is how it

My journey into tech began when I came to Earth..just kidding. I was born here. Don't get angsty. I used to go to these Computer Expos that were organised every month, with my Dad. I used to go gaga o

One of the methods of abstraction is to integrate another service. But can you trust someone else's service? Third-party APIs are notorious for failing at the worst possible time. Over time, I ended u

A race condition can hit you anytime, you think it won't because your system isn't that big, or doesn't process a lot of requests, but it will happen, and when it happens, you will feel a bit silly ab

The world is going through a tumultuous phase, but that doesn't stop the progress of humanity. Things go on, people move, prices fluctuate, we eat fruit and live a healthy life. April is hot, so hot,

Well, I celebrated my birthday. :P I worked on a functionality end to end using AI. It was a simple feature and AI wrote everything correctly in a single pass. I used Codex. After that, I had to ask i

Let me think. So I worked on a new functionality and raised a PR in just 2 days for the whole end-to-end correct flow. I did not focus much on performance because I wanted to first get it right and th

Well, I did not build a new feature. Most of my tasks were client-facing, focused on solving client issues. And the client had many issues. Things were escalated, and escalated again. Now the trust that I had built with higher management is kind of g...

Well, I am going to be honest. I do not remember much right now, so I will try to recall things as I write. I did a lot of pair programming to fix production issues, and I changed a webhook implementation that receives a lot of data periodically from...
