https://pramodith.github.io/Pramodith Dissects is a blog covering AI, Tech, Startups and other musings. 2026-03-24T23:36:47+00:00 https://pramodith.github.io/ Jekyll © 2026 /assets/img/favicons/favicon.ico /assets/img/favicons/favicon-96x96.png 2026-03-25T00:00:00+00:00 2026-03-25T00:00:00+00:00 https://pramodith.github.io/posts/gated-delta-net/ Pramodith B

A deep dive into the Gated Delta Net Attention mechanism, a linear attention technique powering Qwen3.5.

2025-12-01T00:00:00+00:00 2025-12-01T12:03:24+00:00 https://pramodith.github.io/posts/speculative-decoding/ Pramodith B

A tutorial on implementing speculative decoding, an inference optimization technique for LLMs, using PyTorch and Hugging Face Transformers.

2025-11-24T00:00:00+00:00 2025-11-24T06:32:54+00:00 https://pramodith.github.io/posts/online-softmax/ Pramodith B

Understanding the mathematical principles behind online softmax, an optimization technique used in Flash Attention to efficiently compute softmax in chunks.

2025-06-04T11:00:00+01:00 2025-11-24T06:32:54+00:00 https://pramodith.github.io/posts/grpo-trainer/ Pramodith B

A step-by-step tutorial to code up your own GRPO Trainer.

2025-05-12T11:00:00+01:00 2025-11-24T06:32:54+00:00 https://pramodith.github.io/posts/medical-definition-understanding/ Pramodith B

Figure: Do LLMs recognize Medical Definitions? There’s been a never-ending debate about whether LLMs understand the data they process, so much so that people have started to debate what understanding something actually means. While some argue that LLMs are mere statistical machines that capture patterns of when and where different words are used, others claim that LLMs do indeed have a sense ...