How Did I Write My First FlashAttention Kernel in CUDA ?
From demystifying the online softmax trick to hitting a 41.6x speedup on an NVIDIA RTX 4050 GPU — a beginner’s hands-on journey into hardware-aware deep learning.
Towards AI11 min read
attention-mechanism
3 stories
Deepseek-v3 : Deepseek MOE Architecture — Part 2
This is the full series of Deepseek-V3 technical report, where i explain all the technical details in simpler words with code…Continue reading on Towards AI »
Towards AI1 min read
Context Engineering: Why Feeding AI More Makes It Dumber
Bigger context windows were supposed to fix everything — just put it all in the prompt and let the model figure it out. In reality, past a certain point, more context makes AI agents worse. This is the story of context engineering: the discipline of deciding what an AI should — and shouldn't — see.
Scrollypedia
Showing 3 of 3 stories
You're all caught up.
AiByts Weekly Brief
Get the top AI news and tools straight to your inbox every week.
Weekly · AI news
Join 15,000+ AI enthusiasts