Self Attention
An intuition-first walk through self attention — queries, keys and values by analogy, then the implementation, multi-head attention, and transformers.
–––
Learnings so far.
Demystifying AI & Tech —
and sharing what I learn.
Passionate about AI and software development. This site is my way of giving back — sharing the learnings from my journey, while I keep building and experimenting.
Latest
All postsPositional Embeddings
Token embeddings alone throw away word order. How position gets encoded into a sentence, and why the sinusoidal scheme is built the way it is.
–––
Token Embeddings
How tokens turn into meaningful vectors: the core idea behind embeddings, how the training data is prepared, and a working implementation.
–––
Neural Networks
Building a neural network from the ground up — what the layers actually do, how training adjusts them, and a worked example end to end.
–––
Tokenization
Why models break text into subwords, how Byte Pair Encoding builds a vocabulary from scratch, and what naive word splitting gets wrong.
–––
LLM in a nutshell
A plain-language overview of how large language models actually work — the mental model worth having before going anywhere near the internals.
–––