skip to content
Posts
-
A tale of technological innovation, corporate collobation, and mass adoption.
-
Understanding Adaptive Layer Normalization. First introduced in the DiT paper
-
What are video codes, their evolution, and how to work with them
-
Just a brief explanation of how attention mechanism works. As well as the quadratic scaling of attention.
-
FPGAs: the ultimate flex by Jon Y from Asianometry
-
C code style by Malcolm Inglis
-
layer normalization of GPT by Andrej Karpathy
-
Exploring GPT-3's diverse training datasets for language model pretraining development.
-
How I understand the Decoder Transformer in Generative Text Models
-
A brief history of large language models, from bigrams to transformers