Breakthrough Tech Lab 2

Part 2 of a series of notebooks for teaching ML to early college students in an 8 week summer lab session. Covers Pandas.



Dex: Differential Probabilistic Inference

A differential approach to probabilistic modeling in Dex



Breakthrough Tech Lab 1

Part 1 of a series of notebooks for teaching ML to early college students in an 8 week summer lab session.



Dex: Quaternions

Literate WebGL blog on Quaternion rotation with a Dex implementation.



Dex: Typed Visualization

A typed Pandas-style visualization notebook.



MiniTorch

A course taught at Cornell Tech where students build up the infrastructure behind vector autodifferentiation.



Dex: NN Layers

Literate blog on typed NN layers rotation with a Dex implementation.



Dex: Tutorial

Literate blog serving as a tutorial for most of the series of Dex posts .



Visualizing Adaptive Sparse Attention Models

A visual description of the adaptive sparse attention technique.



Visualizing Banded Sparse Matrices

A visual description of banded sparse matrices, a really useful and underused form of sparsity.



Named Tensor

Polemic about how tensors should be named in ML programming languages



Named Tensor Layers

Part 2 of a Polemic about how tensors should be named in ML programming languages.



The Annotated Transformer

In this post I present an "annotated" version of the paper in the form of a line-by-line implementation. I have reordered and deleted some sections from the original paper and added comments throughout.