Articles tagged with #Python




Breakthrough Tech Lab 2

Part 2 of a series of notebooks for teaching ML to early college students in an 8 week summer lab session. Covers Pandas.



Breakthrough Tech Lab 1

Part 1 of a series of notebooks for teaching ML to early college students in an 8 week summer lab session.



MiniTorch

A course taught at Cornell Tech where students build up the infrastructure behind vector autodifferentiation.



Visualizing Adaptive Sparse Attention Models

A visual description of the adaptive sparse attention technique.



Visualizing Banded Sparse Matrices

A visual description of banded sparse matrices, a really useful and underused form of sparsity.



Named Tensor

Polemic about how tensors should be named in ML programming languages



Named Tensor Layers

Part 2 of a Polemic about how tensors should be named in ML programming languages.



The Annotated Transformer

In this post I present an "annotated" version of the paper in the form of a line-by-line implementation. I have reordered and deleted some sections from the original paper and added comments throughout.