Hao Zhang - Chatbot Arena (UCSD / LMSys)

Hanna Hajishirzi (AI2) - OLMo: Findings of Training an Open LM

MambaByte: Token-Free Language Modeling

Luca Soldaini - Curating Pretrain Data (AI2 / Dolma)

Do we need Attention? A Mamba Primer

Swabha Swayamdipta: Towards (Closed-Source) LLM Accountability via Logit Signatures (USC)

Ying Sheng - Bridging human and LLM systems

Tatsu Hashimoto - Lessons from the Alpaca Project (Stanford)

Louis Castricato - RLAIF, User Autonomy, and Controllability (Eleuther / Synthlabs)

Eugene Cheah - From idea to LLM (RWKV / Recursal)

Daphne Ippolito (CMU / Google) - No One-Size Fits All Pre-Training Data

Ludwig Schmidt - Open source AI for Multimodality

Leshem Chosen - Wiki-models through Natural Feedback

Irina Rish (Mila) - Continual Learning of Foundation Models

Niklas Muennighoff - From GPU poor to poor GPU rich

Graham Neubig (CMU) - Can we make building with open-source AI as simple as prompting ChatGPT?

Large Language Models in Five Formulas

RNNs for Diffusion? Generating Images with DiffuSSM

Insanely Fast Speech Recognition: Sequence Distilation for Whisper

AIF + DPO: Distilling Zephyr and friends

Inverting Language Models: Raw Text from Vectors and LLM APIs

MiniTorch - Backprop (1.3)

MiniTorch - Neural Networks (2.0)

MiniTorch - Fundamentals (0.1)

MiniTorch - Autodifferentiation (1.2)

MiniTorch - Tensors (2.1)

MiniTorch - Module 0 Code Walkthrough

MiniTorch - Models and Modules (0.2)

MiniTorch - Mini-ML (1.0)

MiniTorch - Gradients (2.4)