George Hotz | Programming | tinygrad refactoring (and maybe some JAX) | tinygrad.org | tinybox
YouTube Viewers YouTube Viewers
194K subscribers
40,247 views
0

 Published On Dec 3, 2023

Date of the stream 2 Dec 2023.
from $1250 buy https://comma.ai/shop/comma-3x & best ADAS system in the world https://openpilot.comma.ai
Live-stream chat added as Subtitles/CC - English (Twitch Chat) - at the bottom - Show Transcript

Sources:
- https://github.com/tinygrad/tinygrad
- https://tinygrad.org/ (The tinybox)
Hardware:
- Apple M3 MAX
- Logitech MX Anywhere
- HHKB Professional 2
Follow for notifications:
-   / georgehotz  
Support George:
-   / georgehotz  
Pre-order tinybox:
- https://buy.stripe.com/5kAaGL6lk9uX9n... (https://tinygrad.org/)

Chapters:
00:00:00 intro
00:01:35 responding to youtube comments
00:02:05 C. S. Lewis quote
00:03:05 physiology and sociology, wokeism, trans people
00:04:35 harvard, ivy league educational institutions
00:07:15 tesla cybertruck
00:08:40 communism, anarchy
00:10:15 based elon
00:10:40 Amouranth, Sky Bri
00:12:20 love, hate
00:13:35 refactor stream
00:14:05 beautiful.py
00:14:50 memory objects in opencl, buffers and images
00:16:00 dtype, cast_image, device hack
00:17:35 LRUAllocator
00:22:18 Clang operations, MallocAllocator
00:23:20 missing 1 required positional argument
00:27:40 this is the actual George's work
00:28:45 LazyBuffer problem
00:32:00 numpy
00:32:45 Alex
00:33:20 auto generated program, float
00:35:00 tinycorp second intern
00:36:40 TORCH=1 test_ops.py
00:38:15 adding cast
00:38:30 unreadable code
00:41:00 UnaryOps_CAST
00:42:10 DiskAllocator dtype
00:46:20 git push
00:47:00 letting everyone chat
00:47:30 be nice to people
00:47:50 what is AGI
00:48:20 why care about views
00:49:00 beautiful.py, tinygrad is a tensor library
00:51:00 ask good questions, anyone understand this?
00:54:45 memoryview cast
01:00:00 copyin function
01:03:50 buffer, JITRunner
01:05:00 The Device, LazyOp
01:10:40 renderer
01:12:25 current line count of tinygrad, hiball energy
01:18:00 questions? does this make sense?
01:20:40 FROM_BUFFER=1 examples coder.py
01:22:10 10 runtimes in tinygrad
01:26:50 computation, memory
01:31:40 where you call the kernels, ClangProgram, to_program, CompiledASTRunner
01:33:20 abstractions.py outdated use beautiful.py instead
01:33:50 MULACC trigger, matmul
01:37:35 git push improve docs
01:38:30 t8 tinybox spec
01:39:00 jax_pmatmul.py
01:39:35 WD_BLACK 1TB SN850X
01:40:30 bidirectional copy peak bandwidth GB/s
01:42:00 infiniband connection between two tinyboxes
01:44:10 up to 18 monitors into your tinybox
01:44:40 shipping to EU
01:45:20 preorder tinybox today
01:46:20 stupid question from non-sub
01:46:35 mlperf, how fast you can train the models
01:47:50 15k GPU hours
01:49:20 the cloud, low priority CPU
01:50:10 tinybox for common user or business, secret price
01:51:10 tinybox wattage
01:55:20 Alex brining tea
01:57:10 hashcat example
02:06:25 4090 vs tinybox hashcat
02:09:40 Alex bringing lunch
02:11:45 hip for hashcat bug
02:12:20 best coin to mine with gpus
02:13:35 amd 8000
02:14:30 advent of code day one speedrun
02:19:20 AoC part 2, asking Quentin for help
02:26:00 write a regex to replace
02:30:20 good programming style
02:31:00 struggle in python console
02:37:15 reducing the lines of code
02:50:55 compiling
02:57:50 memory usage bug
03:06:00 external_test_alloc_all.py
03:11:40 analyze the issue in the comments
03:13:55 why tinygrad has to be so tiny
03:14:30 changing culture, gpt-fast
03:17:05 27 tinyboxes = person
03:17:25 teenyboxes = gaming computer
03:18:20 pro esports player
03:19:10 1Torch, unspecified launch failure
03:24:30 ???, OpenLLaMA, Nvidia
03:27:50 if George was CEO of OpenAI
03:30:25 opensource weights
03:30:50 company that lasts 1000 years
03:31:30 top 10 biggest companies
03:32:15 Apple M3 fastest single thread cpu
03:33:30 Apple GPU
03:35:50 high end M3 Max, don't buy low end M3
03:37:25 5 M3 Max or 1 tinybox
03:38:20 based Apple getting rid of touchbar
03:38:45 spec of tinybox
03:39:10 wokism, truth crime interrogation footage

Official George Hotz communication channels:
- https://geohot.com
-   / realgeorgehotz  
-   / georgehotz  
- https://tinygrad.org
- https://geohot.github.io/blog
- https://github.com/geohot

We archive George Hotz and comma.ai videos for fun.
Follow for notifications:
-   / geohotarchive  

Thank you for reading and using the SHOW MORE button.
We hope you enjoy watching George's videos as much as we do.
See you at the next video.

show more

Share/Embed