George Hotz | Programming | rewriting linearizer (tinygrad) | Day In The Life Of A Software Engineer
YouTube Viewers YouTube Viewers
194K subscribers
27,857 views
0

 Published On Jan 29, 2024

Date of the stream 27 Jan 2024.
from $1250 buy https://comma.ai/shop/comma-3x & best ADAS system in the world https://openpilot.comma.ai
Live-stream chat added as Subtitles/CC - English (Twitch Chat) - at the bottom - Show Transcript

Sources:
- https://github.com/tinygrad/tinygrad
Follow for notifications:
-   / georgehotz  
Support George:
-   / georgehotz  
Pre-order tinybox:
- https://buy.stripe.com/5kAaGL6lk9uX9n... (https://tinygrad.org/)

Chapters:
00:00:00 intro
00:00:30 ASMR typing
00:08:37 Lana_lux raid!
00:10:10 context missing, real work accessibility
00:12:50 linearizer
00:14:40 tensorcore implementation
00:15:10 tvm schedule
00:20:30 upcastmid
00:25:40 optuops
00:28:20 tvm parallel vectorize
00:30:35 future design
00:33:30 reorder
00:37:20 option space searchability design
00:41:40 git commit
00:44:00 test_float32_unary
00:46:00 fix_metal_tests
00:50:20 UOptOps(Enum)
00:54:00 group_for_reduce
00:59:40 yellow and purple
01:06:45 vin[0].arg out of range
01:07:45 tensor cores nightmare
01:10:40 metal_wmma
01:12:10 tvm tensor cores
01:15:40 problem
01:16:35 tvm implementation
01:17:30 thread_local_aliases
01:19:20 can fix this
01:25:00 device required
01:26:20 TensorCore.__init__ missing
01:27:00 specialize dataclass, perplexity
01:28:20 dataclass inheritance
01:30:00 dataclass child class with default properties
01:36:50 git commit
01:40:50 tvm flexible interface
01:43:20 cool test
01:45:00 that is how real work on tinygrad looks like

Official George Hotz communication channels:
- https://geohot.com
-   / realgeorgehotz  
-   / georgehotz  
- https://tinygrad.org
- https://geohot.github.io/blog
- https://github.com/geohot

We archive George Hotz and comma.ai videos for fun.
Follow for notifications:
-   / geohotarchive  

Thank you for reading and using the SHOW MORE button.
We hope you enjoy watching George's videos as much as we do.
See you at the next video.

show more

Share/Embed