Published On Mar 17, 2024
Date of the stream 16 Mar 2024.
from $1250 buy https://comma.ai/shop/comma-3x & best ADAS system in the world https://openpilot.comma.ai
Live-stream chat added as Subtitles/CC - English (Twitch Chat) - at the bottom - Show Transcript
Source:
- https://tenstorrent.com/cards/ (Grayskull™ e150 - Add to cart) - $799
- https://tenstorrent.com/setup/
- https://github.com/orgs/tenstorrent/r...
- https://github.com/geohot/tt-twitch
Follow for notifications:
- / georgehotz
Support George:
- / georgehotz
Pre-order tinybox:
- https://buy.stripe.com/5kAaGL6lk9uX9n... (https://tinygrad.org/)
Chapters:
00:00:00 intro
00:00:40 tenstorrent e150
00:02:40 AT&T, AMD, Qualcomm
00:04:07 Jim Keller, Tenstorrent, Open source
00:07:13 nvidia orin devkit, TRUFFLE–1
00:10:10 tinybox specs, nvidia 5090 rumor
00:11:05 pushing AMD, embracing open source
00:12:20 unboxing e150
00:13:55 interactions with AMD, lying
00:15:13 tenstorrent mega blower fan
00:23:10 fan loudness check
00:23:45 fanless, thermal protection
00:28:42 tenstorrent.com/setup, NDA
00:29:10 Alex
00:30:22 hardware installation
00:34:10 banjo.canonical.com
00:35:10 firmware installing broken
00:39:55 work life balance, Alex
00:41:15 tt-smi, temperature
00:43:07 tenstorrent bounties
00:47:15 smoke test
00:49:45 buda
00:53:40 cloud is a scam, selling cards
00:55:20 import error
00:57:50 this is why tinygrad is going win
00:58:55 nix
00:59:25 docker, no dependencies
01:02:20 nvidia value, cuda
01:02:55 reproducible builds, getting rid of complexity, it just works
01:05:30 import error
01:06:40 the complexity
01:06:54 redis great software
01:08:22 missing jemalloc
01:11:00 key error BACKEND_ARCH_NAME
01:12:15 mysql, sqlite
01:14:40 docker encouragees
01:15:15 exploring tt-metal
01:17:45 PEP8, bad programmers, details
01:18:25 downloading multiple gigabytes
01:20:35 translating github comments
01:25:00 tt-buda
01:26:04 stop writing code like this
01:32:30 if you thought AMD is bad try tenstorrent card
01:32:55 tt-smi reset options, reset file, reset json
01:35:45 this is the opposite of how you do complexity
01:36:40 ordering food, folding phone
01:42:05 tt-metal
01:46:00 start saying what it is
01:48:30 HSA fail, making everything generic
01:51:20 tt_lib, tt_eager
01:52:00 py-buda, luwen
02:04:00 installing egg
02:10:00 tensor bob
02:13:20 devin
02:15:30 reading docs
02:17:40 pyrsistent
02:19:40 Jim stop, nobody wants 50% PyTorch
02:19:55 be proud of what the chip is and expose the chip for what it is
02:21:19 ttlib docs, chip info
02:23:10 no real company is going to buy this card, dojo, inference price per dollar
02:23:50 tinygrad in for 10 years
02:24:05 PyTorch trigger
02:31:10 what this is?
02:35:45 grayskull e150 number of cores
02:37:20 bad documentation
02:42:44 tenstorrent staff in the stream
03:00:25 not trusting C
03:05:02 Alex closing the door
03:11:50 hate coding in C
03:17:00 bad code trigger, memcpy
03:27:17 SFPU
03:34:15 doing math, 13+7=21
03:43:30 kernel APIs
03:47:50 this better than GPUs
04:02:25 opencl api bad concept
04:06:30 food
04:12:20 life magazine 1970
04:16:10 Alex, Groq $20k card, Groq open source
04:20:05 brain backprop, small work units
04:20:39 nvidia full fabric memory
04:22:26 tenstorrent website bug
04:24:07 keeping up with state of the art ML
04:25:10 AMD price advantage, mi300x
04:28:20 graph compiler should be generic
04:28:35 port tinygrad to tenstorrent
04:33:40 the bitter lesson
04:38:50 break
04:47:12 worry about correctness
04:48:25 thumbs up ai
04:48:50 tinygrad code for metal
05:09:00 host_api
05:11:00 Karen ai, devin, VCs, deep state
05:15:17 unitree humanoid, money printer
05:19:04 1971, gold
05:25:50 clang 14 install, VC investment scam
05:42:50 dispatcher kernel, 1971, zebu ep1
06:03:00 fake queuing, scheduling is the key, big scale
06:11:30 Groq demo, tt hardware, wormhole
06:29:25 software, endorsing tenstorrent, comma body
06:49:50 X9000 G2 Groq demo challenge
Official George Hotz communication channels:
- https://geohot.com
- / realgeorgehotz
- / georgehotz
- https://tinygrad.org
- https://geohot.github.io/blog
- https://github.com/geohot
We archive George Hotz and comma.ai videos for fun.
Follow for notifications:
- / geohotarchive
Thank you for reading and using the SHOW MORE button.
We hope you enjoy watching George's videos as much as we do.
See you at the next video.