DALLE-2 has a secret language? No, it’s rather a secret vocabulary. Let’s see what happens and why the model behaves like this.

SPONSOR: Weights & Biases 👉 https://wandb.me/ai-coffee-break

📺 Diffusion models and GLIDE explained:    • Diffusion models explained. How does ...  
📺 Imagen diffusion model:    • Imagen, the DALL-E 2 competitor from ...  

Check out our daily #MachineLearning Quiz Questions:    / aicoffeebreak  
➡️ AI Coffee Break Merch! 🛍️ https://aicoffeebreak.creator-spring....

Paper 📜: Daras, Giannis and Alexandros G. Dimakis. “Discovering the Hidden Vocabulary of DALLE-2.” (2022). https://arxiv.org/abs/2206.00169 or https://giannisdaras.github.io/public...

🔗 Original post by the authors:   / 1531693093040230402  
Author’s thread addressing critique:   / 1532605363232444416  
🔗 Josha Bach’s take:   / 1531711345585860609  
🔗 Benjamin Hilton’s take:   / 1531780892972175361  
🔗 rapha gontijo lopes’ take:   / 1532579141542850560  
🔗 k1uge’s take:   / 1531736708903051265  

Thanks to our Patrons who support us in Tier 2, 3, 4: 🙏
Don Rosenthal, Dres. Trost GbR, banana.dev -- Kyle Morris, Julián Salazar, Edvard Grødem, Vignesh Valliappan, Kevin Tsai, Mutual Information, Mike Ton

Outline:
00:00 DALL-E 2 has a secret vocabulary
01:05 Weights&Biases (Sponsor)
02:34 How DALL-E 2 responds to gibberish
05:00 Why does this happen?
07:59 Security implications (adversarial attacks)

▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
🔥 Optionally, pay us a coffee to help with our Coffee Bean production! ☕
Patreon:   / aicoffeebreak  
Ko-fi: https://ko-fi.com/aicoffeebreak
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀

🔗 Links:
AICoffeeBreakQuiz:    / aicoffeebreak  
Twitter:   / aicoffeebreak  
Reddit:   / aicoffeebreak  
YouTube:    / aicoffeebreak  

#AICoffeeBreak #MsCoffeeBean #MachineLearning #AI #research​

Music 🎵 : Built to Last (Instrumental) - NEFFEX
Video editing: Nils Trost