comma ai | Human-Machine Cooperation in openpilot | Driver Monitoring | Weixing Zhang COMMA_CON talk
YouTube Viewers YouTube Viewers
194K subscribers
4,247 views
0

 Published On Dec 8, 2023

Date of the video 29 Jul 2023.
from $1250 - comma 3X https://comma.ai/shop/comma-3x
best ADAS system in the world - https://openpilot.comma.ai

Weixing Zhang social media:
-   / weixing-zhang  
View original video on Youtube:
-    • COMMA_CON | July 29, 2023 | San Diego  
comma.ai youtube playlist:
-    • comma.ai youtube archive (youtube.com...  

Chapters:
00:00:00 intro
00:00:20 openpilot and driver
00:00:45 what we are going to talk about
00:00:52 learning about the driver
00:01:13 comma two driver facing camera
00:01:30 comma two model input
00:01:55 comma three driver facing model input
00:02:05 full frame DM model input
00:02:35 100% face detection, remove wheeltouch
00:03:05 remove the RHD toggle
00:04:05 end-to-end driver monitoring
00:04:20 what is attention
00:05:10 defining attention in the context of openpilot
00:05:40 paying attention = ready to take control
00:05:53 ground-truthing
00:06:15 assumptions probability of taking control, not taking control
00:07:40 refining ground truthing, manual labeling
00:08:35 end-to-end driver monitoring integration
00:09:28 learning about the driver behavior metrics
00:09:38 aggressiveness
00:11:00 engaged vs not
00:12:10 pay more attention to the road using openpilot
00:12:30 drivers don't really get complacent over time
00:13:20 learning about the driving model
00:13:50 disengagements
00:14:10 disengagement metrics
00:14:37 where do openpilot users tend to take over?
00:14:47 understanding disengagements
00:16:15 longitudinal personality
00:17:30 communication in UI
00:17:41 knowing uncertainty
00:19:10 communicating uncertainty
00:20:10 Q & A
00:20:35 long term investment in driving monitoring
00:21:35 eye gaze and tracking
00:22:20 symbolic approach with declarative logic with sub symbolic model in the future
00:23:40 chil drivers vs aggressive drivers, good drivers
00:24:55 giving feedback about uncertainty
00:27:04 attentive driver, using driver data as negative signal for driving
00:28:21 using driver monitoring for driver communicating intent
00:29:12 driver talking over reaction time after openpilot driving for a long time

We are not affiliated with comma.ai.
Official communication channels:
- https://comma.ai
-   / comma_ai  
-    / commaai  
- https://blog.comma.ai
- https://github.com/commaai
- https://discord.comma.ai

How to get a job:
- https://comma.ai/jobs
How to collaborate:
- https://comma.ai/services
Buy things to support comma.ai:
- https://comma.ai/shop

Are you interested in openpilot?
Knowledge base:
- https://wiki.comma.ai
Check out the code:
- https://openpilot.comma.ai
Is my car supported?
- https://comma.ai/vehicles
Frequently Asked Questions:
- https://comma.ai/faq
How to setup openpilot:
- https://comma.ai/setup
Comma Secure Shell:
- https://ssh.comma.ai
API Documentation:
- https://api.comma.ai
CAN analysis tool:
- https://cabana.comma.ai
Review and annotate your driving data:
- https://my.comma.ai
Leaderboard:
- https://my.comma.ai/leaderboard
Comma Connect App:
- https://apps.apple.com/us/app/comma-c...
- https://play.google.com/store/apps/de...
Research:
- https://github.com/commaai/comma2k19
- https://github.com/commaai/comma10k
- https://github.com/commaai/research

Official George Hotz communication channels:
- https://geohot.com
-   / georgehotz  
-   / georgehotz  
- https://github.com/geohot
-    / geohot  
-   / realgeorgehotz  

We archive George Hotz and comma.ai videos for fun.
Follow for notifications:
-   / geohotarchive  
Unofficial communities and resources:
-   / comma_ai  
-   / geohot  
- https://commasupport.zendesk.com

Thank you for reading and using the SHOW MORE button.
We hope you enjoy watching George's videos as much as we do.
See you at the next video.

show more

Share/Embed