A well-known Tesla white hat hacker known simply as “green” on Twitter (@greentheonly), revealed – to some extent – what Tesla’s selfie camera is monitoring. What is the Tesla Selfie Camera? It’s a camera right behind the rearview mirror of a Tesla vehicle. Here is a look at the interior of my Tesla Model 3 up close and from a distance (you will probably have to click on the second image and zoom in to see the camera in it).
(Note: Thanks to EV Annex for the fun Parasol Elon Musk + Starman!)
Elon Musk has previously stated that the selfie camera is not yet in use and is in cars when they become self-driving cars / robotaxis.
While not yet in use, “green” has identified what this indoor single camera is set up for watching and taking notes. Looked:
In case you were wondering what the Model 3 selfie camera is currently trying to detect:
– green (@greentheonly) October 4, 2020
On the first tag, “BLINDED”, the car is logically configured to notice if the selfie camera is blinded. If someone hailed a Tesla robotaxi and the selfie camera went blind, I guess that would tell the car to stop and warn Tesla Headquarters, and wait for the problem to be resolved before continuing. the service.
I have no idea how the car reacts to noticing that it is dark inside the car, unless it is just an indicator to show that the camera is not completely blinded but that it may not be able to capture things well due to poor lighting.
Naturally, at a stage where the Tesla is not yet capable of 100% operation without human supervision, it might be useful to see if the driver’s eyes are closed or are looking away from the road. The system could then give a warning – perhaps a loud warning – that the driver needs to open their eyes or look up, otherwise the car will stop and park.
In fact, there is also a tag to indicate if the driver is using their phone, which could be very useful if Tesla wanted to be proactive in discouraging texting while driving, which has proven to be as dangerous as drunk driving.
To show how nuanced it really gets, you have two tags regarding sunglasses – one indicating someone is wearing sunglasses but probably looking at the road and another indicating someone is wearing sunglasses but that his eyes are probably not on the road.
I don’t know what “HEAD_TRUNC” means, but I’m assuming it means the driver’s head is “truncated” – not in camera view.
One last note from me: I don’t know how it helps to know if the driver’s head is turned to the left or to the right. I’m sure there are reasons to know it’s useful, but nothing comes to my mind except maybe as evidence in the event of an accident.
Related stories: Tesla Model 3 Standard Range Plus Long Term Review