Laurent Giraldon and Nicolas Ribeyre have listened carefully to understand how this technology allows us to know precisely what we are looking at and how we can use our gaze as a 3rd arm either in a virtual reality helmet, or in front of a screen.
Did you say “eye tracking”?
Sight is the primary sense by which we perceive our surrounding world. Eye tracking (or oculometry in French) makes it possible to measure where a person is looking. This technology thus makes it possible to understand and characterize behavior through visual perception. It is on the Pico Interactive stand that Antoine Luu presents the expertise of Tobii, this Swedish group specialized in gaze detection. Originally, this technology born about fifteen years ago allowed with a machine of about twenty kgs to detect the zone in which your glance is carried on a screen. With a race for miniaturization, this technology today comes in the form of a small 100-gram bar that connects to a USB port. Technology now available directly in virtual reality headsets from major brands such as HP, Pico, HTC Vive or Lynx, the future French headset. Similarly, the group, which employs more than 1,000 people, equips PCs like DELL, MSi, or Asus for professional use. We can now evolve in these virtual environments as in life thanks to this technology. Almost a third hand thanks to your eyes The idea of this solution is to do without a mouse or to complete the mouse when using a screen or a headset. Indeed, you can literally take the camera in the first person and move without having to manipulate a controller, a mouse or a keyboard. In the gaming activity, it gives us superpowers: you can have “revolver” eyes like in the song and knock out your opponents simply by pointing your gaze at them. In Handicap
Useful technology for people with disabilities
Another application: people with disabilities are now in a double jeopardy situation when they have to communicate because everything is done while browsing the internet and if you can’t type on the keys of a keyboard or manipulate a mouse, it becomes complicated. Today more than 100,000 people around the world use Tobii technology to browse, write and communicate on the Internet simply with the help of their eyes. Looking becomes an order, an instruction.
Applications in e-sports
The dream of any e-coach to properly debrief the players would be to see exactly what the players are seeing at the moment: this is now done, by installing the “Tobii Ghost” application, the coaches can put themselves exactly instead of players. A small digital cloud is superimposed on the screens which allows the coaches to follow this artefact which symbolizes the vision of the players. The coach can therefore analyze the ocular vision course of the games. Antoine Luu launches an app and in a few seconds after taking a look at the asteroids, the Tobii bar is operational. In addition, Antoine shows us Tobii Ghost which makes it possible to represent the face of the player in 3D, same thing but in addition the head of the avatar reacts exactly in mimicry of the movement of the head and the gaze of the player.
Uses in the medical field or to navigate on an orientation map
This technology is also used in radiology: for example, if a surgeon is operating and needs both hands used in the operation, he can zoom in on an x-ray or medical imaging of just a look. Same principle if you look at the interactive map of a city, you can zoom thanks to the gaze by keeping it on a district. To move, you just have to look at the street you want to take and the map will follow, all this is done in a natural way, even you can easily scroll through carousels of images by pointing your gaze at the navigation arrows.
Applications for safety in autonomous vehicles
Thanks to its work on the “Driver Monitoring System”, Tobii is also working for our safety when we are on board autonomous vehicles. Because beyond looking at the direction of our gaze, Tobii also observes the size of our pupil. Is it expanded or contracted when the machine offers to hand over the controls to the man on board. Its size will determine our level of attention in relation to the road, it is not a question of going back behind the wheel if we are in a state of confusion, fatigue or cognitive stress.
Learn more: Tobii website: Eye tracking technology for research – Tobii Pro
We wish to give thanks to the author of this short article for this awesome material
Tobii: when the “eye tracking” experts make your life easier
You can view our social media profiles here and other pages related to them here.https://yaroos.com/related-pages/