CONNECT WITH US

Eye tracking makes for a high-quality driving experience; Mindtronic AI creates new in-vehicle business opportunities

News highlights

Mike Huang, CTO of Mindtronic AI

As technology advances apace, the modern demand for high-quality A/V experience has also continued to rise. From mobile phones, computers, and televisions, the demand has even extended to vehicle cabins. Major auto makers, looking to generate revenue, have also been quite keen to introduce new technologies to raise the added value of products. The smart cabin market is gradually taking shape alongside the development of the supply and demand sides. Mindtronic AI's eye-tracking AI system for vehicles, which can instantly track precise movements of the driver's eyes, is finding use in a variety of applications, and has been seen favorably by the industry since its release. More recently, Mindtronic has cooperated with Taiwan panel factories to enter the smart car market.

The auto industry has recently ushered in a new industrial revolution, one in which autonomous driving, electric vehicles, and smartification are the three key trends. According to analysis by Mike Huang, CTO of Mindtronic AI, the development of self-driving (autonomous) cars has not been as fast as expected, due to the need for highly integrated peripheral systems and innovative business models. With the simple structure of electric vehicle chassis, however, the technical threshold is relatively low compared with fuel vehicles, resulting in a large number of investors and major competitive pressures to existing car manufacturers. In such a scenario, introducing forward-looking technology to provide a high-quality ride, and at the same time creating a smart cabin with a range of value, has become an essential strategy for auto makers.

Huang also pointed out that the panel plays an important role in the smart cabin system. Most high-end vehicles on the current market come with customized touch panels. These panels incorporate the appearance and shape of next-gen cabin design and extend from the driver's seat to the front passenger seat. They also provide various functions in response to user needs, from driving assistance to high-resolution audio-visual applications. The smart cabin system requires a new type of human-machine interface (HMI) that includes not just touch technology, but also eye tracking as one of its main features.

Eye tracking, a technology that has been under development for many years, has found wide use in on-board vehicle systems. Its main purpose is to determine the mental state of the driver and issue alerts when the driver is tired or not paying attention. Mindtronic AI has further integrated with AI by making AI the "copilot". In situations not favorable to driving, such as when the driver is not mentally capable of driving, the ADAS of the in-vehicle system will temporarily "take the wheel." In addition to assisted driving, Mindtronic AI's systems also combine eye-tracking technology with intention inference algorithms. Driver can make use of the eye-sight manipulated control panel and the head-up display (HUD) screen function on the windshield, and the system also has the function to actively infer the user's intention and learn their preference or target of interest (TOI). Combined with the recommendation engine to actively provide information, entertainment, and driving service functions, this function can also become a commercial mechanism that can generate operating income for car dealers or platform operators.

Huang says that the current business model for auto makers is basically new car sales with follow-up maintenance. But with electric vehicles becoming a key policy in governments of various countries, the depreciation rate for electric vehicles off the lot is much lower than that for gas-driven vehicles, and the maintenance rate is thus also greatly reduced, so car manufacturers will need to find another source of revenue. Smart cabins may just be one source for new business opportunities. Huang further pointed out that there are two types of the software business service mechanism of the smart car cabin: in-cabin and out-cabin. The in-cabin service mechanism focuses on driving safety functions provided by auto makers, while out-cabin services are similar to smartphones. Consumers can download software products from app makers and use them on the smart cabin platform. From a functional point of view, the out-cabin service mechanism offers more functions and more business opportunities. Nevertheless, this mechanism is built on a complete ecosystem, like a smart phone, so it requires all those involved to work together for promotion.

Eye tracking will be an important control technology for both in-cabin and out-cabin systems. Huang mentioned that current control technologies for the HMI include touch, voice, and eye movement, each performing its respective function in the smart cabin. When the driver is parked or other passengers who there are those who are not in charge of driving, the operating system function mainly uses touch mode, while voice control is mainly used for inputting commands to the navigation system. Eye tracking technology also has its own use here: it is used for selecting functions and reading information during driving. However, Huang also pointed out that for eye tracking control to be practical in the smart cabin system, the two key objectives, i.e., accuracy and immediacy, must be met to create a high-quality experience for users. The technology developed by Mindtronic AI is not affected by ambient lights inside the cabin. With its fast and precise tracking of eye movement, the technology has won wide acceptance in the market, not only winning the US CES Innovation Award for 4 consecutive years, but also being used in cooperation with panel manufacturers and large auto makers.

While unique and practical, Mindtronic AI's eye-tracking AI system for vehicles is favored by the industry due to the innovation-friendly environment created by the government in recent years, argues Huang. He pointed out that the National Science and Technology Council's value creation program and the Taiwan Tech Arena (TTA) have been providing massive supports for startups, especially when taking a startup team to the United States to participate in CES, an excellent opportunity to gain exposure. Huang pointed out that startup teams are certainly aware of the importance of big overseas exhibitions, but that most teams are unable to participate in exhibitions due to limited resources. Also, small booth area limits the final exposure. So, the TTA brought together a large number of Taiwanese start-up teams and set up the TTA Pavilion to magnify the exposure for exhibitors. This expanded exposure has benefited Mindtronic AI in the past. That is why Huang suggests that startups can make good use of the support offered by government policy to expand product exposure while enhancing their own technological capabilities.

Mindtronic AI product development

Mindtronic AI product development
Photo: Company