SenseNova, the latest foundation model set developed by SenseTime, has brought further breakthroughss to SenseTime's Smart Auto business. Based on the foundation model for computer vision (CV), SenseTime has achieved mass production of the BEV (Bird‘s-Eye-View) general perception that can recognise 3,000 types of objects. Moreover, the technology company has built an integrated perception-decision multimodal system to enable better autonomous driving with stronger environmental, behavioural, and motivational comprehension capabilities.
SenseAuto takes the opportunity to showcase its latest development at the highly anticipated Shanghai International Automobile Industry Exhibition (Auto Shanghai) currently held in the thriving city. At a forum in the biennial exhibition, Professor Wang Xiaogang, Co-founder, Chief Scientist, and President of the Intelligent Automotive Group of SenseTime, presents the latest developments of SenseAuto in three areas: Intelligent cabin, Intelligent driving, and Collaborative cloud.
The emergence of the third living space is thanks to the more developed advanced driver assistance system (ADAS) of smart cars and the fact that a part of the driver’s effort to take control of the vehicle is supported and complemented by the system. Therefore, the driver's spared effort and time can translate into more possibilities or activities in the third living space, the space outside of or connecting home and work.
The added possibilities of the third living space are made possible by the SenseAuto Cabin system. In the system, on the one hand, a driver monitoring system (DMS) catches signs of potential hazards associated with the condition of the driver and, as such, helps to reduce the chance of an accident; on the other hand, an occupant monitoring system (OMS) with functions such as child care, pet and left objects detection, seatbelt detection, seat occupancy detection, and multi-mode interaction, enhances safety, comfort, and convenience.
"The integration of the intelligent cabin has become the core trend of the future development of intelligent vehicles. SenseAuto's positioning is to be the global Tier 1 AI software provider in the era of intelligent vehicles," says Professor Wang.
"Creating a three-in-one product suite of intelligent cabin, intelligent driving, and collaborative cloud requires core capabilities in perception, decision-making, planning and control, in addition to AI cloud. Based on our AGI capabilities and AIDC in Shanghai Lingang - one of the largest AIDCs in Asia, SenseAuto has created a diversified product suite. The AI cloud also act as a 'brain' for the smart cabin, offering many intelligent and customised services, making the intelligent cabin a third living space."
"The future driving experience of consumers will be further enhanced, and the deep integration of intelligent driving and intelligent cabin will significantly reduce hardware costs, improve development efficiency, and enhance system security and reliability."
SenseAuto has established partnerships with over 30 international and local Chinese carmakers so far, and its products have been applied in over 80 vehicle models. The company’s AI platform empowers smart driving with different levels of autonomy, intelligent cabin as well as different types of autonomous vehicles.
In September last year, the launch of the SenseAuto V2X Vehicle-Road Synergy Platform promised to enable safer and more efficient urban mobility. The platform naturally caught the attention of the commercial sector of urban transportation, as it provides a one-stop analysis and decision-making solution through the fusion processing and analysis of crucial vehicle and roadside information.
As a signature of the smart cabin, intelligent vehicle features, especially those related to health and well-being, seem to be well anticipated by future car buyers. According to the J.D. Power 2021 China New-Vehicle Intender Study (NVIS), 24 per cent of the respondents considered their experience with vehicle intelligence features to be the decisive factor in their purchase decisions. In a separate study released by the same organisation, 40 per cent considered a new car's health features significant.
SenseAuto views the smart cabin to be user-centered, offering a more personalised user experience for drivers and passengers alike. The SenseAuto Cabin-O Health Partner, for example, leverages AI technology to monitor and measure critical signs of the driver’s health, including but not limited to heart rate and respiratory rate, alerting the driver of any abnormal state, and promoting the safety of the car’s occupants.
In addition, the smart cabin will feature an in-cabin digital human assistant that enables a human-like virtual companion. An array of amenities with convenient voice command and contactless human-computer interaction capability is set to please those in the third living space, regardless of their travelling time.
With the anticipated emergence of the smart auto industry, SenseTime has also been at the forefront in terms of data security and protection development. In August 2022, it co-led an automotive data masking consultation paper to strengthen data protection for smart autos. The consultation paper sets the standard system framework for the automotive industry in China to implement an effective data desensitisation system. It strengthens the protection of personal data and elevates data security levels in the industry.
It must be added that SenseTime is not new to high-level cybersecurity management. The company has been awarded the ISO/SAE 21434:2021 certification for cybersecurity management in road vehicles by SGS, one of the world’s leading testing, inspection and certification companies.
As SenseTime continues to develop its AI-empowered infrastructure, the SenseAuto platform will become an essential portal that connects smart vehicles to the company’s diverse business landscape that covers AIGC, smart health, smart transportation, smart entertainment, mobile Internet and more.
ncG1vNJzZmivp6x7tK%2FMqWWcp51kvbOx0p6lrZ2UZMGmr8doq6iomZjAcL%2FMmqmtZZGqwbC%2FjJypnpmkmnqvsdZmo6KumaO0br%2FPmpqeZ5Gnwaqvy55mbGpha350fo6epZ2klajAbrzOrKqimpmhtrW1xKxkrJ2eqLKiwdOoZJ6mpp7AqrvNrGStoJmnsW64yK%2Bgp59dqL2ir8RmqqaZoql6osHTqKo%3D