Supports
SoC platforms
- SA8155P, SA8295P, SA8620P etc
- MT8666, MT8675, MT2715 etc
- Xavier, Orin
- TDA4, AM62x, TDA3 etc
- OAX8000, OAX4600
In-cabin Visual Software Solutions
Driver Monitoring System (DMS)
As one of the leading Driver Monitoring System (DMS) software providers, ArcSoft helped more than 10 automotive OEMs mass-releasing more than 52 models with DMS functions. ArcSoft DMS solutions have passed the EU DDAW and ADDW validation tests, working with Tier 1 partners to help OEMs meet the regulatory requirements for ADDW, DDAW, E-NCAP, and Chinese GB regulations.
ArcSoft not only provides OEMs with DMS software, but also expertise and test services for pre-certification tests and formal certification tests.
Sensors
All sensors from 1M to 8M are supported, including IR sensors for DMS functions, RGB/IR sensors for OMS functions.
Regulations
Support DDAW, ADDW, GBT, E-NCAP, A-NCAP, CN-NCAP, C-IASI.
Driver Health System (DHS)
In addition to detecting driver drowsiness and inattention, ArcSoft can also use the DMS camera to create advanced features to help drivers with personalized features and safer driving, such as the Driver Health System (DHS).
ArcSoft DHS is an innovative in-cabin intelligent sensing technology designed to collect, analyze, and interpret the driver's vital physiological signs based on remote photoplethysmography (rPPG). Vital signs are extracted from the corresponding light absorption changes in the characteristics of arterial blood flow in the driver's facial skin captured with the DMS camera.
OEMs can integrate ArcSoft DHS with advanced features such as detection and monitoring of driver physical state, checking if a driver is in a good health state to take on and maintain the driving task, and make personalized air-conditioning adjustment, music playing, and other in-cabin environment controls.
Supports
SoC platforms
Qualcomm (SA8155P, SA8295P, SA8775P etc)
MTK (MT8666, MT8675, MT2715 etc)
Nvidia (Xavier, Orin)
TI (TDA4, AM62x, TDA3 etc)
Camera locations
A-pillar, or steering column, or dashboard, or rearview mirror, or overhead area.
Sensors
All IR or RGB sensors from 1M to 8M are supported.
Features
- Heart Rate
- Heart Rate Variability
- Blood Oxygen Saturation
- Blood Pressure
- Breathing Rate
- Physical Energy
- Dynamic Health Detection
- Stress Detection
Face ID and Facial Recognition
With its extensive facial detection, recognition, and tracking technologies, ArcSoft can re-use the DMS camera or OMS camera to help automotive OEMs to create advanced personalized features such as
* enhanced car safety for anti-theft with driver Face ID as an added authorization method, where authorized driver info are stored locally in the vehicle, and facial recognition is performed after ignition to make sure the driver is authorized to drive;
* value-added services of personal settings, where Face ID is used to adjust personalized seat positions, steering wheel positions, infotainment preferences, and climate control settings.
In addition, ArcSoft can help OEMs to implement Face ID functions in other positions, such as on the outside B-pillars, for authorized entry into the vehicles.
We understand the importance of privacy and security, the above methods do not save face images, but encrypted face feature information in the car, to ensure that the biometric information is safe and secure, helping OEMs to conform to GDPR requirements.
Supports
SoC platforms
Qualcomm (SA8155P, SA8295P, SA8775P etc)
MTK (MT8666, MT8675, MT2715 etc)
Nvidia (Xavier, Orin)
TI (TDA4, AM62x, TDA3 etc).
Camera locations
A-pillar, or steering column, or dashboard, or rearview mirror, or overhead area.
Sensors
All IR or RGB sensors from 1M to 8M are supported.
Face detection
Anti-spoofing
pictures
masks
3D
Face recognition
driver ID
pay with face ID
smart cabin setting
Face properties
gender
age
Emotion detection
happy
sad
angry
nervous
Occupant Safety System (OSS)
ArcSoft advanced occupant safety visual sensing technologies (ArcSoft Occupant Safety System, OSS) can be important supplements to existing driver and passenger safety systems. For example, ArcSoft visual Occupant Safety System, can help automotive OEMs to achieve higher accuracy and efficiency for the functions:
SOR (Seat Occupancy Recognition), where ArcSoft visual algorithms are used to detect where the passengers are seated in the car, and their body posture state, size, gender, age information can also be analyzed if interested.
SBR (Seat Belt Reminder), where ArcSoft visual algorithms are used to detect whether the seatbelt is correctly worn by the driver or passengers.
CPD (Child Presence Detection), where ArcSoft visual algorithms are used to detect whether there is a child or children alone in the vehicles without adult supervision, enabling OEMs to take preventive methods to avoid injury to them.
ArcSoft OSS can be a very important supplement to normal in-cabin safety mechanisms, especially on longtail and corner cases, such as mis-classifying luggage as a passenger.
Supports
SoC platforms
Qualcomm (SA8155P, SA8295P, SA8775P etc)
MTK (MT8666, MT8675, MT2715 etc)
Nvidia (Xavier, Orin)
Camera locations
Rearview mirror, or overhead areas.
Sensors
Depending on specific functions, can support 5M or 8M
pixels sensors.
Integrated In-cabin Visual ECU on a Simplified SoC
ArcSoft in-cabin DMS and OMS features are already being mass-released on the Qualcomm IVI SoCs and other platforms. However, some vehicles may lack computing power but still need to meet the regulatory requirements. To help with this, ArcSoft offers low cost and single purpose integrated in-cabin visual ECU solutions based on OAX8000 or OAX4600, product code name "Tahoe".
ArcSoft Tahoe 1.0 is based on OAX8000 and supports single camera for DMS functions of DDAW, ADDW, and Face ID. Tahoe 2.0 is based on OAX4600 and supports up to 4 cameras with additional functions such as driver health system (DHS), HOD, SBR, hand gesture recognition (HGR), passenger seat position detection, and CPD. Tahoe 2.0 also meets ASIL-B functional safety requirements.
Tahoe is an all-in-one standalone integrated visual solution for DMS or OMS integrated with camera and process unit in one box. With DDR embedded inside the SoC, Tahoe has size almost as small as the thumbnail. In addition, it has the advantages of low power consumption, and flexible installation locations. Tahoe has been validated to meet the regulatory requirements of DDAW, ADDW, ENCAP DSM, and Chinese GB regulations, helping OEMs to implement the necessary functions with shorter development time and without complex system modifications.
With their unique simplified SoC configurations, the Tahoe 1.0 ECU offers OEMs with very economical single purpose DMS solution, while Tahoe 2.0 ECU offers a combination of DMS and OMS functions with cost-effective and high performance results.
TahoeTahoe 2.0PlatformOAX8000OAX4600Camera1up to 4Functional SafetyQMASIL-BResolution1 or 2 Million pixelsup to 5 Million pixelsEmbedded DDR128MB256MBCommunicationCAN/CAN FDCAN/CAN FD + Ethernet
Camera locations
For DMS: A-pillar, steering column, dashboard.
For OMS: rearview mirror, reading lights, roof module, or overhead area.
Sensors
For DMS: 1M ~ 5M lR sensors.
For OMS: 2M ~ 5M IR or RGB-IR sensors.
