A recent accident in Texas has raised questions about the safety of Tesla's Full Self-Driving (Supervised) feature. The incident involved a Tesla Model 3 crashing into a home, resulting in the death of a 76-year-old woman. The driver claimed to have had the feature engaged at the time of the crash. The victim's family is now suing Tesla, alleging that the feature was defective and contributed to the accident. The lawsuit highlights the challenges of designing autonomous systems that rely on human oversight. If the system is too effective, drivers may become complacent and fail to intervene when necessary. This issue has been raised in previous incidents, including a 2018 California highway crash where the driver failed to take over steering before the vehicle crashed into a barrier. The National Highway Traffic Safety Administration (NHTSA) has launched an investigation into the Texas crash, which will assess whether Tesla's feature provides adequate warning or time for drivers to respond to unexpected behavior. The incident has also sparked a broader debate about the safety and design of autonomous systems. As the investigation continues, it will be important to examine the technical architecture and system design decisions behind Tesla's Autopilot feature. The company's approach to autonomous driving has been criticized for encouraging driver inattention, and the NHTSA has previously compelled Tesla to issue an Autopilot-related recall. The outcome of this investigation will have significant implications for the development and deployment of autonomous systems in the future.

Source: Wired gear