The override is the design

Every system branded as self-driving carries a hand it cannot see. The hand is the safety case. The hand is also the failure mode.

This week's National Transportation Safety Board (NTSB) preliminary report on a fatal June crash in Katy, Texas names Full Self-Driving (FSD) more honestly than its marketing does. A driver pressed the accelerator to 100 percent on a two-lane road with a 30 mph posted limit, traveling above 70 mph before the Model 3 left the road and killed a 76-year-old woman inside her home. The arrest affidavit records him telling hospital providers he remembered "putting the car in self driving mode" and that he "passed out." His phone's recent searches included "FSD too timid" and "FSD not aggressive enough for city driving," the human end of the hand-off.

The pattern repeats wherever a system promises autonomy and depends on a supervisor to remain safe. The supervising driver is the safety case: FSD requires a human behind the wheel ready to intervene, and the override ran through the accelerator the driver used to manually disengage the system. When the human end of the hand-off is a driver who passed out and wanted the car less cautious, the design worked exactly as drawn.

Tesla AI head Ashok Elluswamy confirmed the override. The National Highway Traffic Safety Administration (NHTSA) is investigating in parallel. The preliminary report is not a final cause finding. It is a clean instance of the hand-off problem, and the next driver-assist fatal crash will look the same.