Siri AI

Apple's first run in the dataset is correct, and padded. Siri AI, the rebuilt Siri that Apple released in beta on September 14, 2026, was tested on iPhone under iOS 27.0.1. It says drive and gives the right reason: walking "won't get your car to the carwash." But it opens on a conditional, "If your goal is to wash your dirty car", and closes with a disclaimer that it is an AI and may make mistakes. That scores Pass-adjacent.

The disclaimer is new here. No other answer in the dataset carries one inside the response itself. Siri AI launched in English only, so there are no runs in the other languages yet. Apple has said French, Japanese, Korean, Portuguese and Spanish will follow next month. There is no reasoning control and no visible trace.

Results

Transcripts