› A Beam run may be evaluated as a language-model answer or as part of a tool-using coding setup.
› For a municipal service note I would measure exact retrieval first, then separately judge whether a code agent edits the correct file.
› Choosing the first job Extract a temporary bus-stop ID from an invented notice and update the matching route fixture with no other changes.
› Models in the November 17 snapshot Model and track Placement Reported score Beam 1.0 (AA intelligence) 38 18 index points Release record.