AI-Assisted Engineering

AI-assisted engineering makes code faster to produce, but it does not remove responsibility for what reaches production. These field notes focus on the work that becomes more important when implementation gets cheaper: reviewing generated changes, evaluating probabilistic behavior, measuring outcomes rather than activity, and maintaining enough system knowledge to own the result.

The recurring question is not whether engineers should use AI. It is how an organization can gain speed without moving the bottleneck—and the risk—into review, integration, or production.

AI-Assisted Engineering Field Notes#

Evals Are the New Tests

In April 2025 OpenAI shipped a model update whose offline evals and A/B tests all looked good. It was sycophantic enough to roll back within days. A practical guide to building the measurement layer that would have caught it - with a working eval spec and grading rubric.

Code Was Never the Bottleneck

Your engineers are producing more code and your delivery cadence has barely moved. The waiting did not disappear - it moved downstream to review and absorption, and that is where the constraint always was. Includes a review-capacity audit.