The Evolution of AI Programming

Fri, 20 Mar 2026 02:00:15 +0800

🤖 The Evolution of AI Programming: From Prompts and Context Engineering to Harness

As models with comparable capabilities become increasingly common, the gap in user experience between different products is actually widening. Some products write code that can be deployed directly, while others produce code that is hard to maintain—why? Because the models are the same; the difference lies in how they are used, and how to use them stably. In the AI industry, this is known as Harness Engineering.

🧠 Harness Engineering: Deconstructing the Agent into Three Layers

We divide programming Agents into three levels:

Scaffolding Responsible for all preparatory work before the AI executes a task, including the tools provisioned by the system.
Harness (Runtime Orchestration, The Core) The central dispatching hub of the entire agent. Responsible for managing the AI’s core reasoning loop, coordinating tool calls, context management, runtime security control, and persistent storage of session data.
Context Engineering Responsible for managing the resource allocation of tokens—the smallest unit of computation for large language models processing text. Determines which information should be retained and which should be discarded during the AI’s operation.

A stable and capable AI coding agent = One or more LLMs called + A robust Harness system.

⏳ Harness is Crucial, Why is it Only Getting Popular Now?

① Phase 1: Prompt Engineering

Core Focus: How to write a good instruction.

Role Setting: Defining clear identities and responsibility boundaries for the AI.
Providing Examples: Using Few-shot prompting to make the AI generate content according to a specific format and style.
Chain-of-Thought: Asking the AI in the instruction to break down the problem step-by-step and deduce logically, reducing logical leaps and errors.

② Phase 2: Context Engineering

A single prompt is no longer enough—we need to dynamically construct the entire context environment for the model. Ensuring that every time the model makes a decision, it can accurately see all the information it needs: task files, conversation history, tool rules, knowledge base entries…

Core Concept: Show the model what it needs to see, and block what it shouldn’t.

③ Phase 3: Harness Engineering

Whenever you find the Agent making a mistake, you spend time engineering a solution so it won’t make the same mistake again.

The model’s capabilities are sufficient, but it just won’t listen. What do we do? The answer is—Harness Engineering.

Real-world Cases:

Experiment	Condition	Result
LangChain	Same model, optimized Harness only	Terminal Bench 2.0: 52.8 → 66.5
Nate B Jones	Same model, same prompt, changed runtime environment only	Coding benchmark win rate: 42% → 78%
OpenAI	Started from an empty git repo, 5 months, entirely AI Agent driven	Produced ~1 million lines of code, 1500 PRs, zero human intervention

The Agent isn’t hard; the Harness is.

💥 Why Do AI Tasks Fail So Frequently?

1. Trying to do it all at once Trying to finish all features in a single window results in the context window rapidly depleting, causing a steep drop in quality towards the latter half.

2. Declaring victory too early In the later stages of complex project development, once the AI agent completes the core functions and has visible output, it directly determines the task is complete and actively terminates—even if a large number of features are unimplemented and core requirements are unmet, it will still stop.

3. Marking features as complete too early As soon as the AI agent finishes writing a feature, it marks it as complete. It will not actively perform end-to-end full functional tests, nor will it verify whether this feature is actually usable in a real environment. It looks like it runs, but in reality, it’s full of hidden bugs.

4. Mechanically copying code patterns AI will mechanically follow existing code patterns (architectural style, coding conventions), even if the pattern is wrong, and continuously amplify it throughout the project. An unconstrained AI agent will accumulate a massive amount of technical debt in a project at extreme speeds.

🛡️ The Four Guardrails of Harness

🔹 1. Context Engineering

The longer and more redundant the AGENTS.MD file is, the lower the Agent’s task success rate, while the inference cost becomes higher. The AGENTS.MD file should be strictly kept under 60 lines.

Context is a scarce resource; too much guidance will crowd out the truly important task code.

🔹 2. Architectural Constraints (The Core)

Implement a strict layered architecture—not by telling the agent “please follow the architecture” via a prompt, but by mechanically enforcing it using deterministic Linters and structured tests.

Embed repair guidelines directly into the Linter error messages, telling the agent how it should be fixed. Constraints are more effective than instructions.

🔹 3. Feedback Loop

In Harness, code review becomes an Agent-to-Agent process. Forming a standardized closed loop: Plan & Discover → Build → Verify → Fix, cycling continuously to consistently purify code quality.

🔹 4. Entropy Management

Over time, AI-generated code accumulates numerous issues: outdated documentation, architectural drift, styling deviations, accumulation of dead code… Letting an Agent maintain documentation for the Agent continuously fights against entropy increase and prevents project rot.

🧭 Conclusion

The evolution of AI programming is essentially a paradigm shift from “writing good prompts” to “building good systems”.

Prompt Engineering solves “how to say it”.
Context Engineering solves “what information to give”.
Harness Engineering solves “how to manage/control it”.

These three paths are not mutually exclusive but rather additive and progressive—each layer builds on the foundation of the previous one. A truly capable AI programming product that stably outputs high-quality code must have invested serious effort across all three of these levels.

AI Programming on Yanmu