top of page
Search

You Bought the AI Tools. Now Build the Operating Model.

  • Writer: Mark Kendall
    Mark Kendall
  • 8 hours ago
  • 10 min read



You Bought the AI Tools. Now Build the Operating Model.



Across the enterprise, the first phase of AI adoption has already happened.


Developers have access to coding assistants. Teams are experimenting with agents. Pilots have been completed. Training sessions have been delivered. Repositories are being connected to AI tools, and engineering leaders are being asked to show results.


The excitement is real.


So is the pressure.


Executives now want to know whether AI is improving delivery, reducing cost, increasing quality, and helping the business move faster. CTOs and vice presidents of engineering are being asked to explain the return on investment. Security teams want stronger controls. Finance leaders want cost visibility. Engineering managers want consistency across teams.


The problem is no longer whether AI can generate code.


The problem is whether the organization knows how to operate AI engineering at scale.


That is the next challenge facing enterprise technology leaders.



Which Companies Should Be Thinking About This?



This conversation is most relevant to companies that have already moved beyond basic AI experimentation.


These organizations may have purchased Claude Code, GitHub Copilot, Cursor, Codex, or other AI engineering platforms. They may already have teams using AI inside development workflows. Some developers may be achieving impressive results, while others are still struggling to find a repeatable way of working.


The companies that should be paying the closest attention usually have several of the following characteristics:


  • Multiple software engineering teams

  • Dozens or hundreds of repositories

  • Several programming languages and technology stacks

  • Distributed or offshore development groups

  • Existing Agile and DevOps processes

  • Significant cloud infrastructure

  • Compliance, security, or regulatory obligations

  • Growing AI usage costs

  • Inconsistent adoption across engineering teams

  • Pressure from executives to demonstrate measurable value



These companies are not starting their AI journey.


They are entering the difficult second stage.


The first stage was about access.


Give developers AI tools.


The second stage is about operations.


Build a repeatable, governed, measurable system for using them.


That second stage is where many organizations are now becoming stuck.



Who Is the Primary User?



The primary users of an AI engineering operating model are the people responsible for turning business demand into reliable software delivery.


That includes:


  • Software developers

  • Architects

  • Product owners

  • Business analysts

  • Quality engineers

  • DevOps engineers

  • Security engineers

  • Platform teams

  • Engineering managers

  • Delivery leads

  • Scrum masters

  • AI enablement teams



Each of these roles interacts with AI differently.


Developers may use AI to understand repositories, generate code, write tests, or troubleshoot defects.


Architects may use it to analyze systems, evaluate tradeoffs, or design new capabilities.


Product owners may use it to improve requirements and clarify business intent.


Quality engineers may use it to generate scenarios, validate acceptance criteria, or improve coverage.


DevOps and platform teams may use agents to support deployment, infrastructure, observability, and incident response.


The operating model must connect all of these activities.


Without that connection, each team creates its own process, its own instructions, its own guardrails, and its own definition of success.


That may produce isolated productivity gains.


It does not create enterprise capability.



Who Is the Primary Buyer?



The primary buyer is usually the executive who is accountable for engineering performance and AI investment.


That may be the:


  • Chief Technology Officer

  • Chief Information Officer

  • Chief Digital Officer

  • Vice President of Engineering

  • Head of Software Development

  • Head of Enterprise Architecture

  • Head of Developer Experience

  • Head of Platform Engineering

  • AI Transformation Leader

  • Engineering Enablement Leader



The buyer may have approved the tools, sponsored the pilots, or been asked by the board to create an AI strategy.


Now that executive is being asked harder questions.


What has actually improved?


How much money are we spending?


Why are some teams moving faster while others are not?


How do we stop every repository from developing a different AI workflow?


How do we prevent AI-generated technical debt?


Who owns AI engineering?


How do we measure value beyond lines of code?


How do we move from a successful pilot to fifty or five hundred engineers?


These are not tool-selection questions.


They are operating-model questions.



The Tooling Trap



Many organizations began AI engineering by selecting a tool.


That was understandable.


The tools were highly visible, easy to demonstrate, and relatively easy to purchase. A developer could generate code in minutes, complete a task faster, or produce an impressive proof of concept.


But enterprise software delivery is not an individual coding exercise.


It depends on business priorities, architecture, security, testing, integration, deployment, documentation, support, and long-term maintainability.


Giving every developer an AI assistant does not automatically align those elements.


In many organizations, AI has been placed on top of an engineering system that already had problems:


  • Incomplete requirements

  • Poorly groomed backlogs

  • Inconsistent repositories

  • Missing documentation

  • Weak automated testing

  • Manual approval processes

  • Fragmented architecture

  • Unclear ownership

  • Limited observability

  • Unmeasured rework



AI does not remove those problems.


In some cases, it accelerates them.


A team can generate code faster while still producing the wrong feature. A developer can complete more tasks while creating additional review work downstream. An agent can make changes across a repository without understanding the broader business purpose.


Local speed is not the same as enterprise throughput.



The Missing Layer



Most companies have business strategy at the top and engineering execution at the bottom.


Between those two layers, there is often a gap.


Business leaders describe what they want. Product teams convert that into requirements. Architects make technical decisions. Developers write code. Quality teams validate the output. DevOps teams deploy it.


AI agents are now entering almost every part of that chain.


The missing layer is a structured way to connect business purpose to governed AI execution.


That layer should define:


  • Why the work is being performed

  • What business outcome is expected

  • Which enterprise context is authoritative

  • Which repositories and systems are involved

  • What agents are allowed to do

  • Where human review is required

  • Which security controls must be enforced

  • How quality will be validated

  • How cost will be measured

  • What evidence is required before production



This is the role of an AI engineering operating model.



From Prompts to Intent



Many AI development efforts begin with prompts.


Prompts are useful, but they are often temporary, individual, and incomplete.


One developer asks an agent to add an endpoint. Another asks it to modify a user interface. A third asks it to write tests. Each interaction may be reasonable, but the broader business intent can easily be lost.


A stronger model begins with intent.


Intent explains:


  • Why the capability matters

  • Who it serves

  • What outcome must be achieved

  • Which constraints cannot be violated

  • What success looks like

  • How the work fits into the larger enterprise



That intent can then be refined into executable specifications, plans, tasks, tests, controls, and deployment evidence.


The progression becomes:


Business Intent

→ Enterprise Context

→ Executable Intent

→ Planning

→ Controlled Agent Execution

→ Validation

→ Human Approval

→ Production

→ Measurement

→ Learning


This creates a repeatable system rather than a collection of unrelated AI conversations.



The CTO’s Real Problem



The CTO’s problem is not that AI tools are failing.


The problem is that the organization may not have a shared way of using them.


One team may have strong repository instructions, automated testing, and clear review gates.


Another may rely on ad hoc prompts and manual inspection.


One team may carefully control model usage.


Another may repeatedly send large amounts of context into expensive models.


One repository may be well documented.


Another may require the agent to rediscover the architecture every time it starts.


From the executive level, this creates uncertainty.


The organization may be spending more while producing inconsistent results.


The CTO is then placed in the uncomfortable position of defending an AI investment without reliable operational evidence.


The best way to reduce that pressure is not to buy another tool.


It is to create visibility, standards, ownership, and measurable outcomes.



Start with an Enterprise Readiness Assessment



Before attempting a large transformation, companies should evaluate their current state.


A practical AI engineering readiness assessment should examine at least ten areas.



1. Business Intent



Are teams clear about why features are being built?


Are desired outcomes captured, or are developers working primarily from technical tickets?



2. Backlog Readiness



Are requirements complete enough for humans and agents to act on?


Do acceptance criteria reflect real business rules?



3. Repository Readiness



Can a new developer or AI agent understand the system quickly?


Are architecture, standards, build instructions, and testing expectations documented?



4. Enterprise Context



Can approved information be retrieved from systems such as Jira, Confluence, Figma, source control, service catalogs, and architecture repositories?



5. AI Configuration



Are instructions, skills, agents, hooks, and context strategies standardized?


Or is every developer building a personal workflow?



6. Validation



Are generated changes tested automatically?


Are acceptance criteria, security checks, and production requirements verifiable?



7. Governance



Are permissions, approval points, audit trails, and prohibited actions clearly defined?



8. Security



Can agents access only the data, tools, and environments required for the task?



9. Cost Management



Can the organization measure model usage, repeated context, failed loops, and cost per accepted change?



10. Ownership



Is someone accountable for the AI engineering operating model?


Without clear ownership, improvement efforts become fragmented.



Measure the Right Things



Many companies begin by measuring AI adoption.


They count licenses, active users, prompts, tokens, or generated lines of code.


Those metrics may be useful, but they do not prove business value.


The organization should eventually be able to answer questions such as:


  • What is the cost per accepted feature?

  • Has cycle time improved?

  • Has escaped-defect volume changed?

  • Has review time increased or decreased?

  • How much AI-generated work is rejected?

  • How much rework is being created?

  • Which repositories are producing the strongest results?

  • Which teams are using the most context?

  • How often do agents enter failed or repeated loops?

  • Are production incidents increasing or decreasing?

  • Is customer value being delivered sooner?



The goal is not maximum AI usage.


The goal is better delivery.



Create Shared Services



Large organizations should not expect every team to independently build its own AI engineering platform.


Common capabilities should be developed as shared services.


That may include:


  • Approved MCP servers

  • Enterprise connectors

  • Repository instruction templates

  • Reusable skills and agents

  • Security policies

  • Prompt and intent patterns

  • Validation frameworks

  • Testing utilities

  • Model-routing standards

  • Cost controls

  • Observability dashboards

  • Audit logging

  • Reference implementations



Shared services reduce duplication and create consistency.


They also allow successful practices from one team to be reused across the enterprise.


The objective is not to remove team flexibility.


It is to prevent every team from repeatedly solving the same foundational problems.



Define Human Decision Points



AI engineering should not mean removing people from the process.


It should mean using people at the points where judgment matters most.


Human approval may still be required for:


  • Business-priority decisions

  • Architectural tradeoffs

  • Security exceptions

  • Production deployment

  • Regulatory interpretation

  • High-risk code changes

  • Customer-impacting behavior

  • Financial commitments

  • Data-access changes

  • Acceptance of residual risk



The operating model should make those points explicit.


Agents should know when to proceed, when to stop, when to request clarification, and when to escalate.


This is how organizations gain speed without losing control.



Build a Role-Based Learning Model



AI transformation cannot be treated as developer training alone.


Every role needs a different learning path.


Executives need to understand economics, governance, operating ownership, and risk.


Architects need to understand context design, agent orchestration, integration patterns, and technical controls.


Product leaders need to understand how to express intent and create agent-ready requirements.


Developers need to understand repository-aware workflows, planning, implementation, testing, and review.


Quality engineers need to understand AI-assisted validation, evidence, and risk-based testing.


DevOps teams need to understand agentic deployment, infrastructure intent, observability, rollback, and production controls.


Security teams need to understand tool permissions, data boundaries, agent identity, auditability, and executable policy.


The company does not become AI-capable because a group of developers attended a class.


It becomes AI-capable when the organization develops a shared way of working.



Use a Pilot to Prove the Model



The operating model should not be introduced through a year-long transformation plan.


It should be proven through a focused pilot.


A strong pilot includes:


  • A real business capability

  • A defined engineering team

  • One or more representative repositories

  • Clear success measures

  • Existing delivery constraints

  • Production-quality requirements

  • Cost tracking

  • Human approval points

  • Security and quality controls



The goal is not to create the most impressive demonstration.


The goal is to prove that the operating model works under real enterprise conditions.


The pilot should answer:


  • Can the team move from intent to production more reliably?

  • Can cost be measured?

  • Can quality be maintained or improved?

  • Can the process be repeated?

  • Can another team adopt the same patterns?

  • Can the organization explain why the results improved?



A successful pilot should produce reusable assets, not just a successful feature.



A Practical 90-Day Approach



Companies do not need to solve everything at once.


A practical first 90 days can be divided into three phases.



Days 1–30: Understand the Current State



During the first month, the organization should:


  • Identify current AI tools and users

  • Review existing AI policies

  • Examine representative repositories

  • Map current delivery workflows

  • Identify high-cost usage patterns

  • Document major governance gaps

  • Determine who currently owns AI engineering

  • Establish a baseline for cost, cycle time, quality, and review effort



The output should be a clear assessment, not another broad AI strategy.



Days 31–60: Design the Operating Model



During the second month, the organization should define:


  • Intent standards

  • Repository readiness requirements

  • Approved agent workflows

  • Human approval points

  • Shared-service responsibilities

  • Security and access controls

  • Cost-measurement standards

  • Team roles

  • Pilot scope

  • Executive success measures



This is where the organization moves from discussion to design.



Days 61–90: Run the Pilot



During the third month, the organization should:


  • Select a real capability

  • Prepare the repository

  • Connect approved enterprise context

  • Implement the intent workflow

  • Configure agents and controls

  • Automate validation

  • Measure usage and outcomes

  • Document lessons

  • Prepare the scaling roadmap



At the end of 90 days, leadership should have evidence, not promises.



What Success Looks Like



A mature AI engineering organization should eventually be able to say:


  • We know which business outcomes our AI engineering investments support.

  • We have a consistent way to move from intent to production.

  • Our repositories are prepared for humans and agents.

  • Our teams use approved shared services.

  • Our agents operate within defined permissions.

  • Human approvals occur at deliberate control points.

  • Costs are visible and connected to outcomes.

  • Quality is validated through evidence.

  • Successful workflows can be repeated across teams.

  • One executive owner is accountable for the operating model.



That is far more meaningful than reporting how many developers are using an AI assistant.



The Pressure Will Not Go Away by Itself



CTOs and engineering leaders are under pressure because expectations have moved faster than operating maturity.


Executives have seen demonstrations and now expect transformation.


Developers have seen what AI can do and expect better tools.


Finance leaders see growing spend and expect accountability.


Security leaders see new risks and expect control.


Business leaders expect faster delivery.


The answer is not to slow everything down.


The answer is to build the structure that allows the organization to move faster with confidence.


AI can generate code.


It can analyze repositories, create plans, write tests, propose architectures, assist deployments, and support operations.


But it cannot independently create the organizational system required to connect business intent, enterprise context, human judgment, governance, cost, and production outcomes.


Leadership must create that system.



The Next Phase of Enterprise AI Engineering



The first phase of enterprise AI engineering was driven by curiosity.


The second was driven by tool adoption.


The next phase will be driven by operational discipline.


The companies that succeed will not necessarily be the companies with the most AI tools.


They will be the companies that know:


  • Why the tools are being used

  • How teams should use them

  • Which context agents can access

  • Where humans remain accountable

  • How risks are controlled

  • How success is measured

  • How effective practices are scaled



The real competitive advantage will not come from merely giving developers AI.


It will come from building an enterprise capable of operating with intent.



You Bought the AI Tools. Now Build the Operating Model.This version positions the article as a practical executive guide rather than a promotion, while still naturally establishing the need for Intent-Driven Engineering.


 
 
 

Recent Posts

See All

Comments

Rated 0 out of 5 stars.
No ratings yet

Add a rating
Post: Blog2_Post

Subscribe Form

Thanks for submitting!

©2020 by LearnTeachMaster DevOps. Proudly created with Wix.com

bottom of page