AI Strategy
10 min read

AI ROI Modeling: How to Know If an Initiative Is Worth Doing

Most AI investments lack ROI clarity. Here's how to model ROI so you know what's actually worth funding.

Written and reviewed by The Technology Office · Independent technology advisory

"What's the ROI on this AI project?"

"Uh, we'll measure it after launch."

Bad answer. Good organizations model ROI before launch.

Here's how to do it.

Why ROI Modeling Matters

Without ROI modeling:

  • You invest in projects that don't pay off
  • You can't compare options
  • You can't justify the budget
  • You can't prove value after launch

With ROI modeling:

  • You fund high-value projects first
  • You can compare and prioritize
  • You have budget justification
  • You know if the project delivered

The ROI Modeling Framework

Step 1: Identify the Benefit

What will this AI initiative do?

Common benefits:

  • Time savings: Reduces hours spent on manual tasks
  • Cost reduction: Reduces tools, licenses, or overhead
  • Error reduction: Prevents costly mistakes
  • Revenue growth: Increases sales or customer satisfaction
  • Risk reduction: Prevents compliance or security issues

Be specific. "Saves time" is not specific. "Reduces manual report creation from 40 hours/week to 10 hours/week" is specific.

Step 2: Quantify the Benefit

Put a number on it.

Example: Time Savings

  • Current state: 40 hours/week of manual reporting
  • With AI: 10 hours/week of manual reporting
  • Time saved: 30 hours/week × 50 weeks/year = 1,500 hours/year
  • Cost per hour: $50/hour (blended staff cost)
  • Annual benefit: 1,500 × $50 = $75,000/year

Example: Cost Reduction

  • Current tool cost: $500/month × 12 = $6,000/year
  • AI tool cost: $100/month × 12 = $1,200/year
  • Annual savings: $6,000 - $1,200 = $4,800/year

Example: Error Reduction

  • Current error rate: 2% of transactions
  • Cost per error: $500 (rework + customer impact)
  • Current error cost: 10,000 transactions × 2% × $500 = $100,000/year
  • With AI error rate: 0.5%
  • New error cost: 10,000 × 0.5% × $500 = $25,000/year
  • Annual benefit: $100,000 - $25,000 = $75,000/year

Step 3: Account for Costs

What will this initiative cost?

Direct Costs:

  • Software/tool licenses
  • Implementation and setup
  • Training
  • Integration

Indirect Costs:

  • Staff time for implementation
  • Staff time for governance/monitoring
  • Infrastructure (cloud, storage)
  • Ongoing support

One-Time Costs:

  • Initial implementation: typically $20K - $200K depending on complexity

Annual Ongoing Costs:

  • Tool licenses: $1K - $50K/year
  • Staff support: $10K - $50K/year
  • Infrastructure: $5K - $30K/year
  • Total: typically $15K - $130K/year

Step 4: Calculate Payback Period

How long until the benefit exceeds the cost?

Example:

  • Annual benefit: $75,000
  • One-time implementation cost: $50,000
  • Annual ongoing cost: $20,000

Year 1 ROI: ($75,000 - $20,000) - $50,000 = $5,000 (pays back in month 8)

Year 2+ ROI: $75,000 - $20,000 = $55,000/year

3-Year ROI: ($5,000) + ($55,000) + ($55,000) = $115,000

Step 5: Assess Confidence

How confident are you in these numbers?

High Confidence (90%+):

  • You can measure impact directly
  • You have pilot data
  • The benefit is clear and proven

Medium Confidence (70-90%):

  • You have good estimates
  • Similar projects have shown similar results
  • Some measurement challenges

Low Confidence (<70%):

  • High uncertainty in benefits
  • Hard to measure impact
  • New or unproven use case

Adjust your expected ROI down if confidence is low. Don't double-count uncertain benefits.

Common ROI Mistakes

Mistake 1: Counting the Same Benefit Twice

"We'll save 30 hours/week AND improve customer satisfaction."

If improving satisfaction comes from faster turnaround (same 30 hours), that's one benefit, not two.

Mistake 2: Ignoring Adoption Risk

"The tool will save time, so 100% of staff will use it."

Adoption is usually 60-80%, not 100%.

Adjust your benefit estimate:

  • Best case: 80% adoption
  • Likely case: 60% adoption
  • Conservative: 40% adoption

Mistake 3: Ignoring Change Management Costs

"We'll deploy the tool and people will just use it."

Change management costs money:

  • Training: $5K - $20K
  • Ramp-up time (productivity dip): $10K - $40K
  • Resistance/retraining: $5K - $20K

Include these in your cost calculation.

Mistake 4: One-Year View

"Let's see what happens in year one."

Many AI projects take 12-18 months to hit full ROI.

Model at least 3 years to see true value.

Mistake 5: Ignoring Risk

"The project will definitely work."

Add a risk adjustment:

  • 20% chance project underperforms by 50% → Reduce expected ROI by 10%
  • 10% chance project fails completely → Reduce expected ROI by 2-3%

ROI Modeling Template

Benefit: ___________________ Annual Benefit: $___________ Confidence: % (adjust benefit × confidence factor) Adjusted Benefit: $____

One-Time Cost: $_____________ Annual Ongoing Cost: $________

Payback Period: _______ months Year 1 ROI: $__________ Year 2-3 Annual ROI: $__________ Total 3-Year ROI: $__________

Risk Adjustment: % (reduce expected ROI) Risk-Adjusted ROI: $_____

When NOT to Model ROI

Some initiatives have value that's hard to model:

  • Compliance requirements (you must do it)
  • Risk reduction (hard to model but critical)
  • Strategic positioning (competitive advantage)

For these, focus on cost-benefit, not ROI. "This costs $50K and keeps us compliant and competitive."

But for discretionary initiatives, model the ROI.

The Prioritization Principle

Once you've modeled ROI for all initiatives:

Tier 1: High ROI, Fast Payback

  • $100K annual benefit

  • <6 month payback
  • Do these first

Tier 2: Moderate ROI, Medium Payback

  • $50K-100K annual benefit
  • 6-12 month payback
  • Do these after Tier 1

Tier 3: Low ROI or Long Payback

  • <$50K annual benefit
  • 12 month payback

  • Only do if strategic value

The Real Question

Do you have ROI models for your AI initiatives?

Or are you funding based on excitement and hope?

Good organizations model ROI before funding. Bad organizations measure it (maybe) after.

If you're currently funding initiatives without clear ROI models, that's worth changing.

ROI modeling doesn't take long—a few hours per initiative—and it saves you from funding the wrong projects.

Mentioned services

These service and regional NSW pages expand on the topics covered in this article.

Need help applying this?

Bring in senior technology leadership without the full-time overhead.

The Technology Office works with Sydney and regional NSW businesses on embedded CIO support, Head of IT leadership, governance, vendor management, cost optimisation, crisis stabilisation, and no-cost technology reviews as a lighter first step.

Continue exploring the topic.

View all insights

AI Strategy

AI Transformation Roadmap & Cost Planning: From Hype to Business Value

Most AI conversations lack roadmap clarity and cost visibility. Here's how to build a realistic 12-24 month AI roadmap with clear cost modelling and ROI expectations.

Read article

AI Strategy

From Hype to Value: How to Actually Prioritize AI Projects

Most organizations have 20+ AI ideas but pick the wrong ones to start with. Here's a better way to prioritize.

Read article

AI Strategy

The AI Cost Trap: Why Most AI Initiatives Fail (and How to Avoid It)

Most AI investments fail because of hidden costs, unclear ROI, and no governance. Here's what actually works.

Read article