AI ROI Modeling: How to Know If an Initiative Is Worth Doing
Most AI investments lack ROI clarity. Here's how to model ROI so you know what's actually worth funding.
Written and reviewed by The Technology Office · Independent technology advisory
"What's the ROI on this AI project?"
"Uh, we'll measure it after launch."
Bad answer. Good organizations model ROI before launch.
Here's how to do it.
Why ROI Modeling Matters
Without ROI modeling:
- You invest in projects that don't pay off
- You can't compare options
- You can't justify the budget
- You can't prove value after launch
With ROI modeling:
- You fund high-value projects first
- You can compare and prioritize
- You have budget justification
- You know if the project delivered
The ROI Modeling Framework
Step 1: Identify the Benefit
What will this AI initiative do?
Common benefits:
- Time savings: Reduces hours spent on manual tasks
- Cost reduction: Reduces tools, licenses, or overhead
- Error reduction: Prevents costly mistakes
- Revenue growth: Increases sales or customer satisfaction
- Risk reduction: Prevents compliance or security issues
Be specific. "Saves time" is not specific. "Reduces manual report creation from 40 hours/week to 10 hours/week" is specific.
Step 2: Quantify the Benefit
Put a number on it.
Example: Time Savings
- Current state: 40 hours/week of manual reporting
- With AI: 10 hours/week of manual reporting
- Time saved: 30 hours/week × 50 weeks/year = 1,500 hours/year
- Cost per hour: $50/hour (blended staff cost)
- Annual benefit: 1,500 × $50 = $75,000/year
Example: Cost Reduction
- Current tool cost: $500/month × 12 = $6,000/year
- AI tool cost: $100/month × 12 = $1,200/year
- Annual savings: $6,000 - $1,200 = $4,800/year
Example: Error Reduction
- Current error rate: 2% of transactions
- Cost per error: $500 (rework + customer impact)
- Current error cost: 10,000 transactions × 2% × $500 = $100,000/year
- With AI error rate: 0.5%
- New error cost: 10,000 × 0.5% × $500 = $25,000/year
- Annual benefit: $100,000 - $25,000 = $75,000/year
Step 3: Account for Costs
What will this initiative cost?
Direct Costs:
- Software/tool licenses
- Implementation and setup
- Training
- Integration
Indirect Costs:
- Staff time for implementation
- Staff time for governance/monitoring
- Infrastructure (cloud, storage)
- Ongoing support
One-Time Costs:
- Initial implementation: typically $20K - $200K depending on complexity
Annual Ongoing Costs:
- Tool licenses: $1K - $50K/year
- Staff support: $10K - $50K/year
- Infrastructure: $5K - $30K/year
- Total: typically $15K - $130K/year
Step 4: Calculate Payback Period
How long until the benefit exceeds the cost?
Example:
- Annual benefit: $75,000
- One-time implementation cost: $50,000
- Annual ongoing cost: $20,000
Year 1 ROI: ($75,000 - $20,000) - $50,000 = $5,000 (pays back in month 8)
Year 2+ ROI: $75,000 - $20,000 = $55,000/year
3-Year ROI: ($5,000) + ($55,000) + ($55,000) = $115,000
Step 5: Assess Confidence
How confident are you in these numbers?
High Confidence (90%+):
- You can measure impact directly
- You have pilot data
- The benefit is clear and proven
Medium Confidence (70-90%):
- You have good estimates
- Similar projects have shown similar results
- Some measurement challenges
Low Confidence (<70%):
- High uncertainty in benefits
- Hard to measure impact
- New or unproven use case
Adjust your expected ROI down if confidence is low. Don't double-count uncertain benefits.
Common ROI Mistakes
Mistake 1: Counting the Same Benefit Twice
"We'll save 30 hours/week AND improve customer satisfaction."
If improving satisfaction comes from faster turnaround (same 30 hours), that's one benefit, not two.
Mistake 2: Ignoring Adoption Risk
"The tool will save time, so 100% of staff will use it."
Adoption is usually 60-80%, not 100%.
Adjust your benefit estimate:
- Best case: 80% adoption
- Likely case: 60% adoption
- Conservative: 40% adoption
Mistake 3: Ignoring Change Management Costs
"We'll deploy the tool and people will just use it."
Change management costs money:
- Training: $5K - $20K
- Ramp-up time (productivity dip): $10K - $40K
- Resistance/retraining: $5K - $20K
Include these in your cost calculation.
Mistake 4: One-Year View
"Let's see what happens in year one."
Many AI projects take 12-18 months to hit full ROI.
Model at least 3 years to see true value.
Mistake 5: Ignoring Risk
"The project will definitely work."
Add a risk adjustment:
- 20% chance project underperforms by 50% → Reduce expected ROI by 10%
- 10% chance project fails completely → Reduce expected ROI by 2-3%
ROI Modeling Template
Benefit: ___________________ Annual Benefit: $___________ Confidence: % (adjust benefit × confidence factor) Adjusted Benefit: $____
One-Time Cost: $_____________ Annual Ongoing Cost: $________
Payback Period: _______ months Year 1 ROI: $__________ Year 2-3 Annual ROI: $__________ Total 3-Year ROI: $__________
Risk Adjustment: % (reduce expected ROI) Risk-Adjusted ROI: $_____
When NOT to Model ROI
Some initiatives have value that's hard to model:
- Compliance requirements (you must do it)
- Risk reduction (hard to model but critical)
- Strategic positioning (competitive advantage)
For these, focus on cost-benefit, not ROI. "This costs $50K and keeps us compliant and competitive."
But for discretionary initiatives, model the ROI.
The Prioritization Principle
Once you've modeled ROI for all initiatives:
Tier 1: High ROI, Fast Payback
-
$100K annual benefit
- <6 month payback
- Do these first
Tier 2: Moderate ROI, Medium Payback
- $50K-100K annual benefit
- 6-12 month payback
- Do these after Tier 1
Tier 3: Low ROI or Long Payback
- <$50K annual benefit
-
12 month payback
- Only do if strategic value
The Real Question
Do you have ROI models for your AI initiatives?
Or are you funding based on excitement and hope?
Good organizations model ROI before funding. Bad organizations measure it (maybe) after.
If you're currently funding initiatives without clear ROI models, that's worth changing.
ROI modeling doesn't take long—a few hours per initiative—and it saves you from funding the wrong projects.
Mentioned services
These service and regional NSW pages expand on the topics covered in this article.
Need help applying this?
Bring in senior technology leadership without the full-time overhead.
The Technology Office works with Sydney and regional NSW businesses on embedded CIO support, Head of IT leadership, governance, vendor management, cost optimisation, crisis stabilisation, and no-cost technology reviews as a lighter first step.