Improvement Initiatives Driven by Performance Measures (CGEIT – Benefits Realization)
Overview
In the CGEIT domain of Benefits Realization, a key governance responsibility is making sure that the measurement of IT-enabled investments and services leads to action. Measuring performance is not enough. Governance must use the results to find gaps, decide what to do about them, and drive improvement initiatives that protect and increase value. This topic explains how performance measures such as KPIs, KGIs, balanced scorecards and benefit metrics trigger and guide improvement initiatives. It also covers how to answer CGEIT exam questions on the subject.
Why It Is Important
1. It closes the governance loop. COBIT's governance objectives are Evaluate, Direct and Monitor (EDM). Monitoring that does not feed back into evaluation and direction is wasted effort. Improvement initiatives are the mechanism that turns monitoring results into new direction.
2. It protects realized value. Benefits can erode after an investment goes live. Examples include falling adoption, rising costs and shifting business needs. Performance measures detect the erosion early, and improvement initiatives restore or improve value.
3. It supports accountability. When measures are tied to owners and to improvement actions, business and IT leaders stay accountable for outcomes, not just for activities.
4. It optimizes resources. Measures show where resources are underperforming or misallocated. This allows reprioritization of the portfolio, remediation, or retirement of low-value investments.
5. It enables continual improvement. Frameworks such as COBIT, Val IT, ITIL and ISO/IEC 38500 stress continual improvement. Performance-driven initiatives make improvement evidence-based rather than opinion-based.
6. It manages risk. Deviations in performance often signal emerging risks. Acting on them reduces the risk of benefit shortfalls, failed projects and strategic misalignment.
What It Is
Improvement initiatives driven by performance measures are structured, prioritized actions launched in response to measured gaps between actual and expected performance. The gaps may relate to IT-enabled investments, services, processes or the governance system itself.
Key components:
- Performance measures: KGIs (key goal indicators, which measure outcomes or lag), KPIs (key performance indicators, which measure drivers or lead), benefit metrics, service levels, maturity or capability levels, and customer satisfaction scores.
- Targets and thresholds: agreed baselines and tolerances. These are defined in business cases, SLAs and the benefits realization plan.
- Gap analysis: comparing actual results with targets to find variances.
- Root cause analysis: finding why a gap exists before choosing a remedy.
- Improvement initiatives: corrective actions (fixing shortfalls), preventive actions (avoiding recurrence) and enhancement actions (raising targets or capability).
- Prioritization and approval: initiatives are ranked by value, risk and alignment, then approved through governance bodies such as the IT steering committee, investment committee or board.
- Ownership and tracking: each initiative has a business owner, resources, milestones and its own success measures.
Typical triggers for improvement initiatives:
- Benefits are below the business case targets.
- Costs exceed budget, or the total cost of ownership is rising.
- SLA breaches or declining service quality.
- Low user adoption or low satisfaction.
- Process capability below the target maturity level.
- Audit findings, or benchmarking that shows the organization lags its peers.
- Changes in strategy that make current measures or targets obsolete.
How It Works
The process follows a continual improvement cycle, often modeled on Plan-Do-Check-Act or on the COBIT implementation life cycle.
Step 1: Define measures aligned to goals. Use a goals cascade (enterprise goals, then alignment goals, then governance and management objectives) and a balanced scorecard (financial, customer, internal process, learning and growth). Measures must be SMART, linked to business outcomes, and owned by someone.
Step 2: Establish baselines and targets. Record current performance and the expected results from the business case or service agreements. Without a baseline, improvement cannot be shown.
Step 3: Collect and report performance data. Use dashboards, scorecards and regular reporting to the steering committee or board. Reports should be timely, accurate, and focused on exceptions and trends.
Step 4: Analyze variances and root causes. Investigate significant deviations using techniques such as fishbone diagrams, 5 Whys and Pareto analysis. Separate symptoms from causes. A deviation may come from poor process design, skills gaps, technology issues, changed business conditions or unrealistic original targets.
Step 5: Identify and evaluate improvement options. Options may include process redesign, training, technology changes, organizational change, renegotiating vendor contracts, rescoping, or retiring the investment. Evaluate each option by cost, benefit, risk and strategic alignment. Large initiatives may need their own business case.
Step 6: Prioritize and obtain governance approval. Place improvement initiatives in the portfolio alongside other investments. Senior management or the steering committee decides based on value contribution and risk appetite.
Step 7: Implement with clear ownership. Assign accountable business owners. IT is often responsible, but business owns benefits. Use program and project management disciplines, along with change management to address the people side.
Step 8: Monitor the results of the initiative. Measure whether the improvement closed the gap. Update targets, and capture lessons learned in a post-implementation review.
Step 9: Refine the measurement system itself. Measures can become outdated or encourage the wrong behavior. Review them periodically so they stay relevant, balanced and aligned with strategy.
Roles
- Board or executive management: sets direction and approves major initiatives. Ultimately accountable for value.
- IT steering or investment committee: reviews performance, prioritizes initiatives and allocates resources.
- Business process or benefit owners: accountable for realizing benefits and sponsoring improvements.
- CIO and IT management: deliver IT-related improvements and report performance.
- Internal audit: provides independent assurance over measures and improvement processes.
Common Pitfalls
- Measuring too many things, or measuring only IT-centric metrics such as uptime instead of business outcomes.
- Jumping to solutions without root cause analysis.
- Launching improvements without business ownership or a business case.
- Failing to measure whether improvements actually worked.
- Treating measurement as compliance reporting rather than a decision tool.
- Metrics that drive unintended behavior, sometimes called gaming the metrics.
Exam Tips: Answering Questions on Improvement Initiatives Driven by Performance Measures
1. Think like a governance professional, not a technician. CGEIT answers favor strategic, business-aligned and oversight-oriented actions. Choose answers about aligning, evaluating, prioritizing and ensuring accountability. Avoid hands-on technical fixes.
2. Analyze before acting. When a question describes a performance shortfall, the best first step is usually to determine the root cause or analyze the variance. Immediately replacing a system, adding resources or cancelling a project is rarely correct as a first step.
3. Business ownership of benefits. Benefits and value are owned by the business, not IT. Answers that assign accountability to business owners or sponsors are usually better than those that place sole responsibility on IT.
4. Link measures to enterprise goals. The best measures, and the best basis for improvement, connect to strategic or enterprise objectives through a goals cascade or balanced scorecard. Answers that focus purely on technical metrics are usually distractors.
5. Look for continual improvement and feedback loops. Correct answers often involve monitoring results after an improvement, updating the business case, or feeding lessons learned back into planning.
6. The business case is a living document. If benefits are not being realized, a strong answer may involve revisiting or updating the business case and reassessing whether to continue, change or stop the investment.
7. Prioritize through the portfolio. Improvement initiatives compete for resources. The best answer often involves evaluating them within portfolio management, based on value and risk, with steering committee approval.
8. Know KPIs versus KGIs (lead versus lag). KGIs and outcome measures show whether goals were achieved after the fact. KPIs and driver measures indicate whether goals are likely to be achieved. Questions may ask which measure gives early warning, and the answer is the leading indicator or KPI.
9. Baselines matter. If a question asks why improvement cannot be shown, the likely answer is the absence of a baseline or of agreed targets.
10. Beware of 'most effective' versus 'first' wording. FIRST usually means analysis, understanding or validation. BEST or MOST effective usually means the comprehensive governance solution, such as a framework, aligned measures or established accountability.
11. Eliminate extreme answers. Options such as 'terminate the project immediately' or 'outsource the function' are usually wrong unless the scenario clearly shows value cannot be recovered after proper evaluation.
12. Measures should drive decisions. If a scenario shows reports being produced but no action taken, the issue is weak governance oversight. The fix is defined escalation, accountability and decision-making processes.
Sample Question Walkthrough
Scenario: Six months after deployment, a CRM system shows that customer retention improvements are 40% below the business case target. What should the IT governance committee do FIRST?
A. Approve funding for additional CRM modules.
B. Request an analysis of the root causes of the benefit shortfall.
C. Replace the CRM vendor.
D. Revise the business case targets downward.
Answer: B. Root cause analysis must come before any improvement decision. A and C are solutions without diagnosis. D hides the gap rather than addressing it, although targets may be revised later if analysis shows they were unrealistic.
Key Takeaways
- Performance measures exist to drive decisions and improvement, not just reporting.
- Follow the cycle: measure, compare to baseline and target, analyze root cause, select and prioritize improvements, implement with business ownership, then re-measure.
- Align measures with enterprise goals, use a balance of leading and lagging indicators, and review the measures themselves regularly.
- In the exam, choose answers that are analytical first, business-owned, value-focused and governance-oriented.
