Nonfinancial Information and Benchmarking: A Complete CIA Part 2 Guide
Introduction
Within CIA Part 2 (Practice of Internal Auditing), the domain of Information Gathering, Analysis, and Evaluation asks internal auditors to collect sufficient, reliable, relevant, and useful information to support engagement results. Financial data alone rarely tells the whole story. Nonfinancial information and benchmarking are two closely linked analytical tools. They help auditors understand operations, spot anomalies, assess performance, and recommend improvements.
Why It Is Important
1. A complete picture of performance: Financial results are lagging indicators. They show what already happened. Nonfinancial measures such as customer satisfaction, defect rates, employee turnover, cycle time, and on-time delivery are often leading indicators of future financial results.
2. Corroboration and reasonableness testing: Nonfinancial data can confirm or contradict financial data. For example, revenue growth with no matching growth in units shipped, headcount, or energy use may point to errors or fraud.
3. Supporting operational and value-for-money audits: Performance audits look at economy, efficiency, and effectiveness. These are frequently measured in nonfinancial terms, such as units per labour hour or complaints per thousand transactions.
4. Identifying best practices: Benchmarking shows how the organisation compares with peers or world-class performers. This helps auditors make credible, evidence-based recommendations that add value, in line with the IIA's mission of enhancing and protecting organisational value.
5. Alignment with strategy and governance: Frameworks such as the Balanced Scorecard rely heavily on nonfinancial KPIs. Auditors increasingly provide assurance over ESG, sustainability, and operational metrics reported to boards and stakeholders.
What It Is
Nonfinancial information is any quantitative or qualitative data not expressed in monetary terms that describes operations, processes, people, customers, or the environment. Examples include:
- Operational: production volumes, capacity utilisation, scrap and defect rates, cycle time, downtime.
- Customer: satisfaction scores, Net Promoter Score, complaint counts, retention rates, market share.
- Employee: turnover, absenteeism, training hours, safety incidents, engagement survey results.
- Physical and environmental: square footage, energy consumption, emissions, number of stores or branches.
- Process and compliance: number of exceptions, policy violations, audit findings outstanding, system availability.
Benchmarking is the systematic process of comparing an organisation's processes, practices, and performance measures against a standard or reference point. The aim is to identify gaps and opportunities for improvement.
The main types of benchmarking are:
- Internal benchmarking: comparing similar units, divisions, branches, or periods within the same organisation. Data is easy to obtain and comparable, but insight may be limited.
- Competitive benchmarking: comparing against direct competitors. This is highly relevant, but data is often hard to obtain because competitors guard it.
- Functional or industry benchmarking: comparing a specific function, such as payroll or logistics, against organisations in the same industry that are not necessarily direct competitors.
- Generic or best-in-class benchmarking: comparing a process against the best performer in any industry. A classic example is a manufacturer studying a mail-order firm's warehousing. This can generate breakthrough ideas.
- Performance (metric) benchmarking vs. process benchmarking: the first compares outcomes and numbers. The second studies how work is done.
- Strategic benchmarking: comparing long-term strategies and business models.
How It Works
Using nonfinancial information in analytical procedures
Analytical procedures (IIA Global Internal Audit Standards, Domain V on Performing Engagements) involve developing expectations and comparing them with actual results. Nonfinancial data is used to:
- Build expectations: for example, expected payroll = headcount x average wage x hours. Expected hotel revenue = rooms x occupancy rate x average daily rate.
- Perform ratio and trend analysis: revenue per employee, cost per unit, sales per square foot, maintenance cost per machine hour.
- Run reasonableness tests: compare recorded expenses with physical drivers. Fuel cost should align with miles driven. Utilities should align with production volume.
- Detect red flags: unexplained divergence between financial and nonfinancial trends warrants follow-up through inquiry and further testing.
Reliability of nonfinancial data
Nonfinancial data often comes from operational systems that are not subject to financial-reporting controls. Before relying on it, the auditor should evaluate:
- the source and its independence,
- the controls over the system generating it,
- its consistency over time,
- whether the data could be manipulated by the people being evaluated.
Externally generated or independently verified data is generally more reliable than internally prepared, unaudited data.
The benchmarking process (typical steps)
1. Plan: select the process or function to benchmark, usually one that is critical, high-cost, or underperforming. Identify KPIs and secure management support.
2. Identify benchmarking partners or sources: internal units, competitors, industry associations, trade publications, consultants, government statistics, or benchmarking clearinghouses.
3. Collect data: use surveys, site visits, interviews, published reports, and databases. Ensure measures are defined consistently so comparisons are like-for-like.
4. Analyse: determine performance gaps and their root causes. Adjust for differences in size, geography, accounting policies, and business model.
5. Integrate and adapt: communicate findings, set improvement targets, and adapt best practices rather than blindly copying them.
6. Act and monitor: implement changes, track results, and recalibrate benchmarks periodically. This is a continuous improvement cycle similar to Plan-Do-Check-Act.
Role of the internal auditor
- Use benchmarks as criteria for evaluating performance during operational audits.
- Recommend benchmarking as a management improvement tool.
- Provide assurance on the integrity of KPIs and benchmark data reported to management and the board.
- Act as a consultant in designing performance measurement systems, while preserving objectivity by not assuming management responsibility.
- Benchmark the internal audit activity itself, for example audit cycle time, cost per audit hour, or recommendations implemented. This is often part of the Quality Assurance and Improvement Program.
Limitations and Pitfalls
- Comparability problems: different definitions, accounting methods, sizes, or operating environments.
- Data availability and confidentiality: competitors rarely share sensitive data. Ethical and legal limits apply, including antitrust concerns and benchmarking codes of conduct.
- Focus on numbers over processes: metric benchmarking shows that a gap exists, not why.
- Gaming of metrics: people measured on nonfinancial KPIs may manipulate them.
- Complacency: beating an average benchmark does not mean performance is excellent.
- Cost and time: formal benchmarking studies can be resource-intensive.
Worked Examples
Example 1: A retail chain's Store A reports sales growth of 25%. Foot traffic counts are flat and inventory purchases are down 5%. This nonfinancial inconsistency suggests possible fictitious sales or cut-off errors. The auditor should investigate.
Example 2: The accounts payable department processes 4,000 invoices per full-time employee per year. An industry benchmark shows best-in-class at 12,000. This is a performance gap. The auditor would then perform process benchmarking, such as studying automation and e-invoicing, to identify root causes and recommend improvements.
Exam Tips: Answering Questions on Nonfinancial Information and Benchmarking
1. Know the benchmarking types cold. Expect questions such as 'Comparing the organisation's warehouse operations with those of a leading online retailer in another industry is an example of...' The answer is generic or best-in-class benchmarking. Comparing branches within the company is internal. Comparing with a direct rival is competitive.
2. Remember the first step. In most CIA-style questions, the first step of benchmarking is to identify the process or area to be benchmarked and the key measures. Selecting partners comes later. Do not jump to data collection.
3. Look for the corroboration angle. When a question describes financial figures that do not match operational drivers, the best answer usually involves using nonfinancial data to test reasonableness and then following up the unexplained variance.
4. Prefer independent, external, verifiable data. If asked which nonfinancial information is most reliable, choose data from independent third parties or systems with strong controls. Avoid figures prepared by the managers being evaluated.
5. Distinguish leading from lagging indicators. Customer satisfaction, employee training, and defect rates are leading or nonfinancial indicators. Profit, ROI, and revenue are lagging or financial ones. Balanced Scorecard questions often test this distinction.
6. Recognise limitations. A frequent correct answer to 'What is the primary disadvantage...' is lack of comparability or difficulty obtaining competitor data. For internal benchmarking, the drawback is limited scope for breakthrough improvement.
7. Watch for objectivity traps. If an option has internal audit designing and owning the KPI system, or setting targets for management, it likely impairs objectivity. Auditors advise and assure; management decides and implements.
8. Process vs. metric. If a question asks how to learn why a competitor performs better, the answer is process benchmarking, such as site visits or studying workflows. Metric comparisons only reveal the gap.
9. Read for the 'best' or 'most' qualifier. Several options may be partly correct. Choose the one that most directly addresses the stated objective, whether that is efficiency, fraud detection, reliability, or improvement.
10. Link to engagement criteria. Benchmarks, industry standards, and best practices are acceptable sources of criteria for evaluating performance. They are especially useful when management has not established its own criteria.
Quick Recap
- Nonfinancial information complements financial data, corroborates it, and often predicts future performance.
- Benchmarking compares performance or processes against internal, competitive, functional, or best-in-class references to find and close gaps.
- Always assess data reliability and comparability.
- Internal auditors use benchmarks as criteria, recommend them as tools, and provide assurance on KPIs while maintaining objectivity.
- In the exam, identify the benchmarking type, the correct sequence of steps, the reliability hierarchy, and the key limitations.
