Relevance, Sufficiency and Reliability of Evidence
In the CIA Challenge Exam's Engagement Performance domain, internal auditors must gather information that supports their conclusions. Under IIA Standard 2310 (now Standard 14.1 of the Global Internal Audit Standards), evidence must be sufficient, reliable, relevant and useful. These qualities determine whether findings will hold up to scrutiny. Relevance means the evidence has a logical connection to the engagement objective or assertion being tested. It must support the auditor's observations and recommendations. Direction of testing is a classic exam point. To test existence or occurrence, auditors trace from the records to the underlying items, such as vouching a recorded sale to its shipping document. To test completeness, they trace from source documents forward into the records. Evidence that is accurate but answers the wrong question is irrelevant. Sufficiency concerns quantity. Evidence is sufficient when it is factual, adequate and convincing, so that a prudent, informed person would reach the same conclusions as the auditor. The amount needed depends on risk, materiality, the strength of internal controls and the quality of the evidence itself. Higher risk calls for more evidence. Statistical sampling helps auditors justify how much testing is enough. Reliability, often called competence, concerns quality. It means the evidence is the best attainable through appropriate engagement techniques. Commonly tested reliability rules include: - External evidence from independent third parties, such as bank confirmations, beats internal documents. - The auditor's direct knowledge, through observation, inspection or recomputation, beats indirect information. - Original documents beat copies. - Written evidence beats oral statements. - Internal evidence produced under strong controls beats evidence produced under weak controls. The three qualities work together. Reliable evidence in large volume still fails if it is irrelevant, and relevant evidence fails if it is unreliable or too scarce. Exam questions often ask which procedure provides the most persuasive evidence for a stated objective. Auditors must document this evidence in engagement workpapers to support results and enable supervisory review.
Relevance, Sufficiency and Reliability of Evidence: CIA Challenge Exam Guide (Engagement Performance)
In the Engagement Performance domain of the CIA Challenge Exam, few topics come up as often as the quality of audit evidence. Every internal audit conclusion is only as strong as the information behind it. The IIA requires internal auditors to gather information that is relevant, reliable and sufficient. The older IPPF Standard 2310 also required it to be useful. The 2024 Global Internal Audit Standards, Standard 14.1 (Gathering Information for Analyses and Evaluation), carries the same idea forward. This guide explains why the topic matters, what each attribute means, how the attributes work together in practice, and how to answer exam questions on them.
1. Why It Is Important
Credibility of conclusions: Findings, ratings and recommendations must be defensible to management, the board and external parties. Weak evidence exposes the audit function to challenge and can damage its reputation.
Professional due care: Gathering appropriate evidence is a core part of due professional care and conformance with the Standards.
Risk of wrong conclusions: Insufficient or unreliable evidence increases engagement risk. The auditor may conclude a control is effective when it is not, or report a problem that does not exist.
Efficiency: Knowing what evidence is good enough stops auditors from over-auditing (wasting resources) or under-auditing (missing issues).
Supervision and quality assurance: Engagement workpapers must allow a reviewer to see that the conclusions are supported.
Exam weight: CIA Challenge candidates are usually experienced professionals such as CPAs and CAs. They are expected to apply judgment, so questions are scenario-based rather than definitional.
2. What It Is: Definitions
Relevant information
- Supports engagement observations and recommendations.
- Is consistent with the engagement objectives and within the scope.
- Relevance is about the logical relationship between the evidence and the assertion or objective being tested.
- Example: To test whether recorded sales actually occurred (existence/occurrence), you trace from the sales ledger back to shipping documents. Tracing from shipping documents forward to the ledger tests completeness, which is a different objective. Both procedures produce reliable evidence, but only one is relevant to each objective.
- The best attainable information obtained through appropriate engagement techniques.
- It is factual, current and trustworthy. Older literature calls this competent evidence.
- Under GIAS, auditors apply professional skepticism when judging reliability.
- Factual, adequate and convincing, so that a prudent, informed person would reach the same conclusions as the auditor.
- GIAS adds that it should let a competent person repeat the procedures and reach the same conclusions.
- Sufficiency is about quantity (enough evidence), while reliability is about quality.
- Helps the organization meet its goals.
- Under GIAS this idea appears through the value and actionability of findings.
- Relevant = Right topic.
- Reliable = Right quality.
- Sufficient = Right amount.
- Useful = Right purpose.
3. How It Works
A. Hierarchy of reliability
These rules are general guides, not absolutes, but exam answers depend on them.
- External versus internal: Evidence from independent third parties is more reliable than evidence produced inside the organization. Examples include bank confirmations and vendor statements.
- Auditor-obtained versus client-provided: Evidence the auditor obtains directly is more reliable than evidence the auditee provides. Examples include physical inspection, observation and recalculation.
- Documentary versus oral: Written evidence beats verbal representations. Interviews and testimonial evidence are the weakest and need corroboration.
- Originals versus copies: Original documents are more reliable than photocopies, faxes or scans.
- Strong versus weak controls: Internally generated evidence is more reliable when the internal controls over its production are effective.
- Corroborated versus single-source: Information confirmed by several independent sources is more reliable.
- Contemporaneous versus after the fact: Information recorded at the time of the event is more reliable than later reconstructions.
- Externally generated, externally held evidence is stronger than externally generated, internally held evidence. For example, a confirmation sent directly to the auditor beats a vendor invoice held in the auditee's files.
Listed from typically strongest to weakest when used alone:
- Physical: Inspection and observation. Observation is limited to the moment it occurs, and people may behave differently when watched.
- Documentary: Internal or external records.
- Analytical: Ratios, trends and comparisons. It points to anomalies but usually needs follow-up.
- Testimonial: Interviews and questionnaires. It always needs corroboration.
- Risk: Higher risk or materiality requires more evidence.
- Evidence quality: More reliable evidence means less quantity is needed. However, a larger quantity cannot make up for evidence that is irrelevant or unreliable.
- Control environment: Weak controls require more extensive testing.
- Prior findings: Previous issues call for expanded procedures.
- Sampling: Lower tolerable deviation rate, higher desired confidence and higher expected error rate all increase sample size.
- Cost versus benefit: Auditors seek reasonable, not absolute, assurance.
Each objective needs evidence that addresses its specific assertion:
- Existence/occurrence
- Completeness
- Accuracy/valuation
- Rights and obligations
- Authorization
- Compliance
- Effectiveness and efficiency
- Vouching (from records to source documents) tests existence.
- Tracing (from source documents to records) tests completeness.
Workpapers must record the information identified, the analyses performed and the conclusions reached. A supervisor reviews whether the evidence is sufficient and appropriate before the report is issued.
4. Worked Examples
Example 1: An auditor wants to confirm the existence of accounts receivable. Which evidence is most reliable?
Answer: A positive confirmation sent and returned directly to the auditor from the customer. It is external and comes straight to the auditor. Aged trial balances and management assertions are weaker.
Example 2: An auditor examines 200 approved purchase orders to test whether all goods received were recorded as liabilities.
Issue: The evidence is not relevant. Completeness of liabilities requires tracing from receiving reports, or from unpaid vendor statements, to the payables ledger.
Example 3: A manager tells the auditor that bank reconciliations are reviewed monthly.
Issue: This is testimonial evidence only, so it is not reliable or sufficient on its own. The auditor should inspect signed reconciliations or reperform a sample.
Example 4: An auditor bases a fraud finding on a single anomalous transaction.
Issue: A prudent, informed person might not reach the same conclusion, so the evidence is not sufficient. The auditor should expand testing and corroborate.
5. Exam Tips: Answering Questions on Relevance, Sufficiency and Reliability of Evidence
Tip 1: Identify which attribute is being tested.
- Words such as persuasive, prudent person, enough or same conclusion point to sufficiency.
- Words such as best attainable, trustworthy or competent point to reliability.
- Words such as supports the objective or related to the finding point to relevance.
Tip 3: For 'most reliable' questions, apply the hierarchy. Prefer external over internal, auditor-obtained over auditee-provided, and documents over oral statements. Also prefer originals, corroborated information and evidence produced under strong controls. Third-party confirmations sent directly to the auditor and the auditor's own observation, recalculation or reperformance usually win.
Tip 4: Treat 'least reliable' answers carefully. Unsupported verbal assertions by the auditee are the typical correct answer. This is especially true when they come from the person responsible for the activity under review.
Tip 5: Check the direction of testing. Many relevance questions hide the answer in whether the auditor vouched or traced. Match the direction to the assertion: existence or completeness.
Tip 6: Quantity never fixes quality. If evidence is irrelevant or unreliable, a larger sample does not make it appropriate. Reject options that simply say 'increase the sample size' when the real problem is the type of evidence.
Tip 7: Remember that judgment governs. Sufficiency is a matter of professional judgment based on risk and materiality. Reasonable assurance, not absolute certainty, is the goal. Eliminate answers claiming that evidence must be conclusive or that auditors must test 100 percent.
Tip 8: Watch for limitations of specific techniques.
- Observation applies only at the moment it is performed.
- Analytical procedures identify anomalies but rarely prove a conclusion alone.
- Inquiry must be corroborated.
- Inspecting a document proves it exists, not that the underlying transaction is valid.
- Corroborate with independent evidence.
- Expand procedures.
- Obtain external confirmation.
Tip 10: Know both frameworks. The exam may reference Standard 2310 (sufficient, reliable, relevant, useful) or GIAS Standard 14.1 (relevant, reliable, sufficient, assessed with professional skepticism). The concepts are the same, so answer based on the principle.
Tip 11: Read 'best', 'most' and 'primary' carefully. Several options may be partially correct. Choose the one that most directly addresses the stated objective with the most reliable source.
Tip 12: Use elimination. Remove options that are:
- Outside the engagement scope (irrelevant).
- Prepared by the auditee without independent support (less reliable).
- Based on one item or one source for a significant conclusion (insufficient).
6. Quick Summary
Relevant evidence supports the objective and the finding. Reliable evidence is the best attainable, factual and trustworthy, and is strongest when external, direct, documented and corroborated. Sufficient evidence is enough to convince a prudent, informed person to reach the same conclusion. Useful evidence helps the organization achieve its goals.
Master the reliability hierarchy, match the direction of testing to the assertion, and remember that judgment based on risk drives sufficiency. With these, you can answer most CIA Challenge questions on this topic confidently.
CIA Challenge - Relevance, Sufficiency and Reliability of Evidence Example Questions
Test your knowledge of Relevance, Sufficiency and Reliability of Evidence
Question 1
An internal auditor testing the year-end balance of an outstanding bank loan receives a PDF copy of the lender's statement from the treasury manager. The treasury manager's team administers the loan. Which action would best increase the reliability of the evidence supporting the loan balance?
Question 2
An internal auditor must design a sampling plan to test whether disbursements above an approval threshold received two authorized signatures throughout the year. The engagement supervisor asks for a plan that yields sufficient, relevant evidence that a competent reviewer could rely on to reach the same conclusion. Which plan design is most appropriate?
Question 3
An internal auditor obtains two listings of terminated employees who still have system access. Listing A comes from an application whose access and change management controls were recently tested and found effective. Listing B comes from a spreadsheet that a process owner maintains manually, with no independent review. When comparing the two sources, which conclusion is most appropriate?