Bridging IT auditors and AI auditing: Understanding pathways to effective IT audits of AI-driven processes
Yueqi Li & Sanjay Goel
Abstract
The increasing deployment of artificial intelligence (AI) in organizational accounting and other business processes necessitates the auditing of AI-driven processes. However, such processes can be difficult to audit, as the logic behind model decisions is often not explicit and hence less auditable than traditional IT processes. To address this issue, measures to render these processes auditable, alongside relevant auditor competencies, need to be established. Through a survey of 89 IT auditors, this exploratory study identifies and ranks auditability measures and competency requirements for auditors engaging in the auditing of AI-driven processes. Our findings suggest that while many traditional IT auditability measures remain important, auditing AI-driven processes requires additional AI-specific auditability measures, particularly those related to data governance processes and model explainability measures. IT auditors also need to be equipped with AI knowledge and specialized competencies in evaluating AI-driven processes, in addition to other IT auditing competencies. This research introduces key factors that affect the success of IT audits of AI-driven processes. Our findings can help guide the design of future AI auditability measures and training programs to better support IT auditors in evaluating AI-driven processes. • Top auditability measures for AI-driven processes include log maintenance, auditing standards, and data governance processes. • Traditional IT auditability measures continue to be required in auditing AI-driven processes. • An emphasis in technical skills has been observed in auditing AI-driven processes. • Practitioners generally tend to prioritize technical audit skills over ethical or model-level competencies.
2 citations
Evidence weight
Balanced mode · F 0.40 / M 0.15 / V 0.05 / R 0.40
| F · citation impact | 0.25 × 0.4 = 0.10 |
| M · momentum | 0.55 × 0.15 = 0.08 |
| V · venue signal | 0.50 × 0.05 = 0.03 |
| R · text relevance † | 0.50 × 0.4 = 0.20 |
† Text relevance is estimated at 0.50 on the detail page — for your query’s actual relevance score, open this paper from a search result.