Black Shard

Insights21 September 2026

What a board should ask about AI risk before a rollout

A board oversees an AI rollout by requiring a current register of every AI system in use, a named person who can intervene in each one, a risk entry that states the specific way each system can fail, and a quarterly pack that shows movement between periods. The Guidance for AI Adoption published by the Department of Industry, Science and Resources sets six essential practices covering accountability, risk, information sharing, testing and human control, and ISO/IEC 42001:2023 assigns the same work to top management as auditable clauses.

An empty boardroom table with a single chair lit from above in violet light, no people or text visible.

The four questions a board asks before an AI rollout

A board's questions on AI risk oversight come down to four. Which AI systems the organisation is already running, and who owns each one. What evidence shows a person can intervene when a system is wrong. How each system can fail in business terms, and who answers for that consequence. What the organisation would hand over if a regulator, an insurer or a customer asked how that use is governed. Those four questions go to management on a fixed cadence, and the answers belong in the minutes. A board does not have to assess an AI system's technical accuracy before it operates.

The Department of Industry, Science and Resources published the Guidance for AI Adoption in October 2025. It sets six essential practices for AI governance: decide who is accountable, understand impacts and plan accordingly, measure and manage risks. The other three are share essential information, test and monitor, and maintain human control. It evolves the Voluntary AI Safety Standard, whose 10 guardrails remain published as the more detailed set. ISO/IEC 42001:2023, the international standard for an AI management system, sets the same expectations as auditable clauses. Each of them asks the organisation to show that a named person owns the AI decision and that a record of it exists.

Why AI oversight lands on the board

An AI rollout usually starts as a procurement decision or a product build, and the paper that reaches the board describes the tool. The exposure sits in what the organisation answers for afterwards. A system that reads customer records, drafts communications or acts on a person's behalf produces actions nobody approved individually. That puts it on the same footing as any other material business risk the board oversees.

The Voluntary AI Safety Standard states that leaders cannot delegate or outsource accountability for the safe and responsible deployment and use of AI systems. The Guidance for AI Adoption turns that into a first action: assign a senior leader as the overall AI governance owner. That leader needs enough authority and understanding of AI capability and risk to oversee all AI use. It then asks for a specific person to be made accountable for every AI system the organisation uses. ISO/IEC 42001 clause 5.1 holds top management itself responsible for the AI policy and objectives, and for their fit with the organisation's strategic direction. It also holds top management responsible for integrating the management system into ordinary business processes and for the resources it needs. Clause 5.3 requires top management to assign responsibility and authority for two things: that the AI management system conforms to the standard, and that its performance is reported to top management. Put a name against each in the board papers.

What a board should be able to answer about its own AI use

The AI project underway has a name and a sponsor. The rest of an organisation's AI use often has neither, because staff adopt AI tools individually and vendors switch AI features on inside products the organisation already licenses. The Guidance for AI Adoption asks for an AI register: an up-to-date, organisation-wide inventory of each AI model and system. It is held in enough detail to inform stakeholders and to support a future conformance assessment. A register that lists only the sanctioned project misses the tools staff picked up on their own. It also misses the features that arrived in a product update, and any AI agent given standing access to internal systems.

Question the board asksArtefact that answers itOwner
What AI systems are running, sanctioned or not?An AI register covering vendor tools, AI features embedded in licensed products and internally built systems, refreshed on a fixed cycleThe senior leader assigned as AI governance owner
Who can pause, override or shut down each system when it is wrong?A named intervention point for each system, with a test that shows it worksThe person accountable for that system
What data does each system read, and under what access?A data governance record naming the sources, the access boundary and any personal information involvedSystem owner, with the privacy lead
What would we hand a regulator or an insurer who asked how this is governed?The register entry: accountable people, purpose, capabilities and limitations, datasets and their provenance, acceptance criteria and test results, identified risks and treatment, audit outcomes and dates of reviewThe ISO/IEC 42001 conformance role
Which AI outputs are acted on with no human check?A list of the automated actions that carry no review step, each with the business consequence if the output is wrongRisk owner, tabled by the system owner

Board questions on AI use, the artefact that answers each one, and who owns it

What a risk register entry for AI contains

A register entry that says AI risk names nothing anyone can act on. The third essential practice asks for a risk screening process that flags the systems and use cases carrying unacceptable risk or needing extra governance attention. It then asks for risk assessments and mitigation plans for each specific use case. The Voluntary AI Safety Standard sets the same requirement at system level, calling for a documented risk assessment for each AI system, including systems procured from third parties. Each assessment is written against documented use cases and their potential unintended use. A workable entry names the system, states the way it can fail in business terms, and names who answers for the consequence.

  • The system named, with the business process it sits inside.
  • The specific failure stated as a consequence, such as an incorrect output acted on before anyone checks it.
  • The intervention point, and evidence it has been exercised.
  • The data the system reads, and whether any of it is personal or client information.
  • The accountable owner, a person distinct from whoever built or bought the system.
  • A review date, so an entry cannot age into a permanent fixture nobody revisits.

What the board should see each quarter

The Voluntary AI Safety Standard sets record keeping at the level a third party needs to assess compliance with the guardrails. That is a harder bar than an internal comfort document. Under ISO/IEC 42001 clause 5.3, reporting the AI management system's performance to top management is an assigned responsibility. Set the cadence and the detail so the board can see movement between quarters.

A quarterly pack built to that bar carries the current AI register against the previous one, so the board can see what was added and what was retired. It carries the gaps that remain against each practice a system has not met. It also carries every occasion on which a person intervened and what followed, and the incidents and near misses logged against AI systems, kept separate from general IT incidents. Where a gap has been accepted instead of closed, the acceptance needs a named owner, a compensating step and a date it comes back for review.

Two further items belong in the pack. The fifth essential practice calls for documented deployment authorisation and rationale from the accountable person, based on test results. The pack should show who authorised each system to go live and on what evidence. The sixth calls for alternative pathways, so that critical functions continue if an AI system malfunctions or is retired, which is a question to settle before the rollout.

How an Australian court has measured adequacy

The Corporations Act 2001 (Cth) contains no AI duty. It contains section 180(1), which requires a director or other officer to exercise their powers and discharge their duties with the care and diligence a reasonable person would exercise if they held that office, with those responsibilities, in that company's circumstances. The National AI Centre puts that duty in AI terms. A company director has a personal duty under section 180 to act with care and diligence. That duty includes ensuring adequate governance systems exist to manage the risks created by the organisation's AI systems.

The nearest Australian authority on what adequate means sits in cyber security. In Australian Securities and Investments Commission v RI Advice Group Pty Ltd [2022] FCA 496, the Federal Court declared that RI Advice contravened the Corporations Act, sections 912A(1)(a) and 912A(1)(h). The contravention was failing to have cyber security documentation and controls adequate to manage risk across the network operating under its licence. Rofe J found that it is not possible to reduce cyber security risk to zero. It can be materially reduced to an acceptable level through adequate documentation and controls. The judgment also states how adequacy is to be assessed. Assessing any particular set of cyber risk management systems requires the technical expertise of a relevantly skilled person. The standard is one for the Court to decide, but the Court's assessment would be informed by evidence from relevantly qualified experts in the field.

Those findings were made about a financial services licensee, and about cyber security rather than AI. What they call for is evidence of a particular kind. That evidence is a documented AI register, a risk assessment for each system, and oversight points examined by someone outside the team that built them.

What to check first, and where the gap gets closed

Start with the register, because none of the other artefacts can be produced without it: every AI system in live use, named, owned and dated. Then confirm the intervention point for each one and test that it stops something. Then check that the two ISO/IEC 42001 roles, conformance and performance reporting, sit with named people instead of being implied by a job title. A gap analysis produced before the register exists will describe the wrong systems.

Where none of that exists yet, the work runs as an ISO 42001 readiness assessment. That assessment is a gap analysis against the standard, scoped to the AI systems actually in use. It produces a remediation plan sequenced against the date driving the work, and an evidence set prepared for a certification audit. It is led by a director who holds the Exemplar Global Certified Lead Auditor credential for ISO/IEC 27001:2022. That work runs from the engineering practice that builds and runs the firm's own production AI systems on Azure. Our AI cyber defence work covers the register, the intervention points and the assessments that sit behind the quarterly pack.

Tell us what AI you need secured.

Brisbane head office. Work delivered across Australia.

Open a briefinfo@blackshard.com.au