The Australian government is strongly urging healthcare professionals to exercise caution when using AI-powered medical scribing tools, as regulators examine whether stronger safeguards are needed around one of healthcare's fastest-growing technologies. AI scribes, which record, transcribe, and summarise doctor-patient conversations into clinical notes, have rapidly gained popularity by reducing the administrative burden on doctors. However, government officials now warn that the technology's rapid adoption has outpaced oversight, raising serious questions about patient privacy, informed consent, and the accuracy of medical records.
According to documents obtained by freedom of information requests, Australia's federal health department has identified several risks associated with AI scribing tools. Briefing papers prepared for Senate Estimates in February 2026 describe the technology as having "little oversight" and note that some AI scribes are marketed as operating outside existing medical device regulations despite being used in clinical settings. This regulatory gap has created a situation where providers may deploy systems without the rigorous testing required for medical devices, potentially compromising patient safety.
The rapid adoption of AI scribes in Australian healthcare
The adoption of AI scribes has surged dramatically. An online survey conducted by the Royal Australian College of General Practitioners (RACGP) found that the proportion of Australian doctors using AI scribes nearly doubled from 22 percent in August 2024 to 40 percent by November 2025. Technology providers also claim their platforms have processed hundreds of millions of consultations globally over the past 18 months. This rapid uptake reflects a combination of factors: severe clinician burnout, increasing administrative demands, and the promise of AI to free up time for patient care.
Doctors typically spend several hours each day on documentation, often after regular hours. AI scribes promise to reduce this burden by automatically generating notes, coding, and even suggesting follow-up actions. However, the health department acknowledges that while AI scribes could improve clinician productivity and help reduce burnout, they also inherit the same limitations as large language models. Errors in transcription or summarisation can affect patient safety, clinical accountability, and the quality of information stored in Australia's digital health infrastructure, including the My Health Record system.
Privacy and data security concerns
Privacy has emerged as one of the most pressing concerns. Officials found that some providers promote their products as privacy compliant while offering limited transparency about how patient information is processed. In some cases, healthcare providers may not even realise that patient data is being transmitted to cloud servers outside Australia, potentially exposing sensitive medical information to additional risks under foreign data protection regimes. The Australian government is particularly concerned about the lack of clarity regarding data retention, encryption, and the potential for third-party access.
The Office of the Australian Information Commissioner has previously warned that entities collecting health information must ensure that data is not used for purposes beyond providing healthcare without explicit consent. Yet, the opacity of many AI scribe platforms makes it difficult for both doctors and patients to understand what happens to their data once it leaves the consultation room. Some vendors advertise that they use anonymised data to improve their models, but the legal and ethical boundaries remain unclear.
Accuracy and clinical accountability
Accuracy of transcription and summarisation is another major worry. While large language models have become remarkably fluent, they are prone to "hallucinations"—generating plausible-sounding but incorrect information. In a clinical setting, even minor errors can have serious consequences. For instance, a reported symptom could be misinterpreted, a medication could be misrecorded, or a treatment plan could be incorrectly summarised. The health department notes that errors in AI-generated notes could lead to misdiagnosis, inappropriate treatment, or legal liability for the clinician who reviewed and signed off on the notes.
Moreover, the technology's limitations are not always communicated to doctors. Many clinicians may assume that the AI output is accurate because it appears polished, leading to over-reliance. Tools that automatically populate electronic health records could introduce systematic errors that propagate across a patient's history. The Australian Health Practitioner Regulation Agency (Ahpra) is now considering whether updated guidelines are needed to clarify the professional responsibilities of doctors when using AI documentation tools.
The consent paradox
Patient consent has become a contentious issue. The government found significant variation in how clinics obtain permission before recording consultations. Meaningful informed consent requires patients to understand both the benefits and limitations of AI-assisted documentation. However, consumer groups have reported instances where patients were told they would need to find another healthcare provider if they declined to have AI scribes used during appointments. This coercive practice undermines the principle of voluntary consent and raises ethical red flags.
Some clinics provide opt-out forms that patients can sign, but without clear explanations of how the AI works, patients may not fully comprehend what they are consenting to. The RACGP has issued guidance recommending that doctors have a conversation with patients about the use of AI scribes, explaining that the tool is used for documentation purposes and that the patient's data will be handled securely. Yet, in busy practice settings, such conversations are often skipped or minimised, leaving patients in the dark.
Economic implications and Medicare concerns
The economic implications of AI scribes are also attracting scrutiny. The health department questioned marketing claims suggesting AI scribes can increase doctors' revenue by around 30 percent without extending working hours or seeing more patients. Officials worry that such claims could have broader implications for Australia's publicly funded Medicare system if higher billing becomes a primary incentive for adoption rather than improved patient care. In a fee-for-service environment, doctors might be tempted to generate more billable items using AI-generated notes, potentially leading to fraudulent billing or upcoding.
Additionally, if AI scribes allow doctors to see more patients in the same time, this could increase overall healthcare costs without necessarily improving outcomes. The Department of Health is evaluating whether artificial documentation tools should be subject to specific billing rules, similar to those that govern other remote consultations and digital health services.
Regulatory fragmentation and path forward
The regulatory landscape for AI scribes remains fragmented. Oversight is currently shared between the Therapeutic Goods Administration (TGA), Ahpra, and the Office of the Australian Information Commissioner. The TGA is reviewing whether AI scribes should be formally classified as medical devices, a decision that could bring many platforms under stricter oversight. A report is expected in the coming months. If AI scribes are classified as medical devices, they would need to undergo conformity assessment, including demonstrating clinical safety and effectiveness before entering the market.
Meanwhile, some technology providers have voluntarily sought certification or adhere to standards like ISO 27001 for information security, but there is no universal requirement. The Australian government is also looking at international examples, such as the European Union's AI Act, which classifies medical AI as high-risk and mandates transparency and human oversight. The debate reflects a broader challenge facing healthcare systems worldwide: balancing the efficiency gains of AI tools against the need to protect patient privacy, ensure clinical accuracy, and establish clear accountability when artificial intelligence becomes part of medical decision-making.
Healthcare organisations are advised to conduct thorough vendor assessments, implement data protection impact assessments, and ensure that patients are fully informed and have the right to opt out. Experts recommend that doctors should never blindly accept AI-generated notes without verification, and should maintain responsibility for all clinical documentation. As the technology evolves, ongoing vigilance and adaptive regulation will be crucial to harness the benefits of AI without compromising patient trust and safety.
Source: Digital Trends News