Before You Approve AI in Healthcare or Government, Ask These 4 Questions

There are two unhelpful stories I frequently hear about AI in healthcare and government.

The first story is that this is easy. Buy a license. Turn it on. Tell everyone not to paste sensitive information into the chat box. Done.

The second story is that this is impossible. The regulations are too strict. The acronyms are too dense. Legal will say no. Security will say no. Better to wait.

Both stories miss the point.

Deploying AI in these environments is not like flipping on a new calendar app. It is more like renovating a hospital wing. You are not just picking the paint color. You are checking the locks, the badge access, the records room, the cameras, the policies, and who is allowed through which door.

That sounds heavy, but it should also be reassuring. This doesn’t require magic. It requires governance. And governance is something your organization already knows how to do.

Who This Article Is For

This article is written for healthcare executives, government agency leaders, and program managers who are being asked to approve, fund, or oversee AI initiatives. You do not need a technical background to use it. You need enough context to ask the right questions of the people who do.

TL;DR

The four questions you should ask your technical leaders:

  1. Which AI tools have a signed BAA or FedRAMP authorization in place?
  2. Which of our data is the AI actually able to access, and how is that controlled?
  3. Where are the logs, and who reviews them?
  4. What happens if an employee uses a non-approved AI tool with patient or citizen data?

If your team can answer all four clearly, you are probably in good shape. If the answers are vague or inconsistent, that is the gap to close before you go further.

Help Me With the Acronym Soup

Before going further, let’s translate the language that makes this conversation feel more intimidating than it needs to be.

PHI (Protected Health Information) is any data that can identify a patient and relates to their health: names tied to diagnoses, insurance records, test results, appointment histories. Federal law requires that PHI be handled with strict controls.

PII (Personally Identifiable Information) is the broader category: any data that could identify a specific person. Social Security numbers, addresses, government ID numbers. Both federal and state laws govern how PII can be stored and shared.

HIPAA (Health Insurance Portability and Accountability Act) is the federal law that sets the rules for how health information must be protected. If your organization touches patient data, HIPAA applies to you and to every vendor you share that data with.

A BAA (Business Associate Agreement) is a contract. When your organization shares PHI with a vendor (say, a cloud provider or an AI tool), HIPAA requires that vendor to sign a BAA promising to handle that data responsibly. No signed BAA means no legal basis for sharing PHI with that vendor. Full stop.

FedRAMP (Federal Risk and Authorization Management Program) is the federal government’s stamp of approval for cloud services. Think of it as a security audit that vendors go through so that government agencies don’t have to audit every vendor themselves.

Leaders do not need to become experts in every one of these terms. They just need to hold on to the question underneath all of them: can this vendor handle our information in a way that matches the seriousness of our environment?

“Just Tell People Not to Paste Sensitive Data In”

A lot of AI conversations start with the software equivalent of, “How hard could it be?”

Someone sees a polished demo. A chatbot summarizes documents in seconds. It all looks smooth, and the assumption becomes: if the tool is this easy to use, it must be easy to deploy safely.

That is like admiring a beautiful hotel lobby and assuming the building has no boiler room, security desk, or fire code to worry about.

A premium license does not turn AI into a compliant system. A BAA is not automatic. Government authorization is not automatic. And the phrase “enterprise AI” often hides an important follow-up question: enterprise version of which product, exactly, covering which features?

The deeper problem is what happens once you connect the tool to internal documents. That is where the “just be careful” approach fully breaks down.

Saying “the AI should not see sensitive information” after enabling document access is like handing a contractor a master key and then acting surprised when they can open the doors. The tool is designed to read the files it is given access to. That is the feature. The question is not whether the AI will see sensitive information. The question is whether it sees the right information, under the right permissions, with the right safeguards in place.

“AI Is Off the Table” Is Also Outdated

The opposite mistake is treating regulation as a permanent stop sign.

The major cloud providers have spent the last several years building real pathways for regulated AI. Microsoft, Google, and AWS now offer AI services that operate inside FedRAMP-authorized and HIPAA-eligible environments, with BAAs available, data kept out of model training by default, and audit logs your compliance team can actually use. This was not true three years ago. It is true now.

The right answer is no longer “AI is off the table.” The right answer is “show me the approved path.”

That is a much better question for leadership to ask. Not: “Can we use AI?” But: “Under what conditions can we use AI responsibly?”

Think of AI as a Very Fast New Employee

Here is the clearest way to hold all of this in your head at once.

AI is like a very fast new employee. It can read quickly. Write quickly. Summarize quickly. Find patterns quickly. But it has no instinct for what is legally restricted, politically sensitive, or operationally off-limits unless someone builds those boundaries around it.

So the real job is not deciding whether to hire the employee. The real job is deciding which rooms they can enter, which files they can open, whether they are supervised, what gets recorded, and what kind of work they are allowed to do on their own.

That is why this is neither easy nor impossible. It is manageable, but only for organizations willing to manage it.

The Questions That Separate a Strategy from an Accident

The most effective leaders in this space are not the ones who memorize every compliance term. They are the ones who keep the conversation honest. They know the difference between a demo and an operating model. They know that if a team cannot explain the data boundary in plain language, the design is probably not mature enough yet.

Green-light uses that organizations are doing responsibly right now: searching internal policy documents, drafting patient education materials with human review before anything goes out, summarizing internal memos inside a covered environment.

Red-light uses that require much more caution: fully automated clinical decisions, benefits eligibility determinations without human review, any system where nobody is sure which data the AI is actually reading.

When evaluating any AI initiative, a leader can ask four plain questions of their IT and legal teams:

  1. Which AI tools have a signed BAA or FedRAMP authorization in place?
  2. Which of our data is the AI actually able to access, and how is that controlled?
  3. Where are the logs, and who reviews them?
  4. What happens if an employee uses a non-approved AI tool with patient or citizen data?

These are not technical questions. They are management questions. And they are often the difference between an AI strategy and an AI accident.

If your team can answer all four clearly, you are probably in good shape. If the answers are vague or inconsistent, that is the real risk, not AI itself.

AI in regulated environments is a bounded-yes problem. The boundary is the work. And the organizations that get there first are the ones willing to ask the right questions now.

Provider Comparison Table (illustrative, May 2026)

Provider Healthcare path Government path Gotchas Best fit when…
Microsoft Azure OpenAI is available through Microsoft’s HIPAA / BAA framework for eligible services, and Microsoft 365 Copilot can fit into the same broader compliance story for covered tenants. Azure OpenAI is available in Azure Government with strong federal authorization pathways, including FedRAMP High and DoD environments. Not every feature is covered, and compliance is not “on” just because you bought an enterprise license. Best when an organization already lives in Microsoft 365 and wants AI to stay inside an environment their teams already govern.
OpenAI BAAs are available for certain API, enterprise, and healthcare offerings. OpenAI now has a government story as well, including FedRAMP Moderate offerings and ChatGPT Gov patterns. Public ChatGPT is not the same as a governed enterprise deployment, and feature scope matters. Best when organizations want a strong front-end experience but are willing to be disciplined about contracts, features, and access boundaries.
AWS AWS supports HIPAA through its BAA plus HIPAA-eligible services such as Bedrock, HealthLake, and Comprehend Medical. AWS GovCloud and Bedrock now offer a real path for FedRAMP High and IL4 / IL5 use cases. “HIPAA-eligible” still requires the customer to design and govern the environment correctly. Best for organizations that want maximum control and are comfortable building a governed AI environment in the cloud.
Google Google Cloud and Workspace now have meaningful HIPAA-covered paths for Vertex AI, Gemini in Workspace, and healthcare-focused cloud services. Google also has a growing government story through Assured Workloads and FedRAMP-authorized AI services. Consumer Gemini, AI Studio, NotebookLM, and some Gemini surfaces are not the same as compliant enterprise or government deployments. Best for organizations already standardized on Google Workspace or Google Cloud that want AI close to their documents and collaboration tools.
Anthropic Anthropic offers BAA-ready paths for some enterprise and API customers, and Claude can also sit inside cloud-provider compliance boundaries through Bedrock and Vertex AI. Claude is also available through approved government-oriented cloud environments such as AWS GovCloud and Vertex AI. The direct consumer experience is not the same thing as a covered regulated deployment. Best when organizations want Claude’s model quality but prefer to consume it through AWS or Google’s compliance boundary.

Note: This is a high-level snapshot, not a compliance determination. Coverage, authorizations, and feature scope vary by product and deployment model, and should be validated directly with the vendor before any regulated use.

Sources

Note: Sources were compiled using AI-assisted research and then manually checked for link accuracy, title accuracy, and general relevance. Official vendor documentation was prioritized where available. Because product scope, authorizations, and terms can change, readers should confirm current details directly with the vendor before making compliance or procurement decisions.

  1. Azure AI BAA/HIPAA Compliance – Microsoft Q&A
  2. Health Insurance Portability and Accountability Act (HIPAA) & Health …
  3. Health Insurance Portability and Accountability Act (HIPAA) & Health …
  4. Azure OpenAI, including GPT-4o, Approved as a Service within the …
  5. Azure OpenAI now authorized as a service at DoD IL4 and IL5
  6. Azure OpenAI Service now authorized for all U.S. Government data …
  7. Azure OpenAI Data Retention Privacy 2025 – Microsoft Q&A
  8. Azure OpenAI: data management and Abuse Monitoring – Microsoft Q&A
  9. Azure OpenAI Hipaa Compliance Status – Microsoft Q&A
  10. HIPAA Compliance for Microsoft Azure: BAA, Covered Services, and …
  11. Microsoft 365 Copilot data protection architecture
  12. Enterprise data protection in Microsoft 365 Copilot and Microsoft …
  13. How can I get a Business Associate Agreement (BAA) with OpenAI …
  14. Business data privacy, security, and compliance
  15. ChatGPT for Healthcare
  16. Enterprise privacy at OpenAI
  17. Security and privacy at OpenAI
  18. AWS Bedrock HIPAA Eligible BAA- Secure AI for Healthcare
  19. AI-powered patient profiles using AWS HealthLake and Amazon Bedrock …
  20. Secure Gen AI Apps – Amazon Bedrock Security and Privacy – AWS
  21. Is ChatGPT HIPAA Compliant? – BastionGPT
  22. Is OpenAI HIPAA Compliant? – Arkenea
  23. Is OpenAI HIPAA-Compliant? – Community – OpenAI Developer Community
  24. HIPAA Compliance – Amazon Web Services (AWS)
  25. HIPAA Eligible Services Reference – Amazon Web Services (AWS)
  26. AI Assistant for Enterprise
  27. Amazon Q Business is now HIPAA eligible – AWS
  28. FHIR Storage and Interoperable Health Data Standards
  29. Healthcare NLP – Extract Health Data – Amazon Comprehend Medical – AWS
  30. Amazon Transcribe Medical
  31. AWS HealthScribe – Amazon Transcribe
  32. Compliance – AWS GovCloud (US)
  33. How AWS Complies with FedRAMP for U.S. Agencies – Aquasec
  34. Amazon Bedrock achieves FedRAMP High authorization – AWS
  35. Amazon Bedrock models get FedRAMP High and DoD IL-4/5 approval …
  36. Accelerating government innovation: Amazon Bedrock models get FedRAMP …
  37. Amazon Bedrock in AWS GovCloud (US) – AWS GovCloud (US)
  38. HIPAA Compliance – Amazon Web Services (AWS)
  39. Archived Architecting for HIPAA Security and Compliance on Amazon …
  40. AWS Shared Responsibility Model: Healthcare Compliance Tips
  41. How to Get a BAA with AWS: Steps, Requirements, and Covered HIPAA …
  42. Secure Gen AI Apps – Amazon Bedrock Security and Privacy – AWS
  43. Security best practices to consider while fine-tuning models in …
  44. Data protection – Amazon Bedrock
  45. HIPAA compliance for generative AI solutions on AWS
  46. AI-powered patient profiles using AWS HealthLake and Amazon Bedrock …
  47. HIPAA – Compliance
  48. HIPAA Compliance on Google Cloud
  49. US Data Boundary for Healthcare and Life Sciences
  50. Overview of the Cloud Healthcare API
  51. HIPAA Included Functionality
  52. Generative AI in Google Workspace Privacy Hub
  53. FedRAMP implementation guidance on Google Cloud
  54. Vertex AI Search and Generative AI on Vertex AI achieve FedRAMP …
  55. Vertex AI Search and Generative AI on Vertex AI achieve FedRAMP …
  56. Is Gemini HIPAA Compliant? 2026 Guide (BAA, Workspace, Vertex AI, …
  57. Is Gemini HIPAA Compliant? 2026 Guide (BAA, Workspace, Vertex AI, …
  58. VPC Service Controls
  59. Overview of VPC Service Controls
  60. Use Private Service Connect to access Generative AI on Vertex AI …
  61. Customer-managed encryption keys (CMEK)
  62. HIPAA Compliance on Google Cloud
  63. HIPAA Compliance for Amazon Web Services (AWS): Requirements, BAA, …
  64. Claude in Amazon Bedrock: Approved for Use in FedRAMP High and …
  65. Claude on Google Cloud’s Vertex AI: FedRAMP High and IL2 Authorized …
  66. Claude in Amazon Bedrock: Approved for Use in FedRAMP High and …
  67. Public Sector FAQs
  68. HIPAA Compliance for Cloud Computing: AWS, Azure & Google Cloud …
  69. HIPAA Compliance in Cloud Shared Responsibility
  70. HIPAA Business Associate Agreement (BAA) Compliance Guide
  71. HIPAA-Compliant Cloud Architecture: AWS vs Azure vs GCP …
  72. Exploring Certified FedRAMP Cloud Service Providers
  73. The FedRAMP Frontier: How AWS GovCloud Is Reshaping Secure Data …
  74. HIPAA Compliance – Amazon Web Services (AWS)
  75. AI Assistant Privacy and Security Comparison
  76. AI Data Classification: What Is Safe for ChatGPT & Copilot
  77. How do I protect my business data when using AI? – CG Technologies
  78. Gemini Apps Privacy Hub – Gemini Apps Help
  79. Compliance and security controls
  80. LLM and data privacy: are they training on your data?
  81. AWS GovCloud in Government: Adoption, FedRAMP VDRs, and Compliance: …
  82. r/FedRAMP on Reddit: Do We Have to Use AWS GovCloud for FedRAMP High?
  83. GDPR Compliance Showdown: A Side-by-Side Comparison of Microsoft …
  84. Data Privacy Considerations – Generative AI Tools for Students …
  85. Why FedRAMP Adherence Matters for AI in Government—and How …
  86. FedRAMP High authorization for Vertex AI Vector Search, Looker …
  87. HIPAA Compliance with Google Workspace and Cloud Identity
  88. Generative AI in Google Workspace Privacy Hub
  89. Zero data retention in the Gemini Developer API
  90. Gemini Enterprise Agent Platform and zero data retention
  91. Abuse monitoring
  92. What data are you feeding into AI tools, and why it matters
  93. The Great AI Privacy Divide: Claude, ChatGPT, Gemini, and Copilot …