Yes. A bank can use AI and keep customer data in-region, but in-region has to cover the whole workflow, not just stored files. Check where prompts are processed, where answers and logs land, who can access them, and what happens during failover. Choose a deployment only after that data path is clear.
Why does data residency matter for banks using AI?
Because the bank stays accountable for customer information even when an AI vendor or cloud provider handles part of the work. A regional storage setting is only one control. The bank has to know where data is processed, who can reach it, and which party owns each safeguard, a responsibility the FFIEC's statement on cloud computing makes clear.1 It is also what bankers worry about most: in a 2026 survey of 17 community banks, 55% of respondents named security and data leakage as their top AI challenge.2
Picture a banker summarizing a customer file. The file may stay in the bank's cloud account while an excerpt travels to a model, an answer comes back, and a log is saved. Each step can have its own location and retention settings. Microsoft's documentation, for example, keeps stored data in the chosen geography, while prompts sent to a "Global" deployment may be processed in any Azure region.3 "Stored in-region" does not prove the whole workflow stays there.
So define the boundary first: one cloud region, one country, or a wider geography. Then trace source records, prompts, outputs, logs, backups, failover, support access and subcontractors. If one step crosses the boundary, a regional label can't settle the question. Recheck the map whenever a provider changes its model, routing, logging or failover setup.
What are the main deployment options?
There are three practical routes: a vendor-operated service with a regional commitment, an AI application in the bank's own cloud environment, or infrastructure on premises. The real question is who controls each part of the data path and who maintains it.
| Vendor-operated, regional commitment | In the bank's cloud | On premises | |
|---|---|---|---|
| What the bank controls | Vendor choice, contract terms, user access and available settings; the vendor runs the service | More of the application, identity, configuration and data settings; the cloud provider runs the infrastructure | Hardware, network and most operational settings, if the full workflow really runs there |
| What to check | Does the commitment cover processing, logs, backups, failover, support access and subcontractors? | Do managed model calls or connected services cross the boundary? Who owns each security control? | Are there external model calls or remote support paths? Can the bank keep up security, capacity and recovery? |
| Cost and speed | Fastest to start and no hardware; usage fees, vendor review and contract oversight remain | Moderate setup; more flexibility, plus engineering and ongoing cloud operations for the bank | Slowest to start; the bank buys, houses, staffs and scales the hardware |
"Private cloud" doesn't necessarily mean on premises. NIST's definition allows a private cloud to sit on or off premises and to be run by the organization, a third party, or both.4 Ask where each workload actually runs and who owns the controls; the label isn't an answer.
What should a bank be ready to show examiners and auditors?
A decision trail: what the AI does, how customer data moves, who owns the controls, and how those controls are tested over time. Interagency guidance on third-party relationships calls for oversight scaled to the activity and its risk, including "ongoing monitoring throughout the duration of a third-party relationship."5 This is a practical evidence list, not an examiner script.
- Purpose and risk: the task, the customer data it uses, and what happens if the AI is wrong or unavailable.
- Data path: where records, prompts, outputs, logs and backups are stored and processed, including failover, subcontractors and any geographic terms in the contract.
- Access and ownership: who can see data or change settings, including provider staff, and which controls the bank operates itself.
- Evidence: due diligence, relevant audit reports, tests and monitoring records. Confirm each audit report covers the service and controls the bank relies on.
- Incidents and exit: how the bank detects problems, restores service, and retrieves or deletes its data if it changes providers.
A data-flow diagram, the vendor's terms and day-to-day operating evidence should all support the same conclusion.
Where should a bank start with an AI pilot?
Start where no customer data is at risk. Point the AI at the bank's internal policies first. Once you've confirmed data stays in-region, move to one approved task where the AI reads customer documents but can't change them, with staff reviewing every output.
| Stage 1: policy search | Stage 2: one customer-document task | |
|---|---|---|
| Data used | Internal policies and procedures | Approved customer files, read-only |
| What the AI does | Answers questions, like the callback procedure for an outgoing wire, citing the exact policy section | Drafts a summary of a borrower's financial statements for a credit analyst, or flags gaps |
| Who checks it | The person asking, against the cited policy | The staff owner of the task, every time |
| Move on when | The data path, logs and access controls match the map | Reviewers' corrections are logged and the error pattern is understood |
Why stage it? The revised model risk guidance from the Federal Reserve, OCC and FDIC, SR 26-2 (April 17, 2026, replacing SR 11-7), leaves generative and agentic AI out of scope and says a bank's own risk management and governance should set the controls for those tools.6 For the models it does cover, it warns that "using a model beyond its intended purpose introduces additional uncertainty and risk." That principle is worth borrowing: each expansion, whether a new document type, a new team or write access, gets its own review.
How does a bank scale AI without losing track of customer data?
Write the data boundary down once, then add one workflow at a time inside it. Score each workflow on two things: how accurate its outputs are, and whether the controls held. Expand only after the people who approved the pilot have reviewed that evidence.
Put the boundary on one page. Which regions data may sit in. Which systems the AI can read from, and which it can never write to. Which kinds of data are allowed. Who can see prompts and logs, and how long logs are kept. Anything a new idea needs that the page doesn't allow goes back to risk and compliance before anyone builds it.
Add workflows in order of data sensitivity. A sensible order for most banks:
- Internal knowledge: policy and procedure search, with no customer data.
- Read-only customer documents: checking files for missing items or summarizing them for a reviewer.
- Drafting for staff: a first draft of a credit memo or exception report that an analyst edits and signs.
- Anything that writes to a system of record: last, and always with a person approving each change.
Keep two scorecards from day one. A workflow can be accurate and still fail review because nobody can prove where its data went. Agree on the pass mark with your risk team before the pilot starts, not after you've seen the results.
| What to measure | Evidence to keep | Who reviews it | |
|---|---|---|---|
| Accuracy | How often reviewers change or reject outputs, and why | A sample of outputs checked against the reviewer's final version | The business owner, such as the credit or operations lead |
| Controls | Data stayed in-region, access matched permissions, no writes outside scope | Logs, access reviews, incident records | Information security and compliance |
| Ongoing | Accuracy and controls still hold months later | Quarterly re-checks on a fresh sample | Risk management and internal audit |
Expand only after the review signs off. The gate to the next workflow is a meeting with a packet: the boundary page, both scorecards, and anything that went wrong and how it was fixed. If the packet is thin, the answer is not yet. The same interagency guidance is clear that using a third party "does not diminish" the bank's own responsibility.5 For a shared vocabulary, NIST's voluntary AI Risk Management Framework, released in January 2023 and now being revised, groups this work into four functions: govern, map, measure and manage.7
How does Soren help a bank scale this way?
Soren AI's engineers embed with your team, so the people who built the pilot are the ones who put together the review packet and answer your risk team's questions. We build into the systems you already run, like Fiserv or Jack Henry cores and nCino, instead of moving your data somewhere new, which keeps the boundary page short. We've shipped cloud, on-premises and hybrid deployments.
We also stay after launch, so the quarterly re-checks aren't handed to someone who has never seen the workflow. Your staff approve every output and make every decision; we make sure there's evidence that they did. More on the model in how we work, and on our work with banks and credit unions.
Map your data boundary with us
Start with a 30-minute call with our team. We'll walk through one workflow and where its data would need to stay.
Frequently asked questions
Can a community bank use ChatGPT at all?
Yes, for work that doesn't involve customer data, under an enterprise agreement with retention and training settings configured and reviewed by risk and compliance. Putting customer information into a consumer chatbot is different: no bank contract covers it, and the bank couldn't show an examiner where that data went.
What does "in-region" actually guarantee?
Often only where data is stored. Processing, logs, backups, failover and support access can each sit somewhere else unless the contract and settings say otherwise. Ask the vendor about each step separately, get the answers in writing, and recheck them whenever the provider changes its models or routing.
Do we need our own GPUs to keep data in-region?
No. Only an on-premises deployment needs the bank's own hardware. A vendor service with a regional commitment, or a model running in the bank's own cloud account, can keep data in-region without the bank buying or running GPUs, as long as every step of the data path stays inside the boundary.
Does SR 26-2 apply to generative AI?
Not directly. The April 2026 model risk guidance from the Federal Reserve, OCC and FDIC leaves generative and agentic AI out of its scope. It says a bank's own risk management and governance should set the controls for those tools, so banks still need a documented process for approving and monitoring them.
Sources
- Joint Statement on Risk Management for Cloud Computing Services, FFIEC, April 2020
- Survey Results: 2026 AI Adoption & Maturity in Banking, Wolf & Company, May 2026
- Azure OpenAI deployment types, Microsoft Learn, updated August 2026
- SP 800-145: The NIST Definition of Cloud Computing, NIST, 2011
- Interagency Guidance on Third-Party Relationships: Risk Management (SR 23-4), June 2023
- SR 26-2: Revised Guidance on Model Risk Management, Federal Reserve, OCC and FDIC, April 2026
- AI Risk Management Framework, NIST


