PCI DSS 4.0 legacy integration patterns for enterprise AI agents — Reference Architecture

Reference architecture · published 2026-10-16 · regulated enterprise · PCI DSS 4.0 · layout troubleshooting · implementation executed in CI before publish

The control that resolves this is an Idempotent System-of-Record Bridge, evaluated before the request reaches a model provider rather than audited afterwards. In regulated enterprise the binding constraint is PCI DSS 4.0, and the question it actually asks is is cardholder data in scope, and can you prove it is not. The specific problem here is mainframe integration. The shape below holds p95 ≤ 2400ms over outbound webhooks with signed payloads, and ships with a standard-library implementation that runs as written.

The architecture friction point

Agents can read the legacy estate and cannot safely write to it. A retry after a gateway timeout creates a duplicate posting, and in an ERP a duplicate journal entry is a finance incident. So the team that owns the system of record withholds write access, and the automation stalls at read-only.

What makes mainframe integration specifically hard

The mainframe is the system of record and its change window is measured in quarters. Anything that requires a change on that side is not an integration plan, it is a request to join a release queue.

What resolves it is a side-car integration that requires zero mainframe change. The failure to design against: a design whose first step is a CICS change nobody will schedule.

What PCI DSS 4.0 specifically requires

PCI scope is contagious: any system that stores, processes or transmits cardholder data — or can affect the security of one that does — is in scope. The cheapest control is to keep the model tier out of scope entirely.

The artifact that satisfies it is a segmentation test proving the model tier is out of scope. The way teams most often fail it: a PAN reaching a prompt log, dragging the whole inference tier into PCI scope.

Why this blocks a rollout rather than slowing it: The blocker is ownership risk, not capability. Until duplicate writes are structurally impossible and every field an agent can post is enumerated in a contract, no system-of-record owner will sign off — and they are right not to. In regulated enterprise the cost of getting it wrong is concrete — a failed Type II observation window restarts the clock.

What the auditor will ask

Implementation parameter matrix

Every value below is a parameter you can hold a vendor or an internal team to. Adjectives are not acceptance criteria.

Implementation parameters for this deployment shape
Deployment vectorOn-premises gateway adjacent to the system of record
Security standardPCI DSS 4.0
Applicable regimesSOC 2 Type II, ISO/IEC 27001:2022, GDPR
Latency SLAp95 ≤ 2400ms — interactive surfaces need sub-second; batch jobs do not
Integration protocoloutbound webhooks with signed payloads — the system of record pushes rather than being polled
Idempotency controla delivery id the receiver de-duplicates on
Throughput envelopebounded by the slowest receiver, so a DLQ is mandatory
Middleware requirementpolicy decision point in front of the model gateway
Data classes in scopePII, commercial-in-confidence data
Retention obligationper the data class retention schedule, enforced automatically
Data residencycontracted processing region, asserted on every response
Contractual instrumentDPA plus a disclosed subprocessor list
Systems of recordSAP, Salesforce, Workday
Primary failure modeat-least-once delivery handled as exactly-once by the consumer

Reference implementation — Idempotent write-back with a typed write contract

Standard-library Python, no external dependencies, runs as written. Executed by the publish gate: if it raises, this page does not ship. Wire it behind outbound webhooks with signed payloads; the failure mode it guards against is at-least-once delivery handled as exactly-once by the consumer. The output you hand the assessor is the segmentation test report.

"""Idempotent write-back adapter for a legacy system of record (SAP/ERP shape).

Why this shape: the blocker on legacy integration is almost never reading. It
is writing. An agent that retries a posting because a gateway timed out will
happily create a duplicate journal entry, and in an ERP a duplicate posting is
a finance incident, not a bug report.

Three controls make agent-driven writes acceptable to the team that owns the
system of record:
  * a deterministic idempotency key derived from business content
  * a claim table, so a retry observes the first attempt instead of repeating it
  * a bounded, typed projection, so the agent can never post a field it does
    not understand
"""
import hashlib
import json
import time
from dataclasses import dataclass


class DuplicatePosting(Exception):
    """Raised when a retry would create a second document for one intent."""


def idempotency_key(doc_type: str, business_keys: dict) -> str:
    """Derived from BUSINESS content, never from a uuid4.

    A random key makes every retry unique, which is the opposite of what
    idempotency means. Two attempts to post the same invoice must collide.
    """
    canonical = json.dumps({k: business_keys[k] for k in sorted(business_keys)},
                           sort_keys=True, separators=(",", ":"))
    return f"{doc_type}:" + hashlib.sha256(canonical.encode()).hexdigest()[:32]


ALLOWED_FIELDS = {
    "journal_entry": {"company_code", "posting_date", "currency",
                      "debit_account", "credit_account", "amount", "reference"},
}


def project(doc_type: str, payload: dict) -> dict:
    """Allow-list projection. An agent-proposed field that is not in the
    contract is dropped loudly, not posted hopefully."""
    allowed = ALLOWED_FIELDS.get(doc_type)
    if allowed is None:
        raise ValueError(f"no write contract defined for {doc_type!r}")
    unknown = set(payload) - allowed
    if unknown:
        raise ValueError(f"fields outside the write contract: {sorted(unknown)}")
    missing = allowed - set(payload)
    if missing:
        raise ValueError(f"write contract requires: {sorted(missing)}")
    return {k: payload[k] for k in sorted(allowed)}


@dataclass
class ClaimStore:
    """Stands in for a real transactional table. In production this is a row
    in the SAME database as your outbox, claimed with SELECT ... FOR UPDATE."""

    def __post_init__(self):
        self._claims: dict = {}

    def claim(self, key: str, ttl: float = 900.0) -> tuple:
        """-> (is_new, existing_result). Atomic in a real DB."""
        now = time.time()
        rec = self._claims.get(key)
        if rec and (rec["status"] == "done" or now - rec["at"] < ttl):
            return False, rec
        self._claims[key] = {"status": "in_flight", "at": now, "result": None}
        return True, None

    def complete(self, key: str, result: dict):
        self._claims[key] = {"status": "done", "at": time.time(), "result": result}

    def fail(self, key: str):
        self._claims.pop(key, None)      # let a genuine retry through


def post_document(store: ClaimStore, doc_type: str, business_keys: dict,
                  payload: dict, transport) -> dict:
    """The only sanctioned path from an agent to the system of record."""
    key = idempotency_key(doc_type, business_keys)
    body = project(doc_type, payload)

    is_new, existing = store.claim(key)
    if not is_new:
        if existing["status"] == "done":
            # The correct response to a duplicate is the ORIGINAL result.
            return {"idempotency_key": key, "replayed": True,
                    **existing["result"]}
        raise DuplicatePosting(f"{key} is already in flight")

    try:
        result = transport(doc_type, body, key)
    except Exception:
        store.fail(key)
        raise
    store.complete(key, result)
    return {"idempotency_key": key, "replayed": False, **result}


if __name__ == "__main__":
    calls = []

    def fake_sap(doc_type, body, key):
        calls.append(key)
        return {"document_number": f"50000{len(calls)}", "posted": True}

    store = ClaimStore()
    keys = {"invoice_id": "INV-8831", "company_code": "1000"}
    payload = {"company_code": "1000", "posting_date": "2026-10-16",
               "currency": "EUR", "debit_account": "400000",
               "credit_account": "113100", "amount": "14500.00",
               "reference": "INV-8831"}

    first = post_document(store, "journal_entry", keys, payload, fake_sap)
    retry = post_document(store, "journal_entry", keys, payload, fake_sap)
    print("first :", first["document_number"], "replayed", first["replayed"])
    print("retry :", retry["document_number"], "replayed", retry["replayed"])
    print("transport invocations:", len(calls), "(must be 1)")
    try:
        project("journal_entry", {**payload, "tax_code": "V1"})
    except ValueError as e:
        print("contract rejects unknown field:", e)

The PCI DSS 4.0 control, as code

PAN tokenisation and a scope-reduction proof. This is the artifact an assessor asks for under PCI DSS 4.0 specifically — it is not the same control as the one above, and a system that implements one does not thereby implement the other. It executes under the same publish gate.

"""PAN detection with tokenisation, and a scope-reduction proof.

PCI DSS 4.0 scope is everything that stores, processes or transmits account
data, plus anything connected to it. The cheapest compliance move is not better
controls — it is removing systems from scope. A model gateway that never sees a
PAN is out of scope; one that sees it once is in, along with everything it talks
to.
"""
import hashlib
import re

PAN_RE = re.compile(r"\b(?:\d[ -]?){12,18}\d\b")


def luhn_valid(digits: str) -> bool:
    total, parity = 0, len(digits) % 2
    for i, ch in enumerate(digits):
        d = int(ch)
        if i % 2 == parity:
            d *= 2
            if d > 9:
                d -= 9
        total += d
    return total % 10 == 0


class TokenVault:
    """Format-preserving surrogate. The vault is in scope; nothing it feeds is,
    provided the surrogate is not reversible outside it."""

    def __init__(self, pepper: str):
        self._pepper = pepper
        self._map: dict[str, str] = {}

    def tokenise(self, pan: str) -> str:
        digest = hashlib.sha256(f"{self._pepper}:{pan}".encode()).hexdigest()
        surrogate = "4" + str(int(digest[:15], 16)).zfill(15)[:15]
        self._map[surrogate] = pan
        return surrogate

    def last_four(self, pan: str) -> str:
        return pan[-4:]


class ScopeBoundary:
    def __init__(self):
        self.systems: dict[str, bool] = {}
        self.flows: list[tuple[str, str]] = []

    def add(self, system: str, sees_pan: bool) -> None:
        self.systems[system] = sees_pan

    def flow(self, src: str, dst: str) -> None:
        self.flows.append((src, dst))

    def in_scope(self) -> set[str]:
        scope = {s for s, sees in self.systems.items() if sees}
        changed = True
        while changed:                      # connected-to is also in scope
            changed = False
            for src, dst in self.flows:
                if src in scope and dst not in scope:
                    scope.add(dst); changed = True
                elif dst in scope and src not in scope:
                    scope.add(src); changed = True
        return scope


def redact(text: str, vault: TokenVault) -> tuple[str, int]:
    found = 0
    def _sub(m):
        nonlocal found
        raw = re.sub(r"[ -]", "", m.group(0))
        if not luhn_valid(raw):
            return m.group(0)
        found += 1
        return f"tok_{vault.tokenise(raw)}(last4={vault.last_four(raw)})"
    return PAN_RE.sub(_sub, text), found


if __name__ == "__main__":
    vault = TokenVault(pepper="hsm-managed")
    text = "Charge card 4111 1111 1111 1111 for invoice 9912, ref 1234567890123456"
    out, n = redact(text, vault)
    assert n >= 1 and "4111 1111 1111 1111" not in out, out
    assert "last4=1111" in out, out

    # A number that fails Luhn is not a PAN and must not be mangled.
    benign, n2 = redact("order 1234 5678 9012 3450 placed", vault)
    assert n2 == 0 and "1234 5678 9012 3450" in benign, benign

    sb = ScopeBoundary()
    sb.add("checkout", True); sb.add("token_vault", True)
    sb.add("llm_gateway", False); sb.add("analytics", False)
    sb.flow("checkout", "token_vault"); sb.flow("token_vault", "llm_gateway")
    scope = sb.in_scope()
    assert "llm_gateway" in scope, "connected-to is in scope — that is the point"

    clean = ScopeBoundary()
    clean.add("checkout", True); clean.add("token_vault", True)
    clean.add("llm_gateway", False)
    clean.flow("checkout", "token_vault")
    assert "llm_gateway" not in clean.in_scope(), clean.in_scope()

    print("PCI DSS 4.0 tokenisation + scope reduction: OK")
    print(f"  PANs tokenised {n}, naive scope {len(scope)} systems, "
          f"segmented scope {len(clean.in_scope())} systems")

The request path

Idempotent System-of-Record Bridge — the request path, with the decision points that must exist before the first model call:

flowchart LR
    AG[Agent] --> PR[Projection<br/>allow-listed fields]
    PR -->|unknown field| REJ[Reject - loud]
    PR --> IK[Idempotency key<br/>sha256 of business keys]
    IK --> CL{Claim table}
    CL -->|already done| RP[Replay original result]
    CL -->|in flight| DUP[Refuse duplicate]
    CL -->|new| OB[(Outbox)]
    OB --> TR[Transport - OData / IDoc / RFC]
    TR --> SOR[(System of record<br/>SAP / ERP / AS400)]
    SOR --> RC[Reconciliation]
    RC -->|drift| CMP[Compensating action]
Request path. Rendered as a diagram where scripting is available; the Mermaid source above is the authoritative definition either way.

Risk mitigation matrix

Each row carries an acceptance parameter rather than an adjective, because "low latency" cannot be signed off. Retention here is bound by per the data class retention schedule, enforced automatically.

CategoryRiskControlAcceptance parameter
PCI DSS 4.0A PAN in a prompt pulls the inference tier into PCI scopeTokenise before the model boundary and prove segmentation with a penetration test at least annuallySegmentation test passes; 0 PANs detected in prompt or completion stores by continuous scanning
mainframe integrationIntegration requires a change inside the mainframe release windowConfine all new logic to the side-car; treat the mainframe interface as immutable0 mainframe-side changes required to ship; verified in design review
OperationalRetry after timeout creates a duplicate documentBusiness-content idempotency key plus a transactional claim; retries replay the original resultInduced timeout + retry produces 1 document and 1 transport call
OperationalAgent posts a field nobody contracted forAllow-list projection per document type; reject unknown and require complete fields0 writes containing fields outside the contract; enforced in tests
OperationalCrash mid-flight leaves an ambiguous stateDurable outbox written before transport; reconciliation resolves on restartKill-during-post leaves 0 ambiguous records after reconciliation
Data privacyLegacy extracts pull more fields than the use case needsProjection on read as well as write; field-level justification recordedExtract schema matches the documented minimum field set
Latency SLASynchronous legacy calls stall the agent loopAsync submit with a claim handle; agent polls or is called backAgent p95 independent of the system-of-record response time
Cost controlRe-extracting the full estate on every runChange-data capture or a watermark; full extract only on schema changeIncremental run under 10% of full-extract cost
OperationalNo defined reversal for a wrong postingA compensating action per document type, rehearsed in a sandbox clientEvery writable document type has a tested reversal path

Implementation components

  1. Content-derived idempotency key — Derived from business keys, so two attempts at one intent collide.
  2. Claim table — Transactional claim in the same database as the outbox; a retry observes the first attempt.
  3. Typed write contract — Allow-listed fields per document type; unknown fields are rejected loudly.
  4. Outbox — Durable intent record, so a crash mid-flight is recoverable rather than ambiguous.
  5. Reconciliation job — Compares posted documents against intents and surfaces drift.
  6. Compensating action — A defined reversal path per document type, because some writes must be undoable.

See also

Enterprise infrastructure review

If you are carrying this blocker, the useful next step is not a demo. It is a review of your actual request path against the control points above:

  • Which of the 6 components exist in your estate today, and which are assumed
  • Your current numbers against the 7 acceptance parameters, starting with p95 ≤ 2400ms
  • Which PCI DSS 4.0 control questions you cannot yet answer, and what closes each gap
Request an architecture review