Rethinking LLMOps for Fraud and AML: Building a Compliance-Grade LLM Serving Stack

This research paper proposes a specialized LLMOps stack designed for fraud detection and anti-money laundering (AML) compliance, recognizing their distinct serving requirements compared to generic chat workloads. The stack integrates various advanced techniques to efficiently handle evidence-rich, schema-constrained prompts and ensure compliance-grade performance with self-hosted open-weight LLMs.