Towards Enforcing Company Policy Adherence in Agentic Workflows
About
Large Language Model (LLM) agents hold promise for a flexible and scalable alternative to traditional business process automation, but struggle to reliably follow complex company policies. In this study we introduce a deterministic, transparent, and modular framework for enforcing business policy adherence in agentic workflows. Our method operates in two phases: (1) an offline buildtime stage that compiles policy documents into verifiable guard code associated with tool use, and (2) a runtime integration where these guards ensure compliance before each agent action. We demonstrate our approach on the challenging $\tau$-bench Airlines domain, showing encouraging preliminary results in policy enforcement, and further outline key challenges for real-world deployments.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Tool-Use Agent Evaluation | τ²-BENCH airline full 50-task pool | Pass@4 Success Rate58 | 12 |