arXiv AI By Vivek Acharya

The Two-Ledger Model: Transaction-Grain Cost Accounting for Multi-Agent AI Systems Across Clouds, Models, and Systems of Record

Read the original on arXiv AI →

The Flow has not summarised this story yet — read it at arXiv AI.

arXiv AI
Oct 9

TokenBank: Financial Infrastructure for AI Services

TokenBank is a financial infrastructure that uses structured contracts to manage the financial relationship between AI service operators and their users. The contracts cover service‑consumption rights, cash settlements for API‑price differences, financing based on future revenue, and protection claims for specified service failures. Evaluation on nearly 900,000 API requests shows that forwards can reduce average expenditure while increasing variability, and that financing can yield positive contributions under certain capital conditions.

By Cary Chang, Jialin Zhou
arXiv AI
Oct 31

Beyond LLM Wrappers: Context Engineering and the Three-Engine Architecture for Reliable Financial AI

The paper proposes a three‑engine architecture for reliable financial AI, combining a financial knowledge graph, a deterministic optimization engine, and a multi‑agent LLM layer. A coordination layer called context engineering selects and validates query‑specific context from ERP systems and other tools. Observations from 15 deployments show that multi‑agent validation reduces hallucination rates to below 1%, while reusable mappings and templates cut deployment time from six to two weeks.

By Pradeep Kumar GS, Ravi Tanniru
Hugging Face Trending Papers
Oct 29

Beyond LLM Wrappers: Context Engineering and the Three-Engine Architecture for Reliable Financial AI

The paper proposes a three‑engine architecture for reliable financial AI, combining a financial knowledge graph, a deterministic optimization engine, and a multi‑agent LLM layer. A coordination layer called context engineering selects and validates context from ERP systems, tools, and tenants to ensure numerical accuracy, traceability, and auditability. Observations from 15 deployments show that graph‑backed multi‑agent validation can reduce hallucination rates from 7‑9% to below 1%, while reusable mappings and validation policies cut deployment time from six to two weeks.

arXiv AI
Jul 16

Inference Economics of Enterprise Coding Agents: A Case Study of Cloud vs. On-Premise LLMs

arXiv:2607. 13080v1 Announce Type: cross Abstract: Autonomous coding agents force engineering organizations to choose between API-based frontier models -- strong reasoning at high token cost -- and on-premise quantized open-weights models, which promise low-marginal-cost scaling and data sovereignty at some loss of reasoning fidelity.

By Sheng-Wei Peng, Yi-Hsun Lin, Yi-Pei Lee
arXiv AI
Oct 27

Governing Enterprise AI Traffic at Scale: Design and Operation of a Policy-Driven, Multi-Vendor LLM Gateway on Envoy

The paper describes the Cosmos LLM Gateway, a policy‑driven, multi‑vendor gateway built on Envoy that manages enterprise LLM traffic at PayPal. It separates latency‑sensitive control decisions into an external service while handling wire‑format translation and token metering in‑proxy via a Rust WebAssembly filter, ensuring minimal overhead. Governance is declarative, managed through Open Policy Agent, and includes features like data‑loss‑prevention, budget scopes, and a control plane for role‑scoped authoring and approvals. The gateway currently serves over 12,000 developers, processes roughly 200 billion tokens per day across 100+ models, and maintains 99.999% availability with only a few milliseconds of added latency.

By Mithun Sasidharan, Srinivasan Manoharan, Rupesh Thakur, Abhinav TK, Ashwin Hegde, Anand Gautam