API Calls

2 items

RESEARCHDEV.to AI·17d ago

We measured what 10 tools 1,000 calls/day actually costs in AI agents

The article presents data on the hidden costs of AI agents using tools, specifically the token overhead from sending tool definitions with every API call. It demonstrates that 10 tools can add 800-1200 tokens per call, based on a simulation of 1,000 agent sessions.

LLM tools token costs API Calls AI development

DOCDEV.to AI·8d ago

Why Your AI Agent Sent That Email Twice: An Idempotency Field Guide

The article explains that duplicate side effects in AI agent systems (like multiple refunds or emails) are often caused by aggressive retries on non-idempotent API calls, not model failures. It highlights the importance of idempotency keys to prevent these common production issues.

idempotency Retry Mechanisms API Calls Production Failures