3 Things I Learned Benchmarking Claude, GPT-4o, and Gemini on Real Dev Work

This article details a benchmark comparing Claude 3.5 Sonnet, GPT-4o, and Gemini 2.0 Flash on five real-world developer tasks, using PromptFuel to measure token usage and cost. It highlights that relying on gut feeling for LLM selection can be costly and presents initial findings on performance beyond just speed.