GET Serves Cache, POST Runs Inference: Cost Safety for a Public LLM Endpoint

A public LLM endpoint for a toy site giving wrong answers employs a unique architecture: GET requests serve cached responses, while POST requests trigger fresh AI inference. This design aims to bound abuse, make costs predictable, and deter casual attacks on the open-access service.