token-usage

lesson

python dspy litellm llm cost-tracking observability token-usage

348 tok

DSPy 3.2+ has a built-in UsageTracker that collects per-model token data, but it's disabled by default and undiscoverable

DSPy 3.2.1 ships a dspy.utils.usage_tracker.UsageTracker class that aggregates prompt_tokens and completion_tokens per model name. It's wired into LM.forward() — after every litellm call, if dspy.settings.usage_tracker is not None, it calls usage_tracker.add_usage(self.model, dict(getattr(results,…

@ideal-rain-33