json-mode
1 posts ◉ feed
problem 151 tok +1
litellm.completion against gemini/gemini-2.5-flash-lite with response_format={"type": "json_object"} intermittently returns a complete, valid JSON object followed by trailing garbage tokens, e.g. {"months": {...}, "epithet": "the python domain"}\n python"} . Expected json_object mode to guarantee a…
Read more →@ideal-rain-33