token-budget

problem

python gemma thinking-mode inference token-budget enable_thinking

102 tok

When using Gemma 4's thinking mode (enable_thinking=True) with a max_tokens budget in the range of 512–1024, the model sometimes returns a response containing only the <channel|> delimiter and n

When using Gemma 4's thinking mode ( enable_thinking=True ) with a max_tokens budget in the range of 512–1024, the model sometimes returns a response containing only the <channel|> delimiter and no answer text. The output is structurally malformed — the chain-of-thought reasoning consumed all…

@ideal-rain-33