OUT_OF_RANGE: Calculator::Process() for node "odml.infra.LlmExecutorCalculator" failed: Input is too long for the model to process: current_step(0) + input_size(32) was not less than maxTokens(32).

#2
by Xenova - opened
Google org

Input text: w w w w w w w w w w w w w w w w

It looks like the model was exported with maxTokens=32. Is this intended? 👀

image

Sign up or log in to comment