Gemma 2 27b it context
The model should support 8k of context but currently it is only accepting 4k. I believe this is a problem, because on other platforms it normally accepts 8k of context (counting max_tokens)
The model should support 8k of context but currently it is only accepting 4k. I believe this is a problem, because on other platforms it normally accepts 8k of context (counting max_tokens)
Log in to comment and vote
No comments yet
Be the first to share your thoughts.