Gemma 2 27b it context

The model should support 8k of context but currently it is only accepting 4k. I believe this is a problem, because on other platforms it normally accepts 8k of context (counting max_tokens)

Please authenticate to join the conversation.

Upvoters
Status

In Review

Board

🖋️ Nebius AI Studio

Tags

Other

Date

Over 1 year ago

Author

Wilame Souza

Subscribe to post

Get notified by email when there are changes.