Feature Request: Add Cross-Encoder Reranking Support via /rerank or /score Endpoint

It would be great to have native support for reranking in the Nebius AI API, especially for use in retrieval-augmented generation (RAG) or semantic search workflows.

See https://docs.vllm.ai/en/latest/serving/openai_compatible_server.html for the /rerank and /score API.

  • Add a dedicated endpoint for reranking such as the /score or the /rerank endpoind.

  • Add cross-encoder models to the available model library

Please authenticate to join the conversation.

Upvoters
Status

In Review

Board

💡 Feature request

Tags

Other

Date

10 months ago

Author

llschutte

Subscribe to post

Get notified by email when there are changes.