Skip to main content

Feature Request: Add Cross-Encoder Reranking Support via /rerank or /score Endpoint

It would be great to have native support for reranking in the Nebius AI API, especially for use in retrieval-augmented generation (RAG) or semantic search workflows.

See https://docs.vllm.ai/en/latest/serving/openai_compatible_server.html for the /rerank and /score API.

  • Add a dedicated endpoint for reranking such as the /score or the /rerank endpoind.

  • Add cross-encoder models to the available model library

2 comments

Log in to comment and vote

Comments2