Utilizing External Reranker Models

Introduction

As of Layar 1.21 you have the option to use an external reranker for RAG workflows. In order to do so, you will need to have an accessible URL that allows access to the external reranker.

Configuration

1. SSH into the environment.
2. Run sudo -i
3. Run vim /data/layar/layar.config
4. Press i to start editing.
5. Add the following
   1. RERANKER_URL: 'http://host:port/rerank'
6. Restart the stack.