Utilizing Custom Reranker Models

Introduction

As of Layar 1.21 you have the option to use an external reranker for RAG workflows. In order to do so, you will need to have an accessible URL that allows access to the external reranker.

Configuration

1. SSH into the environment.
2. sudo -i
3. cd /data/vyasa-volumes/
4. ls and look for the "certara-model-server-pvc"
5. cd model-server-pvc-name
6. cd data/custom_rerankers/
   1. If the custom_rerankers folder doesn't exist, create it
7. mkdir name of the reranker
8. cd into the new directory, move the reranker you want into this folder.
9. vim /data/layar/layar.config
10. Press i to start editing.
11. Add the following
    1. ALL_RERANKER_INFO: '[{"reranker_name":"my-custom-reranker","encoder_type":"transformers"}]'
    2. Make sure the reranker_name is set to the name of the directory you made in step 7
12. Restart the stack.