Adjusting Map-Reduce Pipeline Text Cap

Introduction

This guide goes over how to increase the map-reduce pipelines text cap. You must be on version 1.19 in order to use this config setting.

This setting is useful if you have very large documents that have a lot of text. The default is currently set to 5 million characters, this may not be enough for some use cases.

Editing Layar.config

1. SSH into your environment.
2. Run sudo -i
3. Run vim /data/layar/layar.config
4. Press i to start editing.
5. At the bottom of the file add LLM_MAX_NLP_SPLITTER_LENGTH: YOUR DESIRED CAP