Goal
Upload dictionary files larger than 1MB to Zookeeper in Fusion by increasing the Zookeeper jute.maxbuffer size limit.
Environment
- Fusion 5.9.2
- Kubernetes 1.27
- Applicable to any Kubernetes-based deployment of Fusion where Solr configuration files (e.g., Hunspell dictionaries) exceed the default Zookeeper file size limit of 1MB.
Guide
Uploading large files to Zookeeper (such as .dic files used for Hunspell filters) may fail due to the default jute.maxbuffer limit of 1MB. To resolve this, increase the limit to 4MB across all services that interact with Zookeeper and Solr configuration.
Increase buffer size in Zookeeper
-
Edit the Zookeeper ConfigMap:
-
Under the
run:section, set theJVMFLAGSto:
-
Save and restart the StatefulSet:
Update Fusion Admin configuration
-
Edit the deployment for Fusion Admin:
-
Add or update the following environment variables:
-
Restart the deployment:
Update Solr configuration
-
Edit the Solr StatefulSet:
-
Add or modify the following environment variables:
-
Restart the StatefulSet:
Validation
-
Attempt to upload a file larger than 1MB (e.g., a Hunspell
.dicdictionary) using the Fusion Admin UI or the Solr Config API. -
If upload succeeds but the file still cannot be viewed in the UI, verify that
Djute.maxbuffer=4000000is also present in theJAVA_TOOL_OPTIONSof the Fusion Admin container.
Notes
-
Files above 1MB may still fail to render in the UI due to frontend or browser-side limits, even if upload succeeds.
-
Hunspell dictionaries sourced from OpenOffice or LibreOffice can commonly exceed the 1MB threshold.
-
For large-scale or frequently updated dictionaries, consider external storage solutions like a blob store as an architectural alternative.