Getting errors when enabling Spark NLP pre-trained NER model at indexing pipeline stage – Lucidworks

Issue:

We attempted to enable Spark NLP pre-trained NER model (based out of BERT) at indexing pipeline stage and we are running into errors. How does this functionality work?

Environment:

Fusion Server 4.2.2 to 5.6.1, Fusion AI, Index Pipeline Stages

We imported pre-trained NER and POS models from John Snow available at this link:
https://github.com/JohnSnowLabs/spark-nlp-models#english---models

Resolution:

Only the pre-trained NER model is supported. If choosing an NER model, download the NerDLModel instead of the NerCRFModel or NERDL Model with BERT. More info is found on our documentation site here:

https://doc.lucidworks.com/fusion-ai/4.2/540/nlp-annotator-index-stage

Cause:

NerDLModel (NER with BERT) ner_dl_bert was downloaded which is not currently supported with Fusion 4.2.2 to 5.6.1