Issue:
We attempted to enable Spark NLP pre-trained NER model (based out of BERT) at indexing pipeline stage and we are running into errors. How does this functionality work?
Environment:
Fusion Server 4.2.2 to 5.6.1, Fusion AI, Index Pipeline Stages
We imported pre-trained NER and POS models from John Snow available at this link:
https://github.com/JohnSnowLabs/spark-nlp-models#english---models
Resolution:
Only the pre-trained NER model is supported. If choosing an NER model, download the NerDLModel instead of the NerCRFModel or NERDL Model with BERT. More info is found on our documentation site here:
https://doc.lucidworks.com/fusion-ai/4.2/540/nlp-annotator-index-stage
Cause:
NerDLModel (NER with BERT) ner_dl_bert was downloaded which is not currently supported with Fusion 4.2.2 to 5.6.1