The first version of FastAPI has been released by the end of 2018 and it’s been increasingly used in many applications in production since then. That’s what we are using behind the hood at NLP Cloud. It is a great way to easily and efficiently serve our hundreds of NLP models, for entity extraction (NER), text classification, sentiment analysis, question answering, summarization… We found that FastAPI is a great way to serve transformer-based deep learning models.

In this article, we thought it would be interesting to show you how we are implementing an NLP API based on Hugging Face transformers with FastAPI.
— Lees op nlpcloud.io/nlp-machine-learning-classification-api-production-fastapi-transformers-nlpcloud.html

Categories: Data