ELLORA: Enabling Low Resource Languages – Microsoft Research The main goal of ELLORA is to impact underserved communities through enabling language technology by creating economic opportunities, building technological skills, enhancing education and preserving local language and cultures for future generations. ELLORA aims to do this by: (1) Data: New/Innovative methodologies Read more
What is Teachable NLP? Teachable NLP is a free service that you can easily train GPT-2 Model and make your own AI services. All you need to do is preparing your own text data. Teachable NLP will do the rest to train the… — Lees op forum.ainetwork.ai/t/teachable-nlp-how-to-use-teachable-nlp/65
An intuitive understanding on Transformers and how they are used in Machine Translation. After analyzing all subcomponents one by one such as self-attention and positional encodings , we explain the principles behind the Encoder and Decoder and why Transformers work so well — Lees op theaisummer.com/transformer/
In recent years, Natural Language Processing (NLP) models have achieved phenomenal success in linguistic and semantic tasks like text classification, machine translation, cognitive dialogue systems, information retrieval via Natural Language Understanding (NLU), and Natural Language Generation (NLG). This feat is primarily attributed due to the seminal Transformer architecture, leading to Read more
Mastery-based assignments to reinforce learning. Crowdsource and share assignments with educators around the world. — Lees op openclass.ai/catalog/nlp
Researchers From NVIDIA, Stanford University and Microsoft Research Propose Efficient Trillion-Parameter Language Model Training on GPU Clusters. — Lees op www.marktechpost.com/2021/04/19/researchers-from-nvidia-stanford-university-and-microsoft-research-propose-efficient-trillion-parameter-language-model-training-on-gpu-clusters/
[2103.03404] Attention is Not All You Need: Pure Attention Loses Rank Doubly Exponentially with Depth — Lees op arxiv.org/abs/2103.03404
Model performance — trankit documentation — Lees op trankit.readthedocs.io/en/latest/performance.html