{"id":12678,"date":"2023-11-15T09:29:22","date_gmt":"2023-11-15T08:29:22","guid":{"rendered":"https:\/\/flaven.fr\/?p=12678"},"modified":"2026-09-16T10:08:28","modified_gmt":"2026-09-16T08:08:28","slug":"crafting-fluent-translation-api-a-quick-journey-into-text-translation-with-nllb-huggingface-and-fastapi-plus-a-small-dive-into-roberta-masked-language-modeling-with-gradio","status":"publish","type":"post","link":"https:\/\/flaven.fr\/2023\/11\/crafting-fluent-translation-api-a-quick-journey-into-text-translation-with-nllb-huggingface-and-fastapi-plus-a-small-dive-into-roberta-masked-language-modeling-with-gradio\/","title":{"rendered":"Crafting Fluent Translation API: A quick Journey into Text Translation with NLLB, HuggingFace, and FastAPI, Plus a small Dive into Roberta Masked Language Modeling with Gradio"},"content":{"rendered":"

I have already mentioned many times on this blog the obstacles linked to managing a multilingual digital product. Indeed, whether you are creating a mobile application, a site or even a CMS, multilingualism increases the complexity somewhat. For AI, inevitably, the question arises with even more strength. For instance, whatever the language is, how is possible to ensure the same quality for functionalities in NLP (NER, Keywords extraction, summarization, etc.) or for audio extraction… etc. and so, what is the best strategy to adopt to overcome this obstacle?<\/p>\n

For this post, you can find all files for each project on my GitHub account. See https:\/\/github.com\/bflaven\/ia_usages\/tree\/main\/ia_translation_gradio<\/a><\/b><\/p>\n

Looking for the miracle translation tool to tackle the subject of multilingualism. The post was of course also an opportunity to discover the inexhaustible resources of the HuggingFace site as well as the possibility of using Gradio to dress up my AI productions as Streamlit does. <\/b><\/p>\n

A little clarification on languages, I am really looking for an LLM able to translate a wide variety of languages. I need to get rid of my Eurocentrism and include in my quest a fair number of different languages such as African languages: Hausa, Kiswahili, Mandenkan, Fulfulde, Wolof and of course Asian languages such as Chinese, Khmer or Vietnamese, Slavic languages such as Russian, Ukrainian and of course Persian, Arabic or finally Romanian. In short, a real babelian sample!<\/i><\/p>\n

As such, Meta became aware of the under-representation of African linguistic groups for its “no-language-left-behind” library. As such, Meta is therefore launching a call to document certain African languages. So if you speak the Congo, Kinyarwanda or Swazi languages, join the band wagon.<\/p>\n

Source: https:\/\/ai.meta.com\/research\/request-for-proposals\/translation-support-for-african-languages\/<\/a><\/i><\/p>\n

Source: https:\/\/ai.meta.com\/research\/no-language-left-behind\/<\/a><\/i><\/p>\n

Source: https:\/\/ai.meta.com\/blog\/nllb-200-high-quality-machine-translation\/<\/a><\/i><\/p>\n

Few words on Masked Language Modeling<\/h2>\n

An interesting essay on Masked Language Modeling so here is a definition taken from the Keras site.<\/p>\n

Masked Language Modeling is a fill-in-the-blank task, where a model uses the context words surrounding a mask token to try to predict what the masked word should be.<\/p>\n

For an input that contains one or more mask tokens, the model will generate the most likely substitution for each.<\/p>\n

Example:<\/p>\n

Input: “I have watched this [MASK] and it was awesome.”
\nOutput: “I have watched this movie and it was awesome.”\n<\/p><\/blockquote>\n

Like any beginner in IA, during the few tests on Masked Language Modeling with Roberta, I have experimented stranger things! Sometimes, the result is a bit little confusing. Especially, once again when the “system” has to guess a word in a context that is more “African” than “American” I should say! Without being a specialist on the issue, I use this example as an illustration of cognitive bias, which is also very much linked to cultural domination.<\/p>\n

Indeed, for sure, Roberta guesses the capital of Oregon but misses that of Uganda due to lack of appropriate training.<\/p>\n

\r\n[MASK] is the capital of Oregon.\r\n# For sure, everybody knows that the correct answer is \"Portland\" and the probability to have \"Portland\" as a proposition is close to one!\r\n# Portland 94%\r\n# This 2%\r\n# Washington 1%\r\n# Seattle 1%\r\n# It 0%\r\n<\/pre>\n
<\/p>\n
\r\n[MASK] is the capital and largest city of Uganda.\r\n# For sure, everybody knows that the correct answer is \"Kampala\" and the probability to have \"Kampala\" as a proposition is not even in the propositions!\r\n\r\n# Juba 25% Juba is the capital and largest city of South Sudan. \r\n# Uganda 14%\r\n# Beni 8% A city in the Democratic Republic of Congo\r\n# Nairobi 6% Nairobi is the capital and largest city of Kenya.\r\n# It 6%\r\n\r\n\r\n<\/pre>\n
<\/p>\n
Code: https:\/\/github.com\/bflaven\/ia_usages\/tree\/main\/ia_translation_gradio\/004_pyyush_maskedlanguagemodeling<\/a><\/p>\n
Source:
\nhttps:\/\/keras.io\/examples\/nlp\/masked_language_modeling\/<\/a><\/i><\/p>\n
Cut the NLP & Multilingualism’s Knot<\/h2>\n
One of the main impediments I wanted to solve is boiled down to this question: How to offer the same NLP features in an API in an unlimited number of languages? <\/b><\/p>\n
Until now, in fact, the English language predominates in AI, so the models are trained in this language. Two solutions are therefore available to us:<\/p>\n
    \n
  1. Waiting for the situation to improve and therefore having an open source LLM including your missing languages. Time is then your enemy and it is risky but as we have seen, the NLLB initiative may solved the issue. <\/li>\n
  2. Choose a “pivot” language such as English or French, Spanish. Then, the process wil be the following: translate the content, apply the selected AI models (NER, Keywords extraction, summarization, etc.) that you want to the newly translated text in English, then retranslate the result! Smarter and more pragmatic solution, at least it is all in your hands! <\/li>\n<\/ol>\n
    To translate text from one language to another for translation in 200 languages with PyTorch and Hugging Face transformers, I will be using Facebook’s NLLB 200 3.3B<\/b><\/p>\n
    Source: https:\/\/huggingface.co\/facebook\/nllb-200-3.3B<\/a><\/i><\/p>\n
    Below, a quick presentation for each GitHub directory for this overall exploration of translation IA mechanism. Each directory contains a POC with the code. <\/b><\/p>\n