The table below shows how various language are supported in the Fusion product suite. The meanings of the columns are as follows:
  • Encoding. Fusion and App Studio support the language encodings of the selected languages both for search and display.
  • Language detection. The superset of languages supported was determined based on our use of the Language Detection Library for Java that recognizes 71 languages and the supported languages in Solr.
  • Thesaurus. Solr can support a supplied thesaurus for the selected language.
  • Did you mean (spell check). Fusion can return spelling suggestions for the selected language.
  • Stemming. Supported with an externally-supplied dictionary or out of the box with HunspellStemFilter.
  • Summary. The ability to display matching text from a search request which may also include highlighting.
  • App Studio. Text in the selected language can be displayed and Right-to-Left languages are also supported.
  • Administration tools. The language is supported in the Fusion UI.
  • Backtranslation task. Part of the Data Augmentation Job. Translates the input data into one or more intermediate languages before translating it back to the source language.
  • Synonym Substitution task. Part of the Data Augmentation Job. Takes in the input text and substitutes some words with synonyms derived from the included wordner/ppdb dictionaries or user-supplied dictionaries.
  • Keystroke Misspelling task. Part of the Data Augmentation Job. Simulates typos one might make based on the layout of the keyboard.
  • Split Word task. Part of the Data Augmentation Job. Randomly splits words by introducing a space “ “ at some random point in the word.
Supported languageEncodingLanguage detectionThesaurusDid you mean (spell check)StemmingSummaryApp StudioAdministration toolsBacktranslation taskSynonym Substitution taskKeystroke Misspelling taskSplit Word task
Afrikaansxxxxx (hunspell)xx
Albanianxxxxx (hunspell)xx
Arabicxxxxxxx
Aragonesexxxxx (hunspell)xx
Asturianxxxxx (hunspell)xx
Basquexxxxx (hunspell)xx
Belarusianxxxxx (hunspell)xx
Bengalixxxxx (hunspell)xx
Bretonxxxxx (hunspell)xx
Brazilian Portuguesexxxxxxx
Bulgarianxxxxxxx
Catalanxxxxxxx
Chinesexxxxx (performed as part of dictionary-based tokenization; separate stemming step not required)xxxxx
Croatianxxxxx (hunspell)xx
Czechxxxxxxx
Danishxxxxxxx
Dutchxxxxxxxxxxxx
Englishxxxxxxxxxxxx
Estonianxxxxx (hunspell)xx
Finnishxxxxxxx
Frenchxxxxxxxxxxxx
Galicianxxxxxxx
Germanxxxxxxxxxxxx
Greekxxxxx (hunspell)xx
Gujaratixxxxx (hunspell)xx
Haitianxxxxx (hunspell)xx
Hebrewxxxxx (hunspell)xxxxxx
Hindixxxxxxx
Hungarianxxxxx (hunspell)xx
Icelandicxxxxx (hunspell)xx
Indonesianxxxxxxx
Irishxxxxxxx
Italianxxxxxxxxxxxx
Japanesexxxxxxxxxxx
Kannadaxxxxx (hunspell)xx
Khmerxxxxx (hunspell)xx
Koreanxxxxx (hunspell)xxxx
Laoxxxxxx
Latvianxxxxxxx
Lithuanianxxxxx (hunspell)xx
Macedonianxxxxx (hunspell)xx
Malayxxxxx (hunspell)xx
Malayalamxxxxx (hunspell)xx
Maltesexxxxx (hunspell)xx
Marathixxxxx (hunspell)xx
Myanmarxxx
Nepalixxxxx (hunspell)xx
Norwegianxxxxxxx
Occitanxxxxx (hunspell)xx
Persianxxxxx (hunspell)xx
Polishxxxxxxxxxxxx
Portuguesexxxxxxx
Punjabixxxxx (hunspell)xx
Romanianxxxxxxx
Russianxxxxxxx
Serbianxxxxx (hunspell)xx
Slovakxxxxx (hunspell)xx
Slovenexxxxx (hunspell)xx
Somalixxxxx (hunspell)xx
Spanishxxxxxxxxxxxx
Swahilixxxxx (hunspell)xx
Swedishxxxxxxx
Tagalogxxxxx (hunspell)xx
Tamilxxxx (hunspell)xx
Teluguxxxx (hunspell)xx
Thaixxxxx (hunspell)xx
Turkishxxxxxxx
Ukrainianxxxxxxxxxx
Urduxxxx (hunspell)xx
Vietnamesexxxx (hunspell)xx
Walloonxxxxx (hunspell)xx
Welshxxxxx (hunspell)xx
Yiddishxxxxx (hunspell)xx