The current consensus is not to use Google Translate in medical, police, or creative translation settings. Questions have been raised surrounding the use of Google Translate in specific settings. While remaining wary of bias, DeepL’s evaluation generally matches other independent analyses. It should be noted that DeepL outranking Google Translate is generally specific to European languages and for natural-sounding accuracy since DeepL is typically better at preserving context and handling colloquialisms and slang. In DeepL’s evaluation (2020), its own MT tool consistently took first place for all language pairs, with Google Translate in second. Intento ( 2022) ranked Google Translate first above 18 other engines for almost all language pairs. Google Translate is now considered one of the best in terms of reliability and accuracy, particularly for high-resource languages. A reevaluation in 2019 using the same text and metric showed a 34% improvement. Google Translate on Top?Ī 2011 accuracy study on 51 languages found Google Translate performed strongly for European languages, but less so for Asian languages. Facebook patented its own alternative in 2019 and Meta proposed XSTS (a cross-lingual variant of Semantic Textual Similarity) in 2022. Others include NIST, Word Error Rate, and METEOR. While not perfect, the most commonly used is Bilingual Evaluation Understudy ( BLEU). Many automated evaluation metrics have been used for measuring MT output quality.
Some researchers deem a text accurate if over 50% of the meanings are precise others are stricter and texts are ‘failed’ if any ambiguity is present.
0 kommentar(er)
