2021/09/22 by Shuhan Zhou, Zhou, Shuhan, Tao Zhou +33
Computer Science · #Natural Language Processing Techniques #Topic Modeling #Multimodal Machine Learning Applications
paper · pdf · doi:10.48550/arxiv.2109.10485
This paper describes NiuTrans neural machine translation systems of the WMT 2021 news translation tasks. We made submissions to 9 language directions, including English↔\Chinese, Japanese, Russian, Icelandic\ and English→Hausa tasks. Our primary systems are built on several effective variants of Transformer, e.g., Transformer-DLCL, ODE-Transformer. We also utilize back-translation, knowledge distillation, post-ensemble, and iterative fine-tuning techniques to enhance the model performance further.