Advances in Multilingual Machine Translation and Evaluation

The field of natural language processing is rapidly evolving, with a focus on improving machine translation, sentiment analysis, and evaluation metrics. Recent research has explored innovative approaches to address the challenges of simultaneous translation, code-mixed texts, and low-resource languages. Notable advancements include the development of non-monotonic attention-based read/write policies, transformer-based solutions for sentiment analysis in code-mixed texts, and confidence estimation methods for reliable translation. Furthermore, researchers have proposed new evaluation metrics, such as ContrastScore, which utilizes contrastive evaluation to assess generated text quality. These innovative solutions aim to enhance the accuracy, naturalness, and reliability of machine translation and related tasks.

Noteworthy papers include:

  • 'You Cannot Feed Two Birds with One Score: the Accuracy-Naturalness Tradeoff in Translation', which mathematically proves the existence of a tradeoff between accuracy and naturalness in translation.
  • 'ContrastScore: Towards Higher Quality, Less Biased, More Efficient Evaluation Metrics with Contrastive Evaluation', which introduces a novel evaluation metric that achieves stronger correlation with human judgments than existing baselines.
  • 'MKA: Leveraging Cross-Lingual Consensus for Model Abstention', which develops a multilingual pipeline to calibrate model confidence and improve accuracy by up to 71.2% in certain languages.

Sources

Non-Monotonic Attention-based Read/Write Policy Learning for Simultaneous Translation

Advancing Sentiment Analysis in Tamil-English Code-Mixed Texts: Challenges and Transformer-Based Solutions

Using Source-Side Confidence Estimation for Reliable Translation into Unfamiliar Languages

MKA: Leveraging Cross-Lingual Consensus for Model Abstention

You Cannot Feed Two Birds with One Score: the Accuracy-Naturalness Tradeoff in Translation

FUSE : A Ridge and Random Forest-Based Metric for Evaluating MT in Indigenous Languages

Multilingual Sentiment Analysis of Summarized Texts: A Cross-Language Study of Text Shortening Effects

News is More than a Collection of Facts: Moral Frame Preserving News Summarization

Is the Top Still Spinning? Evaluating Subjectivity in Narrative Understanding

ContrastScore: Towards Higher Quality, Less Biased, More Efficient Evaluation Metrics with Contrastive Evaluation

Built with on top of