Translation Blog

Translation tips, AI insights & freelance guides

How to Run an MT Engine Bake-Off: A Step-by-Step Comparison Guide
B2B 2026-07-12 16 min

How to Run an MT Engine Bake-Off: A Step-by-Step Comparison Guide

Practical methodology for comparing MT engines: test corpus design, automatic metrics (BLEU, COMET, TER), blind human evaluation, TCO calculation, and how to make a defensible engine selection decision.

machine translation MT evaluation MT engine comparison
How to Run a Human Evaluation of MT Output the Right Way
B2B 2026-07-11 15 min

How to Run a Human Evaluation of MT Output the Right Way

A practical guide for translation agency PMs and quality engineers: rater selection, MQM vs Direct Assessment, sample size, inter-annotator agreement, and the mistakes that make your eval meaningless.

MT evaluation machine translation quality MQM