Joshua 6: A phrase-based and hierarchical statistical machine translation system

• Main Authors: Post Matt, Cao Yuan, Kumar Gaurav
• Format: Article
• Language: English
• Published: Sciendo 2015-10-01
• Series: Prague Bulletin of Mathematical Linguistics
• Online Access: https://doi.org/10.1515/pralin-2015-0009

We describe the version six release of Joshua, an open-source statistical machine translation toolkit. The main difference from release five is the introduction of a simple, unlexicalized, phrase-based stack decoder. This phrase-based decoder shares a hypergraph format with the syntax-based systems, permitting a tight coupling with the existing codebase of feature functions and hypergraph tools. Joshua 6 also includes a number of large-scale discriminative tuners and a simplified sparse feature function interface with reflection-based loading, which allows new features to be used by writing a single function. Finally, Joshua includes a number of simplifications and improvements focused on usability for both researchers and end-users, including the release of language packs — precompiled models that can be run as black boxes.