PARAGEN : A Parallel Generation Toolkit

October 07, 2022 · Entered Twilight · 🏛 arXiv.org

Repo contents: .editorconfig, .flake8, .gitignore, 3rdparty, LICENSE, MANIFEST.in, Makefile, README.md, examples, paragen, requirements.txt, scripts, setup.py, tests, tutorials

Authors Jiangtao Feng, Yi Zhou, Jun Zhang, Xian Qian, Liwei Wu, Zhexi Zhang, Yanming Liu, Mingxuan Wang, Lei Li, Hao Zhou arXiv ID 2210.03405 Category cs.CL: Computation & Language Citations 3 Venue arXiv.org Repository https://github.com/bytedance/ParaGen ⭐ 185 Last Checked 3 months ago

Abstract

PARAGEN is a PyTorch-based NLP toolkit for further development on parallel generation. PARAGEN provides thirteen types of customizable plugins, helping users to experiment quickly with novel ideas across model architectures, optimization, and learning strategies. We implement various features, such as unlimited data loading and automatic model selection, to enhance its industrial usage. ParaGen is now deployed to support various research and industry applications at ByteDance. PARAGEN is available at https://github.com/bytedance/ParaGen.