pipeline for training language models

We have hosted the application pipeline for training language models in order to run this application in our online workstations with Wine or directly.

Quick description about pipeline for training language models:

Pipeline for training Language Models using PyTorch. Inspired by Yandex Data School NLP Course (week 03: Language Modeling) Prepared text file with space-separated words on each line.

Features:

• Statistical Language Modeling
• Scripts for training statistical language models
• Scripts for validation statistical language models using perplexity
• Scripts for generation new sequences using statistical language models
• RNN Language Modeling
• Various implemented models

Programming Language: Python.
Categories: