过滤特征有：
1.双语句子长度比率
2.重复句子
目前支持的语种类：
- 英文<-->中文
- 日文<-->中文
- 韩文<-->中文
By Liam 9th/Aug/2018
forked from alphadl/corpus_filter
-
Notifications
You must be signed in to change notification settings - Fork 0
prigioni/corpus_filter
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
机器翻译平行语料过滤的脚本
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published
Languages
- Python 100.0%