Skip to content

wurentidai/CWS-NAACL2019

 
 

Repository files navigation

CWS-NAACL2019

Code and data for the NAACL 2019 paper "Improving Cross-Domain Chinese Word Segmentation with Word Embeddings"

Requirements: Python3.6, tf>=1.4.0, Keras==2.2.4

Data Format

Please refer to the sample datafiles ('data/try_*') for the required data format. You need to first segment your raw training data with a baseline segmenter, which is not provided in this repository. However, baseline-segmented data used in the paper is provided under the 'data' path.

Usage

You can simply run the whole segmentation model by run 'run.sh', after having prepared all required data in the proper format and modified parameters in 'run.sh'.

Or, you can run the model step-by-step using 'get_src.sh', 'get_emb.sh', and 'seg_file.sh'.

About

Code and data for the NAACL 2019 paper "Improving Cross-Domain Chinese Word Segmentation with Word Embeddings"

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 71.3%
  • Perl 22.7%
  • Shell 6.0%