Skip to content

shnend/janome

 
 

Repository files navigation

Janome

image

image

Janome is a Japanese morphological analysis engine written in pure Python.

General documentation:

http://mocobeta.github.io/janome/en/ (English)

http://mocobeta.github.io/janome/ (Japanese)

Requirements

Python 2.7.x or 3.3+ is required.

Install

[Note] This consumes about 500 MB memory for building.

(venv) $ python setup.py install

Run

(env) $ python
>>> from janome.tokenizer import Tokenizer
>>> t = Tokenizer()
>>> for token in t.tokenize(u'すもももももももものうち'):
...     print(token)
...
すもも 名詞,一般,*,*,*,*,すもも,スモモ,スモモ
も    助詞,係助詞,*,*,*,*,も,モ,モ
もも  名詞,一般,*,*,*,*,もも,モモ,モモ
も    助詞,係助詞,*,*,*,*,も,モ,モ
もも  名詞,一般,*,*,*,*,もも,モモ,モモ
の    助詞,連体化,*,*,*,*,の,ノ,ノ
うち  名詞,非自立,副詞可能,*,*,*,うち,ウチ,ウチ

License

Licensed under Apache License 2.0 and uses the MeCab-IPADIC dictionary/statistical model.

See LICENSE.txt and NOTICE.txt for license details.

Acknowledgement

Special thanks to @ikawaha and @takuya_a.

Copyright(C) 2015-2016, moco_beta. All rights reserved.

About

Japanese morphological analysis engine written in pure Python

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Languages

  • Python 91.1%
  • Makefile 7.8%
  • Shell 1.1%