Skip to content

MananUpadhyay/POS-NER-Tagger

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

14 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

ReadMe

Part 1: Perceptron

Tested on Spam/Ham datasets.

     Overall Accuracy = 98.68 %

Part 2 : POS Tagger

      Overall Accuracy = 95.85 % 

Part 3 : NER Classifier

       Overall Accuracy = 95.15 % 

Precision, Recall, F-Score - Pending

Part 4 : POS/NER using Naive - Baye's Classifier

The accuracy is almost similar to using a perceptron based classifier but lesser than the perceptron learning algorithm.

Overall Accuracy = 91.94 % (POS) Overall Accuracy = 89.95 % (NER)

Look below for detailed matrices ->

Detailed Matrix for POS

precision: RP 0.045454545454545456 recall: RP 0.0625 fscore: RP 0.052631578947368425

precision: RBR 0.014285714285714285 recall: RBR 0.009523809523809525 fscore: RBR 0.011428571428571429

precision: CD 0.011738401341531582 recall: CD 0.011382113821138212 fscore: CD 0.01155751238304898

precision: NNS 0.028973157221985513 recall: NNS 0.027156549520766772 fscore: NNS 0.028035456606885178

precision: VBN 0.00857843137254902 recall: VBN 0.00823529411764706 fscore: VBN 0.008403361344537816

precision: PRP$ 0.40476190476190477 recall: PRP$ 0.4131944444444444 fscore: PRP$ 0.40893470790378

precision: UH 0.0 recall: UH 0.0

precision: WP 0.7108433734939759 recall: WP 0.7195121951219512 fscore: WP 0.7151515151515151

precision: WP$ 0.7777777777777778 recall: WP$ 0.7777777777777778 fscore: WP$ 0.7777777777777778

precision: NNPS 0.0 recall: NNPS 0.0

precision: VBD 0.0 recall: VBD 0.0

precision: RBS 0.6190476190476191 recall: RBS 0.6842105263157895 fscore: RBS 0.6500000000000001

precision: IN 0.001188212927756654 recall: IN 0.0012419274714356682 fscore: IN 0.0012144765606023802

precision: JJS 0.12987012987012986 recall: JJS 0.11494252873563218 fscore: JJS 0.12195121951219512

precision: NNP 0.00027586206896551725 recall: NNP 0.0002473410833539451 fscore: NNP 0.0002608242044861763

precision: '' 0.95 recall: '' 0.9965034965034965 fscore: '' 0.9726962457337883

precision: JJR 0.012658227848101266 recall: JJR 0.015151515151515152 fscore: JJR 0.013793103448275862

precision: $ 0.9777777777777777 recall: $ 1.0 fscore: $ 0.9887640449438202

precision: VBP 0.022082018927444796 recall: VBP 0.020527859237536656 fscore: VBP 0.021276595744680854

precision: WDT 0.010526315789473684 recall: WDT 0.011049723756906077 fscore: WDT 0.01078167115902965

precision: POS 0.11286681715575621 recall: POS 0.11682242990654206 fscore: POS 0.1148105625717566

precision: FW 0.5 recall: FW 1.0 fscore: FW 0.6666666666666666

precision: PDT 0.0 recall: PDT 0.0

precision: VB 0.07692307692307693 recall: VB 0.08341810783316378 fscore: VB 0.08003904343582235

precision: -RRB- 0.15254237288135594 recall: -RRB- 0.14516129032258066 fscore: -RRB- 0.1487603305785124

precision: , 0.9657503379900856 recall: , 1.0 fscore: , 0.9825767996331958

precision: RB 0.0015600624024961 recall: RB 0.0015290519877675841 fscore: RB 0.0015444015444015446

precision: LS 0.0 recall: LS 0.0

precision: . 0.9923258559622196 recall: . 1.0 fscore: . 0.9961481481481482

precision: DT 0.02369542066027689 recall: DT 0.02534890344631159 fscore: DT 0.024494289252786572

precision: EX 0.9411764705882353 recall: EX 1.0 fscore: EX 0.9696969696969697

precision: NN 0.0034211426616489907 recall: NN 0.0034934497816593887 fscore: NN 0.0034569181574626217

precision: VBZ 0.0043541364296081275 recall: VBZ 0.00425531914893617 fscore: VBZ 0.004304160688665711

precision: # 0.8 recall: # 0.5714285714285714 fscore: # 0.6666666666666666

precision: -LRB- 0.46551724137931033 recall: -LRB- 0.45 fscore: -LRB- 0.4576271186440678

precision: 0.29411764705882354 recall: 0.3082191780821918 fscore: `` 0.3010033444816054

precision: JJ 0.00505902192242833 recall: JJ 0.0048543689320388345 fscore: JJ 0.00495458298926507

precision: CC 0.5097847358121331 recall: CC 0.521 fscore: CC 0.5153313550939664

precision: MD 0.4717514124293785 recall: MD 0.48546511627906974 fscore: MD 0.4785100286532951

precision: PRP 0.4376770538243626 recall: PRP 0.5049019607843137 fscore: PRP 0.46889226100151743

precision: WRB 0.4431818181818182 recall: WRB 0.4431818181818182 fscore: WRB 0.44318181818181823

precision: VBG 0.008421052631578947 recall: VBG 0.006802721088435374 fscore: VBG 0.007525870178739416

precision: TO 0.7340182648401826 recall: TO 0.7407834101382489 fscore: TO 0.7373853211009175

precision: : 0.9121951219512195 recall: : 0.9033816425120773 fscore: : 0.9077669902912623

About

Part of Speech & Named Entity Recognition using Perceptron Learning.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages