Added Parsing and Evaluation of Lemmas using Tiger Corpus
diff --git a/DeReKo/ParseTests.log b/DeReKo/ParseTests.log
index c64ba0b..e873a16 100644
--- a/DeReKo/ParseTests.log
+++ b/DeReKo/ParseTests.log
@@ -280,3 +280,596 @@
INFO:__main__:Time Elapsed: 10007.997486114502. Processed 1830665. [182.92020981619333 Sents/sec]
INFO:__main__:Processing File /export/netapp/kupietz/N-GRAMM-STUDIE/conllu/a00.conllu.gz took 10007.997836351395 seconds!
+INFO:__main__:Start Logging
+INFO:__main__:Chunking in Files of 20000 Sentences
+INFO:__main__:File /export/netapp/kupietz/N-GRAMM-STUDIE/conllu/a00.conllu is already uncompressed. Skipping this step...
+INFO:__main__:Successfully fixed comments on file
+INFO:__main__:Start Logging
+INFO:__main__:Chunking in Files of 20000 Sentences
+INFO:__main__:File /export/netapp/kupietz/N-GRAMM-STUDIE/conllu/a00.conllu is already uncompressed. Skipping this step...
+INFO:__main__:Successfully fixed comments on file
+INFO:__main__:Start Logging
+INFO:__main__:Chunking in Files of 20000 Sentences
+INFO:__main__:File /export/netapp/kupietz/N-GRAMM-STUDIE/conllu/a00.conllu is already uncompressed. Skipping this step...
+INFO:__main__:Successfully fixed comments on file
+INFO:my_utils:Reading instances from lines in file at: /export/netapp/kupietz/N-GRAMM-STUDIE/conllu/a00.conllu.fixed
+INFO:__main__:Start Logging
+INFO:__main__:Chunking in Files of 20000 Sentences
+INFO:__main__:File /export/netapp/kupietz/N-GRAMM-STUDIE/conllu/a00.conllu is already uncompressed. Skipping this step...
+INFO:__main__:Successfully fixed comments on file
+INFO:my_utils:Reading instances from lines in file at: /export/netapp/kupietz/N-GRAMM-STUDIE/conllu/a00.conllu.fixed
+INFO:my_utils:Sending Request 0 to Parser Server...
+INFO:__main__:Start Logging
+INFO:__main__:Chunking in Files of 20000 Sentences
+INFO:__main__:File /export/netapp/kupietz/N-GRAMM-STUDIE/conllu/a00.conllu is already uncompressed. Skipping this step...
+INFO:__main__:Successfully fixed comments on file
+INFO:my_utils:Reading instances from lines in file at: /export/netapp/kupietz/N-GRAMM-STUDIE/conllu/a00.conllu.fixed
+INFO:my_utils:Sending Request 0 to Parser Server...
+INFO:__main__:Time Elapsed: 256.55612111091614. Processed 20000. [77.95565318573499 Sents/sec]
+
+INFO:my_utils:Sending Request 1 to Parser Server...
+INFO:__main__:Chunking TIGER Corpus in chunks of 20000 Sentences
+INFO:__main__:Chunking TIGER Corpus in chunks of 20000 Sentences
+INFO:my_utils:Reading instances from lines in file at: /home/daza/datasets/tiger_release_aug07.corrected.16012013.conll09
+INFO:__main__:Chunking TIGER Corpus in chunks of 20000 Sentences
+INFO:my_utils:Reading instances from lines in file at: /home/daza/datasets/tiger_release_aug07.corrected.16012013.conll09
+INFO:__main__:Time Elapsed: 7.804205894470215. Processed 20000. [2562.7207009199096 Sents/sec]
+
+INFO:__main__:Time Elapsed: 15.504295587539673. Processed 40000. [2579.930173167414 Sents/sec]
+
+INFO:__main__:Time Elapsed: 18.71819543838501. Processed 50472. [2696.413773760377 Sents/sec]
+
+INFO:__main__:Chunking TIGER Corpus in chunks of 20000 Sentences
+INFO:my_utils:Reading instances from lines in file at: /home/daza/datasets/tiger_release_aug07.corrected.16012013.conll09
+INFO:__main__:Chunking TIGER Corpus in chunks of 20000 Sentences
+INFO:my_utils:Reading instances from lines in file at: /home/daza/datasets/tiger_release_aug07.corrected.16012013.conll09
+INFO:my_utils:Sending Request 0 to Parser Server...
+INFO:__main__:Chunking TIGER Corpus in chunks of 10000 Sentences
+INFO:my_utils:Reading instances from lines in file at: /home/daza/datasets/tiger_release_aug07.corrected.16012013.conll09
+INFO:my_utils:Sending Request 0 to Parser Server...
+INFO:__main__:Chunking TIGER Corpus in chunks of 2 Sentences
+INFO:my_utils:Reading instances from lines in file at: /home/daza/datasets/tiger_release_aug07.corrected.16012013.conll09
+INFO:__main__:Time Elapsed: 0.001314401626586914. Processed 2. [1521.6049337928532 Sents/sec]
+
+INFO:__main__:Time Elapsed: 0.0016019344329833984. Processed 4. [2496.9810983777347 Sents/sec]
+
+INFO:__main__:Processing File /home/daza/datasets/tiger_release_aug07.corrected.16012013.conll09 took 0.0016684532165527344 seconds!
+INFO:__main__:Chunking TIGER Corpus in chunks of 2 Sentences
+INFO:my_utils:Reading instances from lines in file at: /home/daza/datasets/tiger_release_aug07.corrected.16012013.conll09
+INFO:__main__:Time Elapsed: 0.0011761188507080078. Processed 2. [1700.50841273059 Sents/sec]
+
+INFO:__main__:Time Elapsed: 0.0015003681182861328. Processed 4. [2666.012394724297 Sents/sec]
+
+INFO:__main__:Processing File /home/daza/datasets/tiger_release_aug07.corrected.16012013.conll09 took 0.0015683174133300781 seconds!
+INFO:__main__:Chunking TIGER Corpus in chunks of 2 Sentences
+INFO:my_utils:Reading instances from lines in file at: /home/daza/datasets/tiger_release_aug07.corrected.16012013.conll09
+INFO:__main__:Chunking TIGER Corpus in chunks of 2 Sentences
+INFO:my_utils:Reading instances from lines in file at: /home/daza/datasets/tiger_release_aug07.corrected.16012013.conll09
+INFO:__main__:Chunking TIGER Corpus in chunks of 2 Sentences
+INFO:my_utils:Reading instances from lines in file at: /home/daza/datasets/tiger_release_aug07.corrected.16012013.conll09
+INFO:__main__:Time Elapsed: 0.0013751983642578125. Processed 2. [1454.3356449375867 Sents/sec]
+
+INFO:__main__:Time Elapsed: 0.0016794204711914062. Processed 4. [2381.7739920499716 Sents/sec]
+
+INFO:__main__:Processing File /home/daza/datasets/tiger_release_aug07.corrected.16012013.conll09 took 0.0017464160919189453 seconds!
+INFO:__main__:Chunking TIGER Corpus in chunks of 2 Sentences
+INFO:my_utils:Reading instances from lines in file at: /home/daza/datasets/tiger_release_aug07.corrected.16012013.conll09
+INFO:__main__:Time Elapsed: 0.0014057159423828125. Processed 2. [1422.7625508819538 Sents/sec]
+
+INFO:__main__:Time Elapsed: 0.0017058849334716797. Processed 4. [2344.824039133473 Sents/sec]
+
+INFO:__main__:Processing File /home/daza/datasets/tiger_release_aug07.corrected.16012013.conll09 took 0.0017724037170410156 seconds!
+INFO:__main__:Chunking TIGER Corpus in chunks of 10 Sentences
+INFO:my_utils:Reading instances from lines in file at: /home/daza/datasets/tiger_release_aug07.corrected.16012013.conll09
+INFO:my_utils:Sending Request 0 to Parser Server...
+INFO:__main__:Start Logging
+INFO:__main__:Chunking in Files of 20000 Sentences
+INFO:__main__:File tutorial_examples/mini_test_raw.conllu is already uncompressed. Skipping this step...
+INFO:__main__:Successfully fixed comments on file
+INFO:my_utils:Reading instances from lines in file at: tutorial_examples/mini_test_raw.conllu.fixed
+INFO:my_utils:Sending Request 0 to Parser Server...
+INFO:__main__:Start Logging
+INFO:__main__:Chunking in Files of 2 Sentences
+INFO:__main__:File tutorial_examples/mini_test_raw.conllu is already uncompressed. Skipping this step...
+INFO:__main__:Successfully fixed comments on file
+INFO:my_utils:Reading instances from lines in file at: tutorial_examples/mini_test_raw.conllu.fixed
+INFO:my_utils:Sending Request 0 to Parser Server...
+INFO:__main__:Start Logging
+INFO:__main__:Chunking in Files of 2 Sentences
+INFO:__main__:File tutorial_examples/mini_test_raw.conllu is already uncompressed. Skipping this step...
+INFO:__main__:Successfully fixed comments on file
+INFO:my_utils:Reading instances from lines in file at: tutorial_examples/mini_test_raw.conllu.fixed
+INFO:my_utils:Sending Request 0 to Parser Server...
+INFO:__main__:Start Logging
+INFO:__main__:Chunking in Files of 2 Sentences
+INFO:__main__:File tutorial_examples/mini_test_raw.conllu is already uncompressed. Skipping this step...
+INFO:__main__:Successfully fixed comments on file
+INFO:my_utils:Reading instances from lines in file at: tutorial_examples/mini_test_raw.conllu.fixed
+INFO:my_utils:Sending Request 0 to Parser Server...
+INFO:__main__:Start Logging
+INFO:__main__:Chunking in Files of 2 Sentences
+INFO:__main__:File tutorial_examples/mini_test_raw.conllu is already uncompressed. Skipping this step...
+INFO:__main__:Successfully fixed comments on file
+INFO:my_utils:Reading instances from lines in file at: tutorial_examples/mini_test_raw.conllu.fixed
+INFO:my_utils:Sending Request 0 to Parser Server...
+INFO:__main__:Time Elapsed: 98.24166512489319. Processed 2. [0.020357961130416807 Sents/sec]
+
+INFO:my_utils:Sending Request 1 to Parser Server...
+INFO:__main__:Time Elapsed: 100.21094870567322. Processed 4. [0.03991579814046356 Sents/sec]
+
+INFO:my_utils:Sending Request 2 to Parser Server...
+INFO:__main__:Time Elapsed: 102.53487825393677. Processed 6. [0.058516673566827326 Sents/sec]
+
+INFO:my_utils:Sending Request 3 to Parser Server...
+INFO:__main__:Time Elapsed: 104.4103856086731. Processed 8. [0.0766207303360008 Sents/sec]
+
+INFO:my_utils:Sending Request 4 to Parser Server...
+INFO:__main__:Time Elapsed: 106.3076753616333. Processed 10. [0.0940665851828891 Sents/sec]
+
+INFO:my_utils:Sending Request 5 to Parser Server...
+INFO:__main__:Time Elapsed: 108.6529791355133. Processed 12. [0.1104433591741047 Sents/sec]
+
+INFO:my_utils:Sending Request 6 to Parser Server...
+INFO:__main__:Time Elapsed: 110.82709813117981. Processed 14. [0.1263228960793414 Sents/sec]
+
+INFO:my_utils:Sending Request 7 to Parser Server...
+INFO:__main__:Time Elapsed: 112.87869834899902. Processed 16. [0.141745078868035 Sents/sec]
+
+INFO:my_utils:Sending Request 8 to Parser Server...
+INFO:__main__:Time Elapsed: 115.0978467464447. Processed 18. [0.15638867718918475 Sents/sec]
+
+INFO:my_utils:Sending Request 9 to Parser Server...
+INFO:__main__:Time Elapsed: 116.95462322235107. Processed 20. [0.17100649336432405 Sents/sec]
+
+INFO:my_utils:Sending Request 10 to Parser Server...
+INFO:__main__:Time Elapsed: 118.83606028556824. Processed 22. [0.18512899154627846 Sents/sec]
+
+INFO:my_utils:Sending Request 11 to Parser Server...
+INFO:__main__:Time Elapsed: 121.33323788642883. Processed 24. [0.1978023534034808 Sents/sec]
+
+INFO:my_utils:Sending Request 12 to Parser Server...
+INFO:__main__:Time Elapsed: 123.19998693466187. Processed 26. [0.21103898341960778 Sents/sec]
+
+INFO:my_utils:Sending Request 13 to Parser Server...
+INFO:__main__:Time Elapsed: 125.05164241790771. Processed 28. [0.22390749500456245 Sents/sec]
+
+INFO:my_utils:Sending Request 14 to Parser Server...
+INFO:__main__:Time Elapsed: 127.36129140853882. Processed 30. [0.23555037537872106 Sents/sec]
+
+INFO:my_utils:Sending Request 15 to Parser Server...
+INFO:__main__:Time Elapsed: 129.26071906089783. Processed 32. [0.2475616740529196 Sents/sec]
+
+INFO:my_utils:Sending Request 16 to Parser Server...
+INFO:__main__:Time Elapsed: 131.22510385513306. Processed 34. [0.25909676579516794 Sents/sec]
+
+INFO:my_utils:Sending Request 17 to Parser Server...
+INFO:__main__:Time Elapsed: 133.9056680202484. Processed 36. [0.2688459759190798 Sents/sec]
+
+INFO:my_utils:Sending Request 18 to Parser Server...
+INFO:__main__:Time Elapsed: 135.85143780708313. Processed 38. [0.2797173192525367 Sents/sec]
+
+INFO:__main__:Processing File tutorial_examples/mini_test_raw.conllu.gz took 135.8516595363617 seconds!
+INFO:__main__:Start Logging
+INFO:__main__:Chunking in Files of 20000 Sentences
+INFO:__main__:File /export/netapp/kupietz/N-GRAMM-STUDIE/conllu/a00.conllu is already uncompressed. Skipping this step...
+INFO:__main__:Chunking TIGER Corpus in chunks of 10 Sentences
+INFO:my_utils:Reading instances from lines in file at: /home/daza/datasets/tiger_release_aug07.corrected.16012013.conll09
+INFO:my_utils:Sending Request 0 to Parser Server...
+INFO:__main__:Chunking TIGER Corpus in chunks of 10 Sentences
+INFO:my_utils:Reading instances from lines in file at: /home/daza/datasets/tiger_release_aug07.corrected.16012013.conll09
+INFO:my_utils:Sending Request 0 to Parser Server...
+INFO:__main__:Chunking TIGER Corpus in chunks of 10 Sentences
+INFO:my_utils:Reading instances from lines in file at: /home/daza/datasets/tiger_release_aug07.corrected.16012013.conll09
+INFO:my_utils:Sending Request 0 to Parser Server...
+INFO:__main__:Chunking TIGER Corpus in chunks of 10 Sentences
+INFO:my_utils:Reading instances from lines in file at: /home/daza/datasets/tiger_release_aug07.corrected.16012013.conll09
+INFO:my_utils:Sending Request 0 to Parser Server...
+INFO:__main__:Chunking TIGER Corpus in chunks of 10 Sentences
+INFO:my_utils:Reading instances from lines in file at: /home/daza/datasets/tiger_release_aug07.corrected.16012013.conll09
+INFO:my_utils:Sending Request 0 to Parser Server...
+INFO:__main__:Chunking TIGER Corpus in chunks of 10 Sentences
+INFO:my_utils:Reading instances from lines in file at: /home/daza/datasets/tiger_release_aug07.corrected.16012013.conll09
+INFO:my_utils:Sending Request 0 to Parser Server...
+INFO:__main__:Chunking TIGER Corpus in chunks of 10 Sentences
+INFO:my_utils:Reading instances from lines in file at: /home/daza/datasets/tiger_release_aug07.corrected.16012013.conll09
+INFO:my_utils:Sending Request 0 to Parser Server...
+INFO:__main__:Time Elapsed: 2.2843611240386963. Processed 10. [4.377591570250607 Sents/sec]
+
+INFO:my_utils:Sending Request 1 to Parser Server...
+INFO:__main__:Time Elapsed: 4.711368083953857. Processed 20. [4.245051467771474 Sents/sec]
+
+INFO:__main__:Processing File /home/daza/datasets/tiger_release_aug07.corrected.16012013.conll09 took 4.711584091186523 seconds!
+INFO:__main__:Chunking TIGER Corpus in chunks of 10000 Sentences
+INFO:my_utils:Reading instances from lines in file at: /home/daza/datasets/tiger_release_aug07.corrected.16012013.conll09
+INFO:my_utils:Sending Request 0 to Parser Server...
+INFO:__main__:Time Elapsed: 147.4470341205597. Processed 10000. [67.82096404749332 Sents/sec]
+
+INFO:my_utils:Sending Request 1 to Parser Server...
+INFO:__main__:Time Elapsed: 269.8712537288666. Processed 20000. [74.1094122610537 Sents/sec]
+
+INFO:my_utils:Sending Request 2 to Parser Server...
+INFO:__main__:Time Elapsed: 376.6291778087616. Processed 30000. [79.65394549232957 Sents/sec]
+
+INFO:my_utils:Sending Request 3 to Parser Server...
+INFO:__main__:Time Elapsed: 480.1558749675751. Processed 40000. [83.30628049214477 Sents/sec]
+
+INFO:my_utils:Sending Request 4 to Parser Server...
+INFO:__main__:Time Elapsed: 579.949392080307. Processed 50000. [86.21441919379816 Sents/sec]
+
+INFO:my_utils:Sending Request 5 to Parser Server...
+INFO:__main__:Time Elapsed: 588.1382684707642. Processed 50472. [85.81655489147774 Sents/sec]
+
+INFO:__main__:Processing File /home/daza/datasets/tiger_release_aug07.corrected.16012013.conll09 took 588.1386239528656 seconds!
+INFO:__main__:Chunking TIGER Corpus in chunks of 4 Sentences
+INFO:__main__:Chunking TIGER Corpus in chunks of 4 Sentences
+INFO:my_utils:Sending Request 0 to Parser Server...
+INFO:__main__:Time Elapsed: 3.4077346324920654. Processed 4. [1.1738003193854367 Sents/sec]
+
+INFO:my_utils:Sending Request 1 to Parser Server...
+INFO:__main__:Time Elapsed: 5.8468177318573. Processed 8. [1.3682656732072818 Sents/sec]
+
+INFO:my_utils:Sending Request 2 to Parser Server...
+INFO:__main__:Time Elapsed: 8.268580436706543. Processed 12. [1.4512769261732814 Sents/sec]
+
+INFO:my_utils:Sending Request 3 to Parser Server...
+INFO:__main__:Time Elapsed: 11.592190504074097. Processed 16. [1.3802395668339622 Sents/sec]
+
+INFO:my_utils:Sending Request 4 to Parser Server...
+INFO:__main__:Time Elapsed: 14.142167806625366. Processed 20. [1.4142103440909772 Sents/sec]
+
+INFO:my_utils:Sending Request 5 to Parser Server...
+INFO:__main__:Time Elapsed: 16.643868684768677. Processed 24. [1.4419724437001324 Sents/sec]
+
+INFO:my_utils:Sending Request 6 to Parser Server...
+INFO:__main__:Time Elapsed: 19.601061582565308. Processed 28. [1.4284940579394616 Sents/sec]
+
+INFO:my_utils:Sending Request 7 to Parser Server...
+INFO:__main__:Time Elapsed: 22.049132347106934. Processed 32. [1.4513042733946273 Sents/sec]
+
+INFO:my_utils:Sending Request 8 to Parser Server...
+INFO:__main__:Time Elapsed: 24.47833514213562. Processed 36. [1.4706882551841378 Sents/sec]
+
+INFO:my_utils:Sending Request 9 to Parser Server...
+INFO:__main__:Time Elapsed: 27.44930672645569. Processed 40. [1.4572317034676847 Sents/sec]
+
+INFO:my_utils:Sending Request 10 to Parser Server...
+INFO:__main__:Time Elapsed: 29.90971040725708. Processed 44. [1.4710941497221635 Sents/sec]
+
+INFO:my_utils:Sending Request 11 to Parser Server...
+INFO:__main__:Time Elapsed: 32.3324978351593. Processed 48. [1.4845744441001214 Sents/sec]
+
+INFO:my_utils:Sending Request 12 to Parser Server...
+INFO:__main__:Time Elapsed: 35.31913232803345. Processed 52. [1.4722898489419187 Sents/sec]
+
+INFO:my_utils:Sending Request 13 to Parser Server...
+INFO:__main__:Time Elapsed: 37.79887795448303. Processed 56. [1.4815254587036828 Sents/sec]
+
+INFO:my_utils:Sending Request 14 to Parser Server...
+INFO:__main__:Time Elapsed: 40.212188720703125. Processed 60. [1.4920849102926144 Sents/sec]
+
+INFO:my_utils:Sending Request 15 to Parser Server...
+INFO:__main__:Time Elapsed: 43.34154200553894. Processed 64. [1.4766433550477036 Sents/sec]
+
+INFO:my_utils:Sending Request 16 to Parser Server...
+INFO:__main__:Time Elapsed: 45.77445721626282. Processed 68. [1.4855446494697235 Sents/sec]
+
+INFO:my_utils:Sending Request 17 to Parser Server...
+INFO:__main__:Time Elapsed: 48.18557167053223. Processed 72. [1.4942232187738353 Sents/sec]
+
+INFO:my_utils:Sending Request 18 to Parser Server...
+INFO:__main__:Time Elapsed: 51.15876364707947. Processed 76. [1.4855714755792122 Sents/sec]
+
+INFO:my_utils:Sending Request 19 to Parser Server...
+INFO:__main__:Time Elapsed: 53.613008975982666. Processed 80. [1.492175155396297 Sents/sec]
+
+INFO:my_utils:Sending Request 20 to Parser Server...
+INFO:__main__:Time Elapsed: 56.01559019088745. Processed 84. [1.4995825218255938 Sents/sec]
+
+INFO:my_utils:Sending Request 21 to Parser Server...
+INFO:__main__:Time Elapsed: 58.91761326789856. Processed 88. [1.493611080270067 Sents/sec]
+
+INFO:my_utils:Sending Request 22 to Parser Server...
+INFO:__main__:Time Elapsed: 61.33076333999634. Processed 92. [1.5000628557317006 Sents/sec]
+
+INFO:my_utils:Sending Request 23 to Parser Server...
+INFO:__main__:Time Elapsed: 63.79576086997986. Processed 96. [1.504802179499898 Sents/sec]
+
+INFO:my_utils:Sending Request 24 to Parser Server...
+INFO:__main__:Time Elapsed: 66.70756030082703. Processed 100. [1.4990804572830438 Sents/sec]
+
+INFO:my_utils:Sending Request 25 to Parser Server...
+INFO:__main__:Time Elapsed: 69.17181944847107. Processed 104. [1.503502449830366 Sents/sec]
+
+INFO:my_utils:Sending Request 26 to Parser Server...
+INFO:__main__:Time Elapsed: 71.60666918754578. Processed 108. [1.5082394031921253 Sents/sec]
+
+INFO:my_utils:Sending Request 27 to Parser Server...
+INFO:__main__:Time Elapsed: 74.51957440376282. Processed 112. [1.5029608112515553 Sents/sec]
+
+INFO:my_utils:Sending Request 28 to Parser Server...
+INFO:__main__:Time Elapsed: 76.92893576622009. Processed 116. [1.5078851519864158 Sents/sec]
+
+INFO:my_utils:Sending Request 29 to Parser Server...
+INFO:__main__:Time Elapsed: 79.32971453666687. Processed 120. [1.5126740427703793 Sents/sec]
+
+INFO:my_utils:Sending Request 30 to Parser Server...
+INFO:__main__:Time Elapsed: 82.35156226158142. Processed 124. [1.505739497766011 Sents/sec]
+
+INFO:my_utils:Sending Request 31 to Parser Server...
+INFO:__main__:Time Elapsed: 84.87265062332153. Processed 128. [1.5081418932947501 Sents/sec]
+
+INFO:my_utils:Sending Request 32 to Parser Server...
+INFO:__main__:Time Elapsed: 87.31170439720154. Processed 132. [1.511824799565255 Sents/sec]
+
+INFO:my_utils:Sending Request 33 to Parser Server...
+INFO:__main__:Time Elapsed: 90.13041281700134. Processed 136. [1.5089246320898495 Sents/sec]
+
+INFO:my_utils:Sending Request 34 to Parser Server...
+INFO:__main__:Time Elapsed: 92.57583284378052. Processed 140. [1.5122737295406958 Sents/sec]
+
+INFO:my_utils:Sending Request 35 to Parser Server...
+INFO:__main__:Time Elapsed: 95.01719546318054. Processed 144. [1.5155151580515807 Sents/sec]
+
+INFO:my_utils:Sending Request 36 to Parser Server...
+INFO:__main__:Time Elapsed: 98.0310468673706. Processed 148. [1.5097257933013204 Sents/sec]
+
+INFO:my_utils:Sending Request 37 to Parser Server...
+INFO:__main__:Time Elapsed: 100.42707133293152. Processed 152. [1.513536121113162 Sents/sec]
+
+INFO:my_utils:Sending Request 38 to Parser Server...
+INFO:__main__:Time Elapsed: 102.81977605819702. Processed 156. [1.5172178541966717 Sents/sec]
+
+INFO:my_utils:Sending Request 39 to Parser Server...
+INFO:__main__:Time Elapsed: 105.71871662139893. Processed 160. [1.5134500787877876 Sents/sec]
+
+INFO:my_utils:Sending Request 40 to Parser Server...
+INFO:__main__:Time Elapsed: 108.23589158058167. Processed 164. [1.5152090272929652 Sents/sec]
+
+INFO:my_utils:Sending Request 41 to Parser Server...
+INFO:__main__:Time Elapsed: 110.6552083492279. Processed 168. [1.5182294851390266 Sents/sec]
+
+INFO:my_utils:Sending Request 42 to Parser Server...
+INFO:__main__:Time Elapsed: 113.5526921749115. Processed 172. [1.5147152982956924 Sents/sec]
+
+INFO:my_utils:Sending Request 43 to Parser Server...
+INFO:__main__:Time Elapsed: 115.98013949394226. Processed 176. [1.5175011926002437 Sents/sec]
+
+INFO:my_utils:Sending Request 44 to Parser Server...
+INFO:__main__:Time Elapsed: 118.35147786140442. Processed 180. [1.5208935558100012 Sents/sec]
+
+INFO:my_utils:Sending Request 45 to Parser Server...
+INFO:__main__:Time Elapsed: 121.10498547554016. Processed 184. [1.5193429013470539 Sents/sec]
+
+INFO:my_utils:Sending Request 46 to Parser Server...
+INFO:__main__:Time Elapsed: 123.55305361747742. Processed 188. [1.5216135457246693 Sents/sec]
+
+INFO:my_utils:Sending Request 47 to Parser Server...
+INFO:__main__:Time Elapsed: 125.96286916732788. Processed 192. [1.5242587063093094 Sents/sec]
+
+INFO:my_utils:Sending Request 48 to Parser Server...
+INFO:__main__:Time Elapsed: 128.8209056854248. Processed 196. [1.521492175180197 Sents/sec]
+
+INFO:my_utils:Sending Request 49 to Parser Server...
+INFO:__main__:Time Elapsed: 131.2418966293335. Processed 200. [1.5239036095680636 Sents/sec]
+
+INFO:my_utils:Sending Request 50 to Parser Server...
+INFO:__main__:Time Elapsed: 133.64410710334778. Processed 204. [1.526442163605804 Sents/sec]
+
+INFO:my_utils:Sending Request 51 to Parser Server...
+INFO:__main__:Time Elapsed: 136.543692111969. Processed 208. [1.5233219256253534 Sents/sec]
+
+INFO:my_utils:Sending Request 52 to Parser Server...
+INFO:__main__:Time Elapsed: 138.87571263313293. Processed 212. [1.526544821843968 Sents/sec]
+
+INFO:my_utils:Sending Request 53 to Parser Server...
+INFO:__main__:Time Elapsed: 141.23592972755432. Processed 216. [1.5293558828597398 Sents/sec]
+
+INFO:my_utils:Sending Request 54 to Parser Server...
+INFO:__main__:Time Elapsed: 144.02863264083862. Processed 220. [1.527474058221532 Sents/sec]
+
+INFO:my_utils:Sending Request 55 to Parser Server...
+INFO:__main__:Time Elapsed: 146.31481456756592. Processed 224. [1.530945452530101 Sents/sec]
+
+INFO:my_utils:Sending Request 56 to Parser Server...
+INFO:__main__:Chunking TIGER Corpus in chunks of 4 Sentences
+INFO:my_utils:Reading instances from lines in file at: /home/daza/datasets/TIGER_conll/tiger_release_aug07.corrected.16012013.conll09
+INFO:my_utils:Sending Request 0 to Parser Server...
+INFO:__main__:Time Elapsed: 2.405996799468994. Processed 4. [1.6625126022124401 Sents/sec]
+
+INFO:my_utils:Sending Request 1 to Parser Server...
+INFO:__main__:Time Elapsed: 4.411545991897583. Processed 8. [1.8134232340982301 Sents/sec]
+
+INFO:my_utils:Sending Request 2 to Parser Server...
+INFO:__main__:Time Elapsed: 6.336946964263916. Processed 12. [1.8936563723306923 Sents/sec]
+
+INFO:my_utils:Sending Request 3 to Parser Server...
+INFO:__main__:Time Elapsed: 8.761664152145386. Processed 16. [1.8261371038836534 Sents/sec]
+
+INFO:my_utils:Sending Request 4 to Parser Server...
+INFO:__main__:Time Elapsed: 10.7116219997406. Processed 20. [1.8671308603388295 Sents/sec]
+
+INFO:my_utils:Sending Request 5 to Parser Server...
+INFO:__main__:Time Elapsed: 12.786542892456055. Processed 24. [1.8769733306224456 Sents/sec]
+
+INFO:my_utils:Sending Request 6 to Parser Server...
+INFO:__main__:Time Elapsed: 15.390063762664795. Processed 28. [1.819355685057395 Sents/sec]
+
+INFO:my_utils:Sending Request 7 to Parser Server...
+INFO:__main__:Time Elapsed: 17.350337505340576. Processed 32. [1.844344525871623 Sents/sec]
+
+INFO:my_utils:Sending Request 8 to Parser Server...
+INFO:__main__:Time Elapsed: 19.427443981170654. Processed 36. [1.8530487095930732 Sents/sec]
+
+INFO:my_utils:Sending Request 9 to Parser Server...
+INFO:__main__:Time Elapsed: 21.852174043655396. Processed 40. [1.8304814852787465 Sents/sec]
+
+INFO:__main__:Processing File /home/daza/datasets/TIGER_conll/tiger_release_aug07.corrected.16012013.conll09 took 21.852431297302246 seconds!
+INFO:__main__:Chunking TIGER Corpus in chunks of 4 Sentences
+INFO:my_utils:Reading instances from lines in file at: /home/daza/datasets/TIGER_conll/tiger_release_aug07.corrected.16012013.conll09
+INFO:my_utils:Sending Request 0 to Parser Server...
+INFO:__main__:Time Elapsed: 1.912651777267456. Processed 4. [2.0913372980599068 Sents/sec]
+
+INFO:my_utils:Sending Request 1 to Parser Server...
+INFO:__main__:Time Elapsed: 3.8369903564453125. Processed 8. [2.084967450220909 Sents/sec]
+
+INFO:my_utils:Sending Request 2 to Parser Server...
+INFO:__main__:Time Elapsed: 6.319569110870361. Processed 12. [1.8988636391931637 Sents/sec]
+
+INFO:my_utils:Sending Request 3 to Parser Server...
+INFO:__main__:Time Elapsed: 8.18579888343811. Processed 16. [1.9546045814015716 Sents/sec]
+
+INFO:my_utils:Sending Request 4 to Parser Server...
+INFO:__main__:Time Elapsed: 10.15789270401001. Processed 20. [1.9689123111238065 Sents/sec]
+
+INFO:my_utils:Sending Request 5 to Parser Server...
+INFO:__main__:Time Elapsed: 12.712148427963257. Processed 24. [1.8879578173589093 Sents/sec]
+
+INFO:my_utils:Sending Request 6 to Parser Server...
+INFO:__main__:Time Elapsed: 14.736063957214355. Processed 28. [1.9001003308140503 Sents/sec]
+
+INFO:my_utils:Sending Request 7 to Parser Server...
+INFO:__main__:Time Elapsed: 16.73722553253174. Processed 32. [1.9119058853453565 Sents/sec]
+
+INFO:my_utils:Sending Request 8 to Parser Server...
+INFO:__main__:Time Elapsed: 19.437472343444824. Processed 36. [1.852092667395655 Sents/sec]
+
+INFO:my_utils:Sending Request 9 to Parser Server...
+INFO:__main__:Time Elapsed: 21.33689522743225. Processed 40. [1.8746869951619352 Sents/sec]
+
+INFO:__main__:Processing File /home/daza/datasets/TIGER_conll/tiger_release_aug07.corrected.16012013.conll09 took 21.337210416793823 seconds!
+INFO:__main__:Chunking TIGER Corpus in chunks of 4 Sentences
+INFO:my_utils:Reading instances from lines in file at: /home/daza/datasets/TIGER_conll/tiger_release_aug07.corrected.16012013.conll09
+INFO:my_utils:Sending Request 0 to Parser Server...
+INFO:__main__:Time Elapsed: 1.9996423721313477. Processed 4. [2.0003576918289356 Sents/sec]
+
+INFO:my_utils:Sending Request 1 to Parser Server...
+INFO:__main__:Time Elapsed: 4.532586097717285. Processed 8. [1.764996809223102 Sents/sec]
+
+INFO:my_utils:Sending Request 2 to Parser Server...
+INFO:__main__:Time Elapsed: 6.610581636428833. Processed 12. [1.8152714329812947 Sents/sec]
+
+INFO:my_utils:Sending Request 3 to Parser Server...
+INFO:__main__:Time Elapsed: 8.619524002075195. Processed 16. [1.8562509943876155 Sents/sec]
+
+INFO:my_utils:Sending Request 4 to Parser Server...
+INFO:__main__:Time Elapsed: 11.058376789093018. Processed 20. [1.808583699166969 Sents/sec]
+
+INFO:my_utils:Sending Request 5 to Parser Server...
+INFO:__main__:Time Elapsed: 13.353788614273071. Processed 24. [1.7972427670711986 Sents/sec]
+
+INFO:my_utils:Sending Request 6 to Parser Server...
+INFO:__main__:Time Elapsed: 15.284202814102173. Processed 28. [1.831956847246585 Sents/sec]
+
+INFO:my_utils:Sending Request 7 to Parser Server...
+INFO:__main__:Chunking TIGER Corpus in chunks of 4 Sentences
+INFO:my_utils:Reading instances from lines in file at: /home/daza/datasets/TIGER_conll/tiger_release_aug07.corrected.16012013.conll09
+INFO:__main__:Chunking TIGER Corpus in chunks of 4 Sentences
+INFO:my_utils:Reading instances from lines in file at: /home/daza/datasets/TIGER_conll/tiger_release_aug07.corrected.16012013.conll09
+INFO:__main__:Chunking TIGER Corpus in chunks of 4 Sentences
+INFO:my_utils:Reading instances from lines in file at: /home/daza/datasets/TIGER_conll/tiger_release_aug07.corrected.16012013.conll09
+INFO:my_utils:Sending Request 0 to Parser Server...
+INFO:__main__:Time Elapsed: 1.976405143737793. Processed 4. [2.0238765380033206 Sents/sec]
+
+INFO:my_utils:Sending Request 1 to Parser Server...
+INFO:__main__:Time Elapsed: 3.9668445587158203. Processed 8. [2.0167162795483535 Sents/sec]
+
+INFO:my_utils:Sending Request 2 to Parser Server...
+INFO:__main__:Time Elapsed: 6.430184841156006. Processed 12. [1.8661982970061346 Sents/sec]
+
+INFO:my_utils:Sending Request 3 to Parser Server...
+INFO:__main__:Time Elapsed: 8.294080257415771. Processed 16. [1.92908671045163 Sents/sec]
+
+INFO:my_utils:Sending Request 4 to Parser Server...
+INFO:__main__:Time Elapsed: 10.314137697219849. Processed 20. [1.9390859989576203 Sents/sec]
+
+INFO:my_utils:Sending Request 5 to Parser Server...
+INFO:__main__:Time Elapsed: 12.794687271118164. Processed 24. [1.8757785549144237 Sents/sec]
+
+INFO:my_utils:Sending Request 6 to Parser Server...
+INFO:__main__:Time Elapsed: 14.684069871902466. Processed 28. [1.9068283006182893 Sents/sec]
+
+INFO:my_utils:Sending Request 7 to Parser Server...
+INFO:__main__:Time Elapsed: 16.59351873397827. Processed 32. [1.928463788362991 Sents/sec]
+
+INFO:my_utils:Sending Request 8 to Parser Server...
+INFO:__main__:Time Elapsed: 18.955203771591187. Processed 36. [1.8992146132427463 Sents/sec]
+
+INFO:my_utils:Sending Request 9 to Parser Server...
+INFO:__main__:Time Elapsed: 20.837483644485474. Processed 40. [1.9196175835072955 Sents/sec]
+
+INFO:__main__:Processing File /home/daza/datasets/TIGER_conll/tiger_release_aug07.corrected.16012013.conll09 took 20.837707042694092 seconds!
+INFO:__main__:Chunking TIGER Corpus in chunks of 4 Sentences
+INFO:my_utils:Reading instances from lines in file at: /home/daza/datasets/TIGER_conll/tiger_release_aug07.corrected.16012013.conll09
+INFO:my_utils:Sending Request 0 to Parser Server...
+INFO:__main__:Time Elapsed: 1.8857543468475342. Processed 4. [2.1211670579929494 Sents/sec]
+
+INFO:my_utils:Sending Request 1 to Parser Server...
+INFO:__main__:Time Elapsed: 4.313926458358765. Processed 8. [1.8544590588694467 Sents/sec]
+
+INFO:my_utils:Sending Request 2 to Parser Server...
+INFO:__main__:Time Elapsed: 6.276944637298584. Processed 12. [1.9117581392536311 Sents/sec]
+
+INFO:my_utils:Sending Request 3 to Parser Server...
+INFO:__main__:Time Elapsed: 8.233506441116333. Processed 16. [1.943278980155951 Sents/sec]
+
+INFO:my_utils:Sending Request 4 to Parser Server...
+INFO:__main__:Time Elapsed: 10.609818935394287. Processed 20. [1.885046306801724 Sents/sec]
+
+INFO:my_utils:Sending Request 5 to Parser Server...
+INFO:__main__:Time Elapsed: 12.564550876617432. Processed 24. [1.910135924131111 Sents/sec]
+
+INFO:my_utils:Sending Request 6 to Parser Server...
+INFO:__main__:Time Elapsed: 14.491822242736816. Processed 28. [1.9321241684449568 Sents/sec]
+
+INFO:my_utils:Sending Request 7 to Parser Server...
+INFO:__main__:Time Elapsed: 16.880109786987305. Processed 32. [1.8957222674385954 Sents/sec]
+
+INFO:my_utils:Sending Request 8 to Parser Server...
+INFO:__main__:Time Elapsed: 18.87423801422119. Processed 36. [1.9073617686115352 Sents/sec]
+
+INFO:my_utils:Sending Request 9 to Parser Server...
+INFO:__main__:Time Elapsed: 20.83071756362915. Processed 40. [1.920241099607668 Sents/sec]
+
+INFO:__main__:Processing File /home/daza/datasets/TIGER_conll/tiger_release_aug07.corrected.16012013.conll09 took 20.831073999404907 seconds!
+INFO:__main__:Chunking TIGER Corpus in chunks of 10000 Sentences
+INFO:my_utils:Reading instances from lines in file at: /home/daza/datasets/TIGER_conll/tiger_release_aug07.corrected.16012013.conll09
+INFO:my_utils:Sending Request 0 to Parser Server...
+INFO:__main__:Time Elapsed: 45.208128929138184. Processed 10000. [221.19915680816106 Sents/sec]
+
+INFO:my_utils:Sending Request 1 to Parser Server...
+INFO:__main__:Time Elapsed: 92.34467482566833. Processed 20000. [216.57989524308505 Sents/sec]
+
+INFO:my_utils:Sending Request 2 to Parser Server...
+INFO:__main__:Time Elapsed: 138.04999089241028. Processed 30000. [217.31258224696734 Sents/sec]
+
+INFO:my_utils:Sending Request 3 to Parser Server...
+INFO:__main__:Time Elapsed: 181.3346757888794. Processed 40000. [220.58660223690683 Sents/sec]
+
+INFO:my_utils:Sending Request 4 to Parser Server...
+INFO:__main__:Time Elapsed: 226.86525297164917. Processed 50000. [220.39514357118577 Sents/sec]
+
+INFO:my_utils:Sending Request 5 to Parser Server...
+INFO:__main__:Time Elapsed: 232.3156774044037. Processed 50472. [217.25610842931115 Sents/sec]
+
+INFO:__main__:Processing File /home/daza/datasets/TIGER_conll/tiger_release_aug07.corrected.16012013.conll09 took 232.31602954864502 seconds!
+INFO:__main__:Chunking TIGER Corpus in chunks of 10000 Sentences
+INFO:my_utils:Reading instances from lines in file at: /home/daza/datasets/TIGER_conll/tiger_release_aug07.corrected.16012013.conll09
+INFO:my_utils:Sending Request 0 to Parser Server...
+INFO:__main__:Time Elapsed: 44.833308696746826. Processed 10000. [223.0484497060021 Sents/sec]
+
+INFO:my_utils:Sending Request 1 to Parser Server...
+INFO:__main__:Time Elapsed: 91.50138306617737. Processed 20000. [218.5759310931423 Sents/sec]
+
+INFO:my_utils:Sending Request 2 to Parser Server...
+INFO:__main__:Time Elapsed: 137.80317568778992. Processed 30000. [217.70180440520977 Sents/sec]
+
+INFO:my_utils:Sending Request 3 to Parser Server...
+INFO:__main__:Time Elapsed: 183.3420286178589. Processed 40000. [218.1714705653895 Sents/sec]
+
+INFO:my_utils:Sending Request 4 to Parser Server...
+INFO:__main__:Time Elapsed: 228.61404871940613. Processed 50000. [218.7092187906985 Sents/sec]
+
+INFO:my_utils:Sending Request 5 to Parser Server...
+INFO:__main__:Time Elapsed: 234.00832319259644. Processed 50472. [215.68463596254185 Sents/sec]
+
+INFO:__main__:Processing File /home/daza/datasets/TIGER_conll/tiger_release_aug07.corrected.16012013.conll09 took 234.00871419906616 seconds!