blob: e873a16d3a09ac76e8e63d87ffb09e4a5c19a8ab [file] [log] [blame]
dazaa3c8c8b2020-08-31 17:19:11 +02001INFO:__main__:Start Logging
2INFO:__main__:Chunking in Files of 20000 Sentences
3INFO:__main__:File /export/netapp/kupietz/N-GRAMM-STUDIE/conllu/a00.conllu is already uncompressed. Skipping this step...
4INFO:__main__:Successfully fixed comments on file
5INFO:__main__:Reading instances from lines in file at: /export/netapp/kupietz/N-GRAMM-STUDIE/conllu/a00.conllu.fixed
6INFO:__main__:Sending Request 0 to Parser Server...
7INFO:__main__:Time Elapsed: 98.19491934776306. Processed 20000. [203.67652555595905 Sents/sec]
8
9INFO:__main__:Sending Request 1 to Parser Server...
10INFO:__main__:Time Elapsed: 178.8947925567627. Processed 40000. [223.5951054154253 Sents/sec]
11
12INFO:__main__:Sending Request 2 to Parser Server...
13INFO:__main__:Time Elapsed: 258.42775654792786. Processed 60000. [232.1732030702841 Sents/sec]
14
15INFO:__main__:Sending Request 3 to Parser Server...
16INFO:__main__:Time Elapsed: 337.31846141815186. Processed 80000. [237.16460600366958 Sents/sec]
17
18INFO:__main__:Sending Request 4 to Parser Server...
19INFO:__main__:Time Elapsed: 420.1129512786865. Processed 100000. [238.03122397353542 Sents/sec]
20
21INFO:__main__:Sending Request 5 to Parser Server...
22INFO:__main__:Time Elapsed: 499.3560426235199. Processed 120000. [240.30949814794118 Sents/sec]
23
24INFO:__main__:Sending Request 6 to Parser Server...
25INFO:__main__:Time Elapsed: 580.2616112232208. Processed 140000. [241.27048436803 Sents/sec]
26
27INFO:__main__:Sending Request 7 to Parser Server...
28INFO:__main__:Time Elapsed: 664.2827656269073. Processed 160000. [240.86128419875877 Sents/sec]
29
30INFO:__main__:Sending Request 8 to Parser Server...
31INFO:__main__:Time Elapsed: 744.8023872375488. Processed 180000. [241.67484299777146 Sents/sec]
32
33INFO:__main__:Sending Request 9 to Parser Server...
34INFO:__main__:Time Elapsed: 825.8918900489807. Processed 200000. [242.16244572656927 Sents/sec]
35
36INFO:__main__:Sending Request 10 to Parser Server...
37INFO:__main__:Time Elapsed: 903.7794210910797. Processed 220000. [243.42222766524927 Sents/sec]
38
39INFO:__main__:Sending Request 11 to Parser Server...
40INFO:__main__:Time Elapsed: 983.4670946598053. Processed 240000. [244.03460095736023 Sents/sec]
41
42INFO:__main__:Sending Request 12 to Parser Server...
43INFO:__main__:Time Elapsed: 1064.4692878723145. Processed 260000. [244.25317194420325 Sents/sec]
44
45INFO:__main__:Sending Request 13 to Parser Server...
46INFO:__main__:Time Elapsed: 1148.1249577999115. Processed 280000. [243.8758935582661 Sents/sec]
47
48INFO:__main__:Sending Request 14 to Parser Server...
49INFO:__main__:Time Elapsed: 1231.3249888420105. Processed 300000. [243.63998352874535 Sents/sec]
50
51INFO:__main__:Sending Request 15 to Parser Server...
52INFO:__main__:Time Elapsed: 1313.075716972351. Processed 320000. [243.70262572355384 Sents/sec]
53
54INFO:__main__:Sending Request 16 to Parser Server...
55INFO:__main__:Time Elapsed: 1394.967396736145. Processed 340000. [243.73329498274305 Sents/sec]
56
57INFO:__main__:Sending Request 17 to Parser Server...
58INFO:__main__:Time Elapsed: 1476.8235352039337. Processed 360000. [243.76642937931499 Sents/sec]
59
60INFO:__main__:Sending Request 18 to Parser Server...
61INFO:__main__:Time Elapsed: 1557.1394641399384. Processed 380000. [244.03722900304697 Sents/sec]
62
63INFO:__main__:Sending Request 19 to Parser Server...
64INFO:__main__:Time Elapsed: 1641.3248417377472. Processed 400000. [243.70556627687506 Sents/sec]
65
66INFO:__main__:Sending Request 20 to Parser Server...
67INFO:__main__:Time Elapsed: 1721.7012026309967. Processed 420000. [243.944767743777 Sents/sec]
68
69INFO:__main__:Sending Request 21 to Parser Server...
70INFO:__main__:Time Elapsed: 1804.4057919979095. Processed 440000. [243.84758791580612 Sents/sec]
71
72INFO:__main__:Sending Request 22 to Parser Server...
73INFO:__main__:Time Elapsed: 1887.0067677497864. Processed 460000. [243.77231065712593 Sents/sec]
74
75INFO:__main__:Sending Request 23 to Parser Server...
76INFO:__main__:Time Elapsed: 2015.9566264152527. Processed 480000. [238.10036074711073 Sents/sec]
77
78INFO:__main__:Sending Request 24 to Parser Server...
79INFO:__main__:Time Elapsed: 2139.8701055049896. Processed 500000. [233.6590425342685 Sents/sec]
80
81INFO:__main__:Sending Request 25 to Parser Server...
82INFO:__main__:Time Elapsed: 2273.1346604824066. Processed 520000. [228.75899481012056 Sents/sec]
83
84INFO:__main__:Sending Request 26 to Parser Server...
85INFO:__main__:Time Elapsed: 2404.8847119808197. Processed 540000. [224.54298840596846 Sents/sec]
86
87INFO:__main__:Sending Request 27 to Parser Server...
88INFO:__main__:Time Elapsed: 2530.600071668625. Processed 560000. [221.29138707830182 Sents/sec]
89
90INFO:__main__:Sending Request 28 to Parser Server...
91INFO:__main__:Time Elapsed: 2656.4930505752563. Processed 580000. [218.33296340617287 Sents/sec]
92
93INFO:__main__:Sending Request 29 to Parser Server...
94INFO:__main__:Time Elapsed: 2781.2974302768707. Processed 600000. [215.72665816624712 Sents/sec]
95
96INFO:__main__:Sending Request 30 to Parser Server...
97INFO:__main__:Time Elapsed: 2907.4323580265045. Processed 620000. [213.24657761628586 Sents/sec]
98
99INFO:__main__:Sending Request 31 to Parser Server...
100INFO:__main__:Time Elapsed: 3030.6001527309418. Processed 640000. [211.17929378551693 Sents/sec]
101
102INFO:__main__:Sending Request 32 to Parser Server...
103INFO:__main__:Time Elapsed: 3155.522436141968. Processed 660000. [209.15712480464404 Sents/sec]
104
105INFO:__main__:Sending Request 33 to Parser Server...
106INFO:__main__:Time Elapsed: 3279.3324024677277. Processed 680000. [207.35927821415535 Sents/sec]
107
108INFO:__main__:Sending Request 34 to Parser Server...
109INFO:__main__:Time Elapsed: 3403.92253446579. Processed 700000. [205.6451029399991 Sents/sec]
110
111INFO:__main__:Sending Request 35 to Parser Server...
112INFO:__main__:Time Elapsed: 3523.8551886081696. Processed 720000. [204.3216765341544 Sents/sec]
113
114INFO:__main__:Sending Request 36 to Parser Server...
115INFO:__main__:Time Elapsed: 3649.4880363941193. Processed 740000. [202.76816710191434 Sents/sec]
116
117INFO:__main__:Sending Request 37 to Parser Server...
118INFO:__main__:Time Elapsed: 3769.89262509346. Processed 760000. [201.59725370988747 Sents/sec]
119
120INFO:__main__:Sending Request 38 to Parser Server...
121INFO:__main__:Time Elapsed: 3896.9183082580566. Processed 780000. [200.1581604487532 Sents/sec]
122
123INFO:__main__:Sending Request 39 to Parser Server...
124INFO:__main__:Time Elapsed: 4012.452913761139. Processed 800000. [199.3792867341356 Sents/sec]
125
126INFO:__main__:Sending Request 40 to Parser Server...
127INFO:__main__:Time Elapsed: 4123.85481595993. Processed 820000. [198.84308167845248 Sents/sec]
128
129INFO:__main__:Sending Request 41 to Parser Server...
130INFO:__main__:Time Elapsed: 4244.3920249938965. Processed 840000. [197.9082033548039 Sents/sec]
131
132INFO:__main__:Sending Request 42 to Parser Server...
133INFO:__main__:Time Elapsed: 4366.287281751633. Processed 860000. [196.96367749191987 Sents/sec]
134
135INFO:__main__:Sending Request 43 to Parser Server...
136INFO:__main__:Time Elapsed: 4488.923060178757. Processed 880000. [196.0381116367267 Sents/sec]
137
138INFO:__main__:Sending Request 44 to Parser Server...
139INFO:__main__:Time Elapsed: 4610.694122076035. Processed 900000. [195.19837494549768 Sents/sec]
140
141INFO:__main__:Sending Request 45 to Parser Server...
142INFO:__main__:Time Elapsed: 4731.4308161735535. Processed 920000. [194.44435219366284 Sents/sec]
143
144INFO:__main__:Sending Request 46 to Parser Server...
145INFO:__main__:Time Elapsed: 4855.6209988594055. Processed 940000. [193.59006813357297 Sents/sec]
146
147INFO:__main__:Sending Request 47 to Parser Server...
148INFO:__main__:Time Elapsed: 4980.613188266754. Processed 960000. [192.74735132243396 Sents/sec]
149
150INFO:__main__:Sending Request 48 to Parser Server...
151INFO:__main__:Time Elapsed: 5098.693638086319. Processed 980000. [192.20609622032933 Sents/sec]
152
153INFO:__main__:Sending Request 49 to Parser Server...
154INFO:__main__:Time Elapsed: 5221.365651845932. Processed 1000000. [191.5207757277956 Sents/sec]
155
156INFO:__main__:Sending Request 50 to Parser Server...
157INFO:__main__:Time Elapsed: 5339.519736289978. Processed 1020000. [191.02841648240064 Sents/sec]
158
159INFO:__main__:Sending Request 51 to Parser Server...
160INFO:__main__:Time Elapsed: 5461.673362731934. Processed 1040000. [190.41783184921024 Sents/sec]
161
162INFO:__main__:Sending Request 52 to Parser Server...
163INFO:__main__:Time Elapsed: 5584.106055259705. Processed 1060000. [189.82447494914237 Sents/sec]
164
165INFO:__main__:Sending Request 53 to Parser Server...
166INFO:__main__:Time Elapsed: 5703.546013832092. Processed 1080000. [189.35588445868797 Sents/sec]
167
168INFO:__main__:Sending Request 54 to Parser Server...
169INFO:__main__:Time Elapsed: 5821.955971479416. Processed 1100000. [188.93993795017988 Sents/sec]
170
171INFO:__main__:Sending Request 55 to Parser Server...
172INFO:__main__:Time Elapsed: 5940.822002887726. Processed 1120000. [188.52609949525308 Sents/sec]
173
174INFO:__main__:Sending Request 56 to Parser Server...
175INFO:__main__:Time Elapsed: 6057.515177726746. Processed 1140000. [188.19597913542782 Sents/sec]
176
177INFO:__main__:Sending Request 57 to Parser Server...
178INFO:__main__:Time Elapsed: 6175.445195436478. Processed 1160000. [187.84070836823477 Sents/sec]
179
180INFO:__main__:Sending Request 58 to Parser Server...
181INFO:__main__:Time Elapsed: 6293.141885995865. Processed 1180000. [187.50570404679024 Sents/sec]
182
183INFO:__main__:Sending Request 59 to Parser Server...
184INFO:__main__:Time Elapsed: 6407.568333148956. Processed 1200000. [187.27853338557657 Sents/sec]
185
186INFO:__main__:Sending Request 60 to Parser Server...
187INFO:__main__:Time Elapsed: 6519.235458374023. Processed 1220000. [187.13850846312013 Sents/sec]
188
189INFO:__main__:Sending Request 61 to Parser Server...
190INFO:__main__:Time Elapsed: 6633.7648096084595. Processed 1240000. [186.92251467883858 Sents/sec]
191
192INFO:__main__:Sending Request 62 to Parser Server...
193INFO:__main__:Time Elapsed: 6748.994223117828. Processed 1260000. [186.69448488843403 Sents/sec]
194
195INFO:__main__:Sending Request 63 to Parser Server...
196INFO:__main__:Time Elapsed: 6866.852972269058. Processed 1280000. [186.4027095336281 Sents/sec]
197
198INFO:__main__:Sending Request 64 to Parser Server...
199INFO:__main__:Time Elapsed: 6990.777011871338. Processed 1300000. [185.95930005955194 Sents/sec]
200
201INFO:__main__:Sending Request 65 to Parser Server...
202INFO:__main__:Time Elapsed: 7105.517110586166. Processed 1320000. [185.77113804052289 Sents/sec]
203
204INFO:__main__:Sending Request 66 to Parser Server...
205INFO:__main__:Time Elapsed: 7225.482071638107. Processed 1340000. [185.45475398241564 Sents/sec]
206
207INFO:__main__:Sending Request 67 to Parser Server...
208INFO:__main__:Time Elapsed: 7337.8775935173035. Processed 1360000. [185.33969566370268 Sents/sec]
209
210INFO:__main__:Sending Request 68 to Parser Server...
211INFO:__main__:Time Elapsed: 7455.035196065903. Processed 1380000. [185.10979005548356 Sents/sec]
212
213INFO:__main__:Sending Request 69 to Parser Server...
214INFO:__main__:Time Elapsed: 7578.5934200286865. Processed 1400000. [184.7308494344193 Sents/sec]
215
216INFO:__main__:Sending Request 70 to Parser Server...
217INFO:__main__:Time Elapsed: 7692.598174333572. Processed 1420000. [184.59302927557604 Sents/sec]
218
219INFO:__main__:Sending Request 71 to Parser Server...
220INFO:__main__:Time Elapsed: 7809.916503667831. Processed 1440000. [184.38097248846665 Sents/sec]
221
222INFO:__main__:Sending Request 72 to Parser Server...
223INFO:__main__:Time Elapsed: 7931.408297300339. Processed 1460000. [184.07828033477347 Sents/sec]
224
225INFO:__main__:Sending Request 73 to Parser Server...
226INFO:__main__:Time Elapsed: 8043.090455055237. Processed 1480000. [184.00887174777347 Sents/sec]
227
228INFO:__main__:Sending Request 74 to Parser Server...
229INFO:__main__:Time Elapsed: 8154.90810251236. Processed 1500000. [183.93830821194427 Sents/sec]
230
231INFO:__main__:Sending Request 75 to Parser Server...
232INFO:__main__:Time Elapsed: 8268.902240037918. Processed 1520000. [183.821256543605 Sents/sec]
233
234INFO:__main__:Sending Request 76 to Parser Server...
235INFO:__main__:Time Elapsed: 8386.647283315659. Processed 1540000. [183.6252256683867 Sents/sec]
236
237INFO:__main__:Sending Request 77 to Parser Server...
238INFO:__main__:Time Elapsed: 8499.714630842209. Processed 1560000. [183.535573575536 Sents/sec]
239
240INFO:__main__:Sending Request 78 to Parser Server...
241INFO:__main__:Time Elapsed: 8609.53560590744. Processed 1580000. [183.51744766766302 Sents/sec]
242
243INFO:__main__:Sending Request 79 to Parser Server...
244INFO:__main__:Time Elapsed: 8720.773554086685. Processed 1600000. [183.46996285096935 Sents/sec]
245
246INFO:__main__:Sending Request 80 to Parser Server...
247INFO:__main__:Time Elapsed: 8831.752426862717. Processed 1620000. [183.42905481279087 Sents/sec]
248
249INFO:__main__:Sending Request 81 to Parser Server...
250INFO:__main__:Time Elapsed: 8940.69381070137. Processed 1640000. [183.43095454594783 Sents/sec]
251
252INFO:__main__:Sending Request 82 to Parser Server...
253INFO:__main__:Time Elapsed: 9054.10047864914. Processed 1660000. [183.34234349558156 Sents/sec]
254
255INFO:__main__:Sending Request 83 to Parser Server...
256INFO:__main__:Time Elapsed: 9169.408634662628. Processed 1680000. [183.21792243495238 Sents/sec]
257
258INFO:__main__:Sending Request 84 to Parser Server...
259INFO:__main__:Time Elapsed: 9278.584917545319. Processed 1700000. [183.21759353469827 Sents/sec]
260
261INFO:__main__:Sending Request 85 to Parser Server...
262INFO:__main__:Time Elapsed: 9385.278182506561. Processed 1720000. [183.26574519719065 Sents/sec]
263
264INFO:__main__:Sending Request 86 to Parser Server...
265INFO:__main__:Time Elapsed: 9499.239807844162. Processed 1740000. [183.17255224604023 Sents/sec]
266
267INFO:__main__:Sending Request 87 to Parser Server...
268INFO:__main__:Time Elapsed: 9611.59985089302. Processed 1760000. [183.1120757525582 Sents/sec]
269
270INFO:__main__:Sending Request 88 to Parser Server...
271INFO:__main__:Time Elapsed: 9722.264467716217. Processed 1780000. [183.0849187358227 Sents/sec]
272
273INFO:__main__:Sending Request 89 to Parser Server...
274INFO:__main__:Time Elapsed: 9835.523452997208. Processed 1800000. [183.01008671292232 Sents/sec]
275
276INFO:__main__:Sending Request 90 to Parser Server...
277INFO:__main__:Time Elapsed: 9946.680324554443. Processed 1820000. [182.97562006764562 Sents/sec]
278
279INFO:__main__:Sending Request 91 to Parser Server...
280INFO:__main__:Time Elapsed: 10007.997486114502. Processed 1830665. [182.92020981619333 Sents/sec]
281
282INFO:__main__:Processing File /export/netapp/kupietz/N-GRAMM-STUDIE/conllu/a00.conllu.gz took 10007.997836351395 seconds!
dazae94ab182020-09-01 16:41:30 +0200283INFO:__main__:Start Logging
284INFO:__main__:Chunking in Files of 20000 Sentences
285INFO:__main__:File /export/netapp/kupietz/N-GRAMM-STUDIE/conllu/a00.conllu is already uncompressed. Skipping this step...
286INFO:__main__:Successfully fixed comments on file
287INFO:__main__:Start Logging
288INFO:__main__:Chunking in Files of 20000 Sentences
289INFO:__main__:File /export/netapp/kupietz/N-GRAMM-STUDIE/conllu/a00.conllu is already uncompressed. Skipping this step...
290INFO:__main__:Successfully fixed comments on file
291INFO:__main__:Start Logging
292INFO:__main__:Chunking in Files of 20000 Sentences
293INFO:__main__:File /export/netapp/kupietz/N-GRAMM-STUDIE/conllu/a00.conllu is already uncompressed. Skipping this step...
294INFO:__main__:Successfully fixed comments on file
295INFO:my_utils:Reading instances from lines in file at: /export/netapp/kupietz/N-GRAMM-STUDIE/conllu/a00.conllu.fixed
296INFO:__main__:Start Logging
297INFO:__main__:Chunking in Files of 20000 Sentences
298INFO:__main__:File /export/netapp/kupietz/N-GRAMM-STUDIE/conllu/a00.conllu is already uncompressed. Skipping this step...
299INFO:__main__:Successfully fixed comments on file
300INFO:my_utils:Reading instances from lines in file at: /export/netapp/kupietz/N-GRAMM-STUDIE/conllu/a00.conllu.fixed
301INFO:my_utils:Sending Request 0 to Parser Server...
302INFO:__main__:Start Logging
303INFO:__main__:Chunking in Files of 20000 Sentences
304INFO:__main__:File /export/netapp/kupietz/N-GRAMM-STUDIE/conllu/a00.conllu is already uncompressed. Skipping this step...
305INFO:__main__:Successfully fixed comments on file
306INFO:my_utils:Reading instances from lines in file at: /export/netapp/kupietz/N-GRAMM-STUDIE/conllu/a00.conllu.fixed
307INFO:my_utils:Sending Request 0 to Parser Server...
308INFO:__main__:Time Elapsed: 256.55612111091614. Processed 20000. [77.95565318573499 Sents/sec]
309
310INFO:my_utils:Sending Request 1 to Parser Server...
311INFO:__main__:Chunking TIGER Corpus in chunks of 20000 Sentences
312INFO:__main__:Chunking TIGER Corpus in chunks of 20000 Sentences
313INFO:my_utils:Reading instances from lines in file at: /home/daza/datasets/tiger_release_aug07.corrected.16012013.conll09
314INFO:__main__:Chunking TIGER Corpus in chunks of 20000 Sentences
315INFO:my_utils:Reading instances from lines in file at: /home/daza/datasets/tiger_release_aug07.corrected.16012013.conll09
316INFO:__main__:Time Elapsed: 7.804205894470215. Processed 20000. [2562.7207009199096 Sents/sec]
317
318INFO:__main__:Time Elapsed: 15.504295587539673. Processed 40000. [2579.930173167414 Sents/sec]
319
320INFO:__main__:Time Elapsed: 18.71819543838501. Processed 50472. [2696.413773760377 Sents/sec]
321
322INFO:__main__:Chunking TIGER Corpus in chunks of 20000 Sentences
323INFO:my_utils:Reading instances from lines in file at: /home/daza/datasets/tiger_release_aug07.corrected.16012013.conll09
324INFO:__main__:Chunking TIGER Corpus in chunks of 20000 Sentences
325INFO:my_utils:Reading instances from lines in file at: /home/daza/datasets/tiger_release_aug07.corrected.16012013.conll09
326INFO:my_utils:Sending Request 0 to Parser Server...
327INFO:__main__:Chunking TIGER Corpus in chunks of 10000 Sentences
328INFO:my_utils:Reading instances from lines in file at: /home/daza/datasets/tiger_release_aug07.corrected.16012013.conll09
329INFO:my_utils:Sending Request 0 to Parser Server...
330INFO:__main__:Chunking TIGER Corpus in chunks of 2 Sentences
331INFO:my_utils:Reading instances from lines in file at: /home/daza/datasets/tiger_release_aug07.corrected.16012013.conll09
332INFO:__main__:Time Elapsed: 0.001314401626586914. Processed 2. [1521.6049337928532 Sents/sec]
333
334INFO:__main__:Time Elapsed: 0.0016019344329833984. Processed 4. [2496.9810983777347 Sents/sec]
335
336INFO:__main__:Processing File /home/daza/datasets/tiger_release_aug07.corrected.16012013.conll09 took 0.0016684532165527344 seconds!
337INFO:__main__:Chunking TIGER Corpus in chunks of 2 Sentences
338INFO:my_utils:Reading instances from lines in file at: /home/daza/datasets/tiger_release_aug07.corrected.16012013.conll09
339INFO:__main__:Time Elapsed: 0.0011761188507080078. Processed 2. [1700.50841273059 Sents/sec]
340
341INFO:__main__:Time Elapsed: 0.0015003681182861328. Processed 4. [2666.012394724297 Sents/sec]
342
343INFO:__main__:Processing File /home/daza/datasets/tiger_release_aug07.corrected.16012013.conll09 took 0.0015683174133300781 seconds!
344INFO:__main__:Chunking TIGER Corpus in chunks of 2 Sentences
345INFO:my_utils:Reading instances from lines in file at: /home/daza/datasets/tiger_release_aug07.corrected.16012013.conll09
346INFO:__main__:Chunking TIGER Corpus in chunks of 2 Sentences
347INFO:my_utils:Reading instances from lines in file at: /home/daza/datasets/tiger_release_aug07.corrected.16012013.conll09
348INFO:__main__:Chunking TIGER Corpus in chunks of 2 Sentences
349INFO:my_utils:Reading instances from lines in file at: /home/daza/datasets/tiger_release_aug07.corrected.16012013.conll09
350INFO:__main__:Time Elapsed: 0.0013751983642578125. Processed 2. [1454.3356449375867 Sents/sec]
351
352INFO:__main__:Time Elapsed: 0.0016794204711914062. Processed 4. [2381.7739920499716 Sents/sec]
353
354INFO:__main__:Processing File /home/daza/datasets/tiger_release_aug07.corrected.16012013.conll09 took 0.0017464160919189453 seconds!
355INFO:__main__:Chunking TIGER Corpus in chunks of 2 Sentences
356INFO:my_utils:Reading instances from lines in file at: /home/daza/datasets/tiger_release_aug07.corrected.16012013.conll09
357INFO:__main__:Time Elapsed: 0.0014057159423828125. Processed 2. [1422.7625508819538 Sents/sec]
358
359INFO:__main__:Time Elapsed: 0.0017058849334716797. Processed 4. [2344.824039133473 Sents/sec]
360
361INFO:__main__:Processing File /home/daza/datasets/tiger_release_aug07.corrected.16012013.conll09 took 0.0017724037170410156 seconds!
362INFO:__main__:Chunking TIGER Corpus in chunks of 10 Sentences
363INFO:my_utils:Reading instances from lines in file at: /home/daza/datasets/tiger_release_aug07.corrected.16012013.conll09
364INFO:my_utils:Sending Request 0 to Parser Server...
365INFO:__main__:Start Logging
366INFO:__main__:Chunking in Files of 20000 Sentences
367INFO:__main__:File tutorial_examples/mini_test_raw.conllu is already uncompressed. Skipping this step...
368INFO:__main__:Successfully fixed comments on file
369INFO:my_utils:Reading instances from lines in file at: tutorial_examples/mini_test_raw.conllu.fixed
370INFO:my_utils:Sending Request 0 to Parser Server...
371INFO:__main__:Start Logging
372INFO:__main__:Chunking in Files of 2 Sentences
373INFO:__main__:File tutorial_examples/mini_test_raw.conllu is already uncompressed. Skipping this step...
374INFO:__main__:Successfully fixed comments on file
375INFO:my_utils:Reading instances from lines in file at: tutorial_examples/mini_test_raw.conllu.fixed
376INFO:my_utils:Sending Request 0 to Parser Server...
377INFO:__main__:Start Logging
378INFO:__main__:Chunking in Files of 2 Sentences
379INFO:__main__:File tutorial_examples/mini_test_raw.conllu is already uncompressed. Skipping this step...
380INFO:__main__:Successfully fixed comments on file
381INFO:my_utils:Reading instances from lines in file at: tutorial_examples/mini_test_raw.conllu.fixed
382INFO:my_utils:Sending Request 0 to Parser Server...
383INFO:__main__:Start Logging
384INFO:__main__:Chunking in Files of 2 Sentences
385INFO:__main__:File tutorial_examples/mini_test_raw.conllu is already uncompressed. Skipping this step...
386INFO:__main__:Successfully fixed comments on file
387INFO:my_utils:Reading instances from lines in file at: tutorial_examples/mini_test_raw.conllu.fixed
388INFO:my_utils:Sending Request 0 to Parser Server...
389INFO:__main__:Start Logging
390INFO:__main__:Chunking in Files of 2 Sentences
391INFO:__main__:File tutorial_examples/mini_test_raw.conllu is already uncompressed. Skipping this step...
392INFO:__main__:Successfully fixed comments on file
393INFO:my_utils:Reading instances from lines in file at: tutorial_examples/mini_test_raw.conllu.fixed
394INFO:my_utils:Sending Request 0 to Parser Server...
395INFO:__main__:Time Elapsed: 98.24166512489319. Processed 2. [0.020357961130416807 Sents/sec]
396
397INFO:my_utils:Sending Request 1 to Parser Server...
398INFO:__main__:Time Elapsed: 100.21094870567322. Processed 4. [0.03991579814046356 Sents/sec]
399
400INFO:my_utils:Sending Request 2 to Parser Server...
401INFO:__main__:Time Elapsed: 102.53487825393677. Processed 6. [0.058516673566827326 Sents/sec]
402
403INFO:my_utils:Sending Request 3 to Parser Server...
404INFO:__main__:Time Elapsed: 104.4103856086731. Processed 8. [0.0766207303360008 Sents/sec]
405
406INFO:my_utils:Sending Request 4 to Parser Server...
407INFO:__main__:Time Elapsed: 106.3076753616333. Processed 10. [0.0940665851828891 Sents/sec]
408
409INFO:my_utils:Sending Request 5 to Parser Server...
410INFO:__main__:Time Elapsed: 108.6529791355133. Processed 12. [0.1104433591741047 Sents/sec]
411
412INFO:my_utils:Sending Request 6 to Parser Server...
413INFO:__main__:Time Elapsed: 110.82709813117981. Processed 14. [0.1263228960793414 Sents/sec]
414
415INFO:my_utils:Sending Request 7 to Parser Server...
416INFO:__main__:Time Elapsed: 112.87869834899902. Processed 16. [0.141745078868035 Sents/sec]
417
418INFO:my_utils:Sending Request 8 to Parser Server...
419INFO:__main__:Time Elapsed: 115.0978467464447. Processed 18. [0.15638867718918475 Sents/sec]
420
421INFO:my_utils:Sending Request 9 to Parser Server...
422INFO:__main__:Time Elapsed: 116.95462322235107. Processed 20. [0.17100649336432405 Sents/sec]
423
424INFO:my_utils:Sending Request 10 to Parser Server...
425INFO:__main__:Time Elapsed: 118.83606028556824. Processed 22. [0.18512899154627846 Sents/sec]
426
427INFO:my_utils:Sending Request 11 to Parser Server...
428INFO:__main__:Time Elapsed: 121.33323788642883. Processed 24. [0.1978023534034808 Sents/sec]
429
430INFO:my_utils:Sending Request 12 to Parser Server...
431INFO:__main__:Time Elapsed: 123.19998693466187. Processed 26. [0.21103898341960778 Sents/sec]
432
433INFO:my_utils:Sending Request 13 to Parser Server...
434INFO:__main__:Time Elapsed: 125.05164241790771. Processed 28. [0.22390749500456245 Sents/sec]
435
436INFO:my_utils:Sending Request 14 to Parser Server...
437INFO:__main__:Time Elapsed: 127.36129140853882. Processed 30. [0.23555037537872106 Sents/sec]
438
439INFO:my_utils:Sending Request 15 to Parser Server...
440INFO:__main__:Time Elapsed: 129.26071906089783. Processed 32. [0.2475616740529196 Sents/sec]
441
442INFO:my_utils:Sending Request 16 to Parser Server...
443INFO:__main__:Time Elapsed: 131.22510385513306. Processed 34. [0.25909676579516794 Sents/sec]
444
445INFO:my_utils:Sending Request 17 to Parser Server...
446INFO:__main__:Time Elapsed: 133.9056680202484. Processed 36. [0.2688459759190798 Sents/sec]
447
448INFO:my_utils:Sending Request 18 to Parser Server...
449INFO:__main__:Time Elapsed: 135.85143780708313. Processed 38. [0.2797173192525367 Sents/sec]
450
451INFO:__main__:Processing File tutorial_examples/mini_test_raw.conllu.gz took 135.8516595363617 seconds!
452INFO:__main__:Start Logging
453INFO:__main__:Chunking in Files of 20000 Sentences
454INFO:__main__:File /export/netapp/kupietz/N-GRAMM-STUDIE/conllu/a00.conllu is already uncompressed. Skipping this step...
455INFO:__main__:Chunking TIGER Corpus in chunks of 10 Sentences
456INFO:my_utils:Reading instances from lines in file at: /home/daza/datasets/tiger_release_aug07.corrected.16012013.conll09
457INFO:my_utils:Sending Request 0 to Parser Server...
458INFO:__main__:Chunking TIGER Corpus in chunks of 10 Sentences
459INFO:my_utils:Reading instances from lines in file at: /home/daza/datasets/tiger_release_aug07.corrected.16012013.conll09
460INFO:my_utils:Sending Request 0 to Parser Server...
461INFO:__main__:Chunking TIGER Corpus in chunks of 10 Sentences
462INFO:my_utils:Reading instances from lines in file at: /home/daza/datasets/tiger_release_aug07.corrected.16012013.conll09
463INFO:my_utils:Sending Request 0 to Parser Server...
464INFO:__main__:Chunking TIGER Corpus in chunks of 10 Sentences
465INFO:my_utils:Reading instances from lines in file at: /home/daza/datasets/tiger_release_aug07.corrected.16012013.conll09
466INFO:my_utils:Sending Request 0 to Parser Server...
467INFO:__main__:Chunking TIGER Corpus in chunks of 10 Sentences
468INFO:my_utils:Reading instances from lines in file at: /home/daza/datasets/tiger_release_aug07.corrected.16012013.conll09
469INFO:my_utils:Sending Request 0 to Parser Server...
470INFO:__main__:Chunking TIGER Corpus in chunks of 10 Sentences
471INFO:my_utils:Reading instances from lines in file at: /home/daza/datasets/tiger_release_aug07.corrected.16012013.conll09
472INFO:my_utils:Sending Request 0 to Parser Server...
473INFO:__main__:Chunking TIGER Corpus in chunks of 10 Sentences
474INFO:my_utils:Reading instances from lines in file at: /home/daza/datasets/tiger_release_aug07.corrected.16012013.conll09
475INFO:my_utils:Sending Request 0 to Parser Server...
476INFO:__main__:Time Elapsed: 2.2843611240386963. Processed 10. [4.377591570250607 Sents/sec]
477
478INFO:my_utils:Sending Request 1 to Parser Server...
479INFO:__main__:Time Elapsed: 4.711368083953857. Processed 20. [4.245051467771474 Sents/sec]
480
481INFO:__main__:Processing File /home/daza/datasets/tiger_release_aug07.corrected.16012013.conll09 took 4.711584091186523 seconds!
482INFO:__main__:Chunking TIGER Corpus in chunks of 10000 Sentences
483INFO:my_utils:Reading instances from lines in file at: /home/daza/datasets/tiger_release_aug07.corrected.16012013.conll09
484INFO:my_utils:Sending Request 0 to Parser Server...
485INFO:__main__:Time Elapsed: 147.4470341205597. Processed 10000. [67.82096404749332 Sents/sec]
486
487INFO:my_utils:Sending Request 1 to Parser Server...
488INFO:__main__:Time Elapsed: 269.8712537288666. Processed 20000. [74.1094122610537 Sents/sec]
489
490INFO:my_utils:Sending Request 2 to Parser Server...
491INFO:__main__:Time Elapsed: 376.6291778087616. Processed 30000. [79.65394549232957 Sents/sec]
492
493INFO:my_utils:Sending Request 3 to Parser Server...
494INFO:__main__:Time Elapsed: 480.1558749675751. Processed 40000. [83.30628049214477 Sents/sec]
495
496INFO:my_utils:Sending Request 4 to Parser Server...
497INFO:__main__:Time Elapsed: 579.949392080307. Processed 50000. [86.21441919379816 Sents/sec]
498
499INFO:my_utils:Sending Request 5 to Parser Server...
500INFO:__main__:Time Elapsed: 588.1382684707642. Processed 50472. [85.81655489147774 Sents/sec]
501
502INFO:__main__:Processing File /home/daza/datasets/tiger_release_aug07.corrected.16012013.conll09 took 588.1386239528656 seconds!
503INFO:__main__:Chunking TIGER Corpus in chunks of 4 Sentences
504INFO:__main__:Chunking TIGER Corpus in chunks of 4 Sentences
505INFO:my_utils:Sending Request 0 to Parser Server...
506INFO:__main__:Time Elapsed: 3.4077346324920654. Processed 4. [1.1738003193854367 Sents/sec]
507
508INFO:my_utils:Sending Request 1 to Parser Server...
509INFO:__main__:Time Elapsed: 5.8468177318573. Processed 8. [1.3682656732072818 Sents/sec]
510
511INFO:my_utils:Sending Request 2 to Parser Server...
512INFO:__main__:Time Elapsed: 8.268580436706543. Processed 12. [1.4512769261732814 Sents/sec]
513
514INFO:my_utils:Sending Request 3 to Parser Server...
515INFO:__main__:Time Elapsed: 11.592190504074097. Processed 16. [1.3802395668339622 Sents/sec]
516
517INFO:my_utils:Sending Request 4 to Parser Server...
518INFO:__main__:Time Elapsed: 14.142167806625366. Processed 20. [1.4142103440909772 Sents/sec]
519
520INFO:my_utils:Sending Request 5 to Parser Server...
521INFO:__main__:Time Elapsed: 16.643868684768677. Processed 24. [1.4419724437001324 Sents/sec]
522
523INFO:my_utils:Sending Request 6 to Parser Server...
524INFO:__main__:Time Elapsed: 19.601061582565308. Processed 28. [1.4284940579394616 Sents/sec]
525
526INFO:my_utils:Sending Request 7 to Parser Server...
527INFO:__main__:Time Elapsed: 22.049132347106934. Processed 32. [1.4513042733946273 Sents/sec]
528
529INFO:my_utils:Sending Request 8 to Parser Server...
530INFO:__main__:Time Elapsed: 24.47833514213562. Processed 36. [1.4706882551841378 Sents/sec]
531
532INFO:my_utils:Sending Request 9 to Parser Server...
533INFO:__main__:Time Elapsed: 27.44930672645569. Processed 40. [1.4572317034676847 Sents/sec]
534
535INFO:my_utils:Sending Request 10 to Parser Server...
536INFO:__main__:Time Elapsed: 29.90971040725708. Processed 44. [1.4710941497221635 Sents/sec]
537
538INFO:my_utils:Sending Request 11 to Parser Server...
539INFO:__main__:Time Elapsed: 32.3324978351593. Processed 48. [1.4845744441001214 Sents/sec]
540
541INFO:my_utils:Sending Request 12 to Parser Server...
542INFO:__main__:Time Elapsed: 35.31913232803345. Processed 52. [1.4722898489419187 Sents/sec]
543
544INFO:my_utils:Sending Request 13 to Parser Server...
545INFO:__main__:Time Elapsed: 37.79887795448303. Processed 56. [1.4815254587036828 Sents/sec]
546
547INFO:my_utils:Sending Request 14 to Parser Server...
548INFO:__main__:Time Elapsed: 40.212188720703125. Processed 60. [1.4920849102926144 Sents/sec]
549
550INFO:my_utils:Sending Request 15 to Parser Server...
551INFO:__main__:Time Elapsed: 43.34154200553894. Processed 64. [1.4766433550477036 Sents/sec]
552
553INFO:my_utils:Sending Request 16 to Parser Server...
554INFO:__main__:Time Elapsed: 45.77445721626282. Processed 68. [1.4855446494697235 Sents/sec]
555
556INFO:my_utils:Sending Request 17 to Parser Server...
557INFO:__main__:Time Elapsed: 48.18557167053223. Processed 72. [1.4942232187738353 Sents/sec]
558
559INFO:my_utils:Sending Request 18 to Parser Server...
560INFO:__main__:Time Elapsed: 51.15876364707947. Processed 76. [1.4855714755792122 Sents/sec]
561
562INFO:my_utils:Sending Request 19 to Parser Server...
563INFO:__main__:Time Elapsed: 53.613008975982666. Processed 80. [1.492175155396297 Sents/sec]
564
565INFO:my_utils:Sending Request 20 to Parser Server...
566INFO:__main__:Time Elapsed: 56.01559019088745. Processed 84. [1.4995825218255938 Sents/sec]
567
568INFO:my_utils:Sending Request 21 to Parser Server...
569INFO:__main__:Time Elapsed: 58.91761326789856. Processed 88. [1.493611080270067 Sents/sec]
570
571INFO:my_utils:Sending Request 22 to Parser Server...
572INFO:__main__:Time Elapsed: 61.33076333999634. Processed 92. [1.5000628557317006 Sents/sec]
573
574INFO:my_utils:Sending Request 23 to Parser Server...
575INFO:__main__:Time Elapsed: 63.79576086997986. Processed 96. [1.504802179499898 Sents/sec]
576
577INFO:my_utils:Sending Request 24 to Parser Server...
578INFO:__main__:Time Elapsed: 66.70756030082703. Processed 100. [1.4990804572830438 Sents/sec]
579
580INFO:my_utils:Sending Request 25 to Parser Server...
581INFO:__main__:Time Elapsed: 69.17181944847107. Processed 104. [1.503502449830366 Sents/sec]
582
583INFO:my_utils:Sending Request 26 to Parser Server...
584INFO:__main__:Time Elapsed: 71.60666918754578. Processed 108. [1.5082394031921253 Sents/sec]
585
586INFO:my_utils:Sending Request 27 to Parser Server...
587INFO:__main__:Time Elapsed: 74.51957440376282. Processed 112. [1.5029608112515553 Sents/sec]
588
589INFO:my_utils:Sending Request 28 to Parser Server...
590INFO:__main__:Time Elapsed: 76.92893576622009. Processed 116. [1.5078851519864158 Sents/sec]
591
592INFO:my_utils:Sending Request 29 to Parser Server...
593INFO:__main__:Time Elapsed: 79.32971453666687. Processed 120. [1.5126740427703793 Sents/sec]
594
595INFO:my_utils:Sending Request 30 to Parser Server...
596INFO:__main__:Time Elapsed: 82.35156226158142. Processed 124. [1.505739497766011 Sents/sec]
597
598INFO:my_utils:Sending Request 31 to Parser Server...
599INFO:__main__:Time Elapsed: 84.87265062332153. Processed 128. [1.5081418932947501 Sents/sec]
600
601INFO:my_utils:Sending Request 32 to Parser Server...
602INFO:__main__:Time Elapsed: 87.31170439720154. Processed 132. [1.511824799565255 Sents/sec]
603
604INFO:my_utils:Sending Request 33 to Parser Server...
605INFO:__main__:Time Elapsed: 90.13041281700134. Processed 136. [1.5089246320898495 Sents/sec]
606
607INFO:my_utils:Sending Request 34 to Parser Server...
608INFO:__main__:Time Elapsed: 92.57583284378052. Processed 140. [1.5122737295406958 Sents/sec]
609
610INFO:my_utils:Sending Request 35 to Parser Server...
611INFO:__main__:Time Elapsed: 95.01719546318054. Processed 144. [1.5155151580515807 Sents/sec]
612
613INFO:my_utils:Sending Request 36 to Parser Server...
614INFO:__main__:Time Elapsed: 98.0310468673706. Processed 148. [1.5097257933013204 Sents/sec]
615
616INFO:my_utils:Sending Request 37 to Parser Server...
617INFO:__main__:Time Elapsed: 100.42707133293152. Processed 152. [1.513536121113162 Sents/sec]
618
619INFO:my_utils:Sending Request 38 to Parser Server...
620INFO:__main__:Time Elapsed: 102.81977605819702. Processed 156. [1.5172178541966717 Sents/sec]
621
622INFO:my_utils:Sending Request 39 to Parser Server...
623INFO:__main__:Time Elapsed: 105.71871662139893. Processed 160. [1.5134500787877876 Sents/sec]
624
625INFO:my_utils:Sending Request 40 to Parser Server...
626INFO:__main__:Time Elapsed: 108.23589158058167. Processed 164. [1.5152090272929652 Sents/sec]
627
628INFO:my_utils:Sending Request 41 to Parser Server...
629INFO:__main__:Time Elapsed: 110.6552083492279. Processed 168. [1.5182294851390266 Sents/sec]
630
631INFO:my_utils:Sending Request 42 to Parser Server...
632INFO:__main__:Time Elapsed: 113.5526921749115. Processed 172. [1.5147152982956924 Sents/sec]
633
634INFO:my_utils:Sending Request 43 to Parser Server...
635INFO:__main__:Time Elapsed: 115.98013949394226. Processed 176. [1.5175011926002437 Sents/sec]
636
637INFO:my_utils:Sending Request 44 to Parser Server...
638INFO:__main__:Time Elapsed: 118.35147786140442. Processed 180. [1.5208935558100012 Sents/sec]
639
640INFO:my_utils:Sending Request 45 to Parser Server...
641INFO:__main__:Time Elapsed: 121.10498547554016. Processed 184. [1.5193429013470539 Sents/sec]
642
643INFO:my_utils:Sending Request 46 to Parser Server...
644INFO:__main__:Time Elapsed: 123.55305361747742. Processed 188. [1.5216135457246693 Sents/sec]
645
646INFO:my_utils:Sending Request 47 to Parser Server...
647INFO:__main__:Time Elapsed: 125.96286916732788. Processed 192. [1.5242587063093094 Sents/sec]
648
649INFO:my_utils:Sending Request 48 to Parser Server...
650INFO:__main__:Time Elapsed: 128.8209056854248. Processed 196. [1.521492175180197 Sents/sec]
651
652INFO:my_utils:Sending Request 49 to Parser Server...
653INFO:__main__:Time Elapsed: 131.2418966293335. Processed 200. [1.5239036095680636 Sents/sec]
654
655INFO:my_utils:Sending Request 50 to Parser Server...
656INFO:__main__:Time Elapsed: 133.64410710334778. Processed 204. [1.526442163605804 Sents/sec]
657
658INFO:my_utils:Sending Request 51 to Parser Server...
659INFO:__main__:Time Elapsed: 136.543692111969. Processed 208. [1.5233219256253534 Sents/sec]
660
661INFO:my_utils:Sending Request 52 to Parser Server...
662INFO:__main__:Time Elapsed: 138.87571263313293. Processed 212. [1.526544821843968 Sents/sec]
663
664INFO:my_utils:Sending Request 53 to Parser Server...
665INFO:__main__:Time Elapsed: 141.23592972755432. Processed 216. [1.5293558828597398 Sents/sec]
666
667INFO:my_utils:Sending Request 54 to Parser Server...
668INFO:__main__:Time Elapsed: 144.02863264083862. Processed 220. [1.527474058221532 Sents/sec]
669
670INFO:my_utils:Sending Request 55 to Parser Server...
671INFO:__main__:Time Elapsed: 146.31481456756592. Processed 224. [1.530945452530101 Sents/sec]
672
673INFO:my_utils:Sending Request 56 to Parser Server...
674INFO:__main__:Chunking TIGER Corpus in chunks of 4 Sentences
675INFO:my_utils:Reading instances from lines in file at: /home/daza/datasets/TIGER_conll/tiger_release_aug07.corrected.16012013.conll09
676INFO:my_utils:Sending Request 0 to Parser Server...
677INFO:__main__:Time Elapsed: 2.405996799468994. Processed 4. [1.6625126022124401 Sents/sec]
678
679INFO:my_utils:Sending Request 1 to Parser Server...
680INFO:__main__:Time Elapsed: 4.411545991897583. Processed 8. [1.8134232340982301 Sents/sec]
681
682INFO:my_utils:Sending Request 2 to Parser Server...
683INFO:__main__:Time Elapsed: 6.336946964263916. Processed 12. [1.8936563723306923 Sents/sec]
684
685INFO:my_utils:Sending Request 3 to Parser Server...
686INFO:__main__:Time Elapsed: 8.761664152145386. Processed 16. [1.8261371038836534 Sents/sec]
687
688INFO:my_utils:Sending Request 4 to Parser Server...
689INFO:__main__:Time Elapsed: 10.7116219997406. Processed 20. [1.8671308603388295 Sents/sec]
690
691INFO:my_utils:Sending Request 5 to Parser Server...
692INFO:__main__:Time Elapsed: 12.786542892456055. Processed 24. [1.8769733306224456 Sents/sec]
693
694INFO:my_utils:Sending Request 6 to Parser Server...
695INFO:__main__:Time Elapsed: 15.390063762664795. Processed 28. [1.819355685057395 Sents/sec]
696
697INFO:my_utils:Sending Request 7 to Parser Server...
698INFO:__main__:Time Elapsed: 17.350337505340576. Processed 32. [1.844344525871623 Sents/sec]
699
700INFO:my_utils:Sending Request 8 to Parser Server...
701INFO:__main__:Time Elapsed: 19.427443981170654. Processed 36. [1.8530487095930732 Sents/sec]
702
703INFO:my_utils:Sending Request 9 to Parser Server...
704INFO:__main__:Time Elapsed: 21.852174043655396. Processed 40. [1.8304814852787465 Sents/sec]
705
706INFO:__main__:Processing File /home/daza/datasets/TIGER_conll/tiger_release_aug07.corrected.16012013.conll09 took 21.852431297302246 seconds!
707INFO:__main__:Chunking TIGER Corpus in chunks of 4 Sentences
708INFO:my_utils:Reading instances from lines in file at: /home/daza/datasets/TIGER_conll/tiger_release_aug07.corrected.16012013.conll09
709INFO:my_utils:Sending Request 0 to Parser Server...
710INFO:__main__:Time Elapsed: 1.912651777267456. Processed 4. [2.0913372980599068 Sents/sec]
711
712INFO:my_utils:Sending Request 1 to Parser Server...
713INFO:__main__:Time Elapsed: 3.8369903564453125. Processed 8. [2.084967450220909 Sents/sec]
714
715INFO:my_utils:Sending Request 2 to Parser Server...
716INFO:__main__:Time Elapsed: 6.319569110870361. Processed 12. [1.8988636391931637 Sents/sec]
717
718INFO:my_utils:Sending Request 3 to Parser Server...
719INFO:__main__:Time Elapsed: 8.18579888343811. Processed 16. [1.9546045814015716 Sents/sec]
720
721INFO:my_utils:Sending Request 4 to Parser Server...
722INFO:__main__:Time Elapsed: 10.15789270401001. Processed 20. [1.9689123111238065 Sents/sec]
723
724INFO:my_utils:Sending Request 5 to Parser Server...
725INFO:__main__:Time Elapsed: 12.712148427963257. Processed 24. [1.8879578173589093 Sents/sec]
726
727INFO:my_utils:Sending Request 6 to Parser Server...
728INFO:__main__:Time Elapsed: 14.736063957214355. Processed 28. [1.9001003308140503 Sents/sec]
729
730INFO:my_utils:Sending Request 7 to Parser Server...
731INFO:__main__:Time Elapsed: 16.73722553253174. Processed 32. [1.9119058853453565 Sents/sec]
732
733INFO:my_utils:Sending Request 8 to Parser Server...
734INFO:__main__:Time Elapsed: 19.437472343444824. Processed 36. [1.852092667395655 Sents/sec]
735
736INFO:my_utils:Sending Request 9 to Parser Server...
737INFO:__main__:Time Elapsed: 21.33689522743225. Processed 40. [1.8746869951619352 Sents/sec]
738
739INFO:__main__:Processing File /home/daza/datasets/TIGER_conll/tiger_release_aug07.corrected.16012013.conll09 took 21.337210416793823 seconds!
740INFO:__main__:Chunking TIGER Corpus in chunks of 4 Sentences
741INFO:my_utils:Reading instances from lines in file at: /home/daza/datasets/TIGER_conll/tiger_release_aug07.corrected.16012013.conll09
742INFO:my_utils:Sending Request 0 to Parser Server...
743INFO:__main__:Time Elapsed: 1.9996423721313477. Processed 4. [2.0003576918289356 Sents/sec]
744
745INFO:my_utils:Sending Request 1 to Parser Server...
746INFO:__main__:Time Elapsed: 4.532586097717285. Processed 8. [1.764996809223102 Sents/sec]
747
748INFO:my_utils:Sending Request 2 to Parser Server...
749INFO:__main__:Time Elapsed: 6.610581636428833. Processed 12. [1.8152714329812947 Sents/sec]
750
751INFO:my_utils:Sending Request 3 to Parser Server...
752INFO:__main__:Time Elapsed: 8.619524002075195. Processed 16. [1.8562509943876155 Sents/sec]
753
754INFO:my_utils:Sending Request 4 to Parser Server...
755INFO:__main__:Time Elapsed: 11.058376789093018. Processed 20. [1.808583699166969 Sents/sec]
756
757INFO:my_utils:Sending Request 5 to Parser Server...
758INFO:__main__:Time Elapsed: 13.353788614273071. Processed 24. [1.7972427670711986 Sents/sec]
759
760INFO:my_utils:Sending Request 6 to Parser Server...
761INFO:__main__:Time Elapsed: 15.284202814102173. Processed 28. [1.831956847246585 Sents/sec]
762
763INFO:my_utils:Sending Request 7 to Parser Server...
764INFO:__main__:Chunking TIGER Corpus in chunks of 4 Sentences
765INFO:my_utils:Reading instances from lines in file at: /home/daza/datasets/TIGER_conll/tiger_release_aug07.corrected.16012013.conll09
766INFO:__main__:Chunking TIGER Corpus in chunks of 4 Sentences
767INFO:my_utils:Reading instances from lines in file at: /home/daza/datasets/TIGER_conll/tiger_release_aug07.corrected.16012013.conll09
768INFO:__main__:Chunking TIGER Corpus in chunks of 4 Sentences
769INFO:my_utils:Reading instances from lines in file at: /home/daza/datasets/TIGER_conll/tiger_release_aug07.corrected.16012013.conll09
770INFO:my_utils:Sending Request 0 to Parser Server...
771INFO:__main__:Time Elapsed: 1.976405143737793. Processed 4. [2.0238765380033206 Sents/sec]
772
773INFO:my_utils:Sending Request 1 to Parser Server...
774INFO:__main__:Time Elapsed: 3.9668445587158203. Processed 8. [2.0167162795483535 Sents/sec]
775
776INFO:my_utils:Sending Request 2 to Parser Server...
777INFO:__main__:Time Elapsed: 6.430184841156006. Processed 12. [1.8661982970061346 Sents/sec]
778
779INFO:my_utils:Sending Request 3 to Parser Server...
780INFO:__main__:Time Elapsed: 8.294080257415771. Processed 16. [1.92908671045163 Sents/sec]
781
782INFO:my_utils:Sending Request 4 to Parser Server...
783INFO:__main__:Time Elapsed: 10.314137697219849. Processed 20. [1.9390859989576203 Sents/sec]
784
785INFO:my_utils:Sending Request 5 to Parser Server...
786INFO:__main__:Time Elapsed: 12.794687271118164. Processed 24. [1.8757785549144237 Sents/sec]
787
788INFO:my_utils:Sending Request 6 to Parser Server...
789INFO:__main__:Time Elapsed: 14.684069871902466. Processed 28. [1.9068283006182893 Sents/sec]
790
791INFO:my_utils:Sending Request 7 to Parser Server...
792INFO:__main__:Time Elapsed: 16.59351873397827. Processed 32. [1.928463788362991 Sents/sec]
793
794INFO:my_utils:Sending Request 8 to Parser Server...
795INFO:__main__:Time Elapsed: 18.955203771591187. Processed 36. [1.8992146132427463 Sents/sec]
796
797INFO:my_utils:Sending Request 9 to Parser Server...
798INFO:__main__:Time Elapsed: 20.837483644485474. Processed 40. [1.9196175835072955 Sents/sec]
799
800INFO:__main__:Processing File /home/daza/datasets/TIGER_conll/tiger_release_aug07.corrected.16012013.conll09 took 20.837707042694092 seconds!
801INFO:__main__:Chunking TIGER Corpus in chunks of 4 Sentences
802INFO:my_utils:Reading instances from lines in file at: /home/daza/datasets/TIGER_conll/tiger_release_aug07.corrected.16012013.conll09
803INFO:my_utils:Sending Request 0 to Parser Server...
804INFO:__main__:Time Elapsed: 1.8857543468475342. Processed 4. [2.1211670579929494 Sents/sec]
805
806INFO:my_utils:Sending Request 1 to Parser Server...
807INFO:__main__:Time Elapsed: 4.313926458358765. Processed 8. [1.8544590588694467 Sents/sec]
808
809INFO:my_utils:Sending Request 2 to Parser Server...
810INFO:__main__:Time Elapsed: 6.276944637298584. Processed 12. [1.9117581392536311 Sents/sec]
811
812INFO:my_utils:Sending Request 3 to Parser Server...
813INFO:__main__:Time Elapsed: 8.233506441116333. Processed 16. [1.943278980155951 Sents/sec]
814
815INFO:my_utils:Sending Request 4 to Parser Server...
816INFO:__main__:Time Elapsed: 10.609818935394287. Processed 20. [1.885046306801724 Sents/sec]
817
818INFO:my_utils:Sending Request 5 to Parser Server...
819INFO:__main__:Time Elapsed: 12.564550876617432. Processed 24. [1.910135924131111 Sents/sec]
820
821INFO:my_utils:Sending Request 6 to Parser Server...
822INFO:__main__:Time Elapsed: 14.491822242736816. Processed 28. [1.9321241684449568 Sents/sec]
823
824INFO:my_utils:Sending Request 7 to Parser Server...
825INFO:__main__:Time Elapsed: 16.880109786987305. Processed 32. [1.8957222674385954 Sents/sec]
826
827INFO:my_utils:Sending Request 8 to Parser Server...
828INFO:__main__:Time Elapsed: 18.87423801422119. Processed 36. [1.9073617686115352 Sents/sec]
829
830INFO:my_utils:Sending Request 9 to Parser Server...
831INFO:__main__:Time Elapsed: 20.83071756362915. Processed 40. [1.920241099607668 Sents/sec]
832
833INFO:__main__:Processing File /home/daza/datasets/TIGER_conll/tiger_release_aug07.corrected.16012013.conll09 took 20.831073999404907 seconds!
834INFO:__main__:Chunking TIGER Corpus in chunks of 10000 Sentences
835INFO:my_utils:Reading instances from lines in file at: /home/daza/datasets/TIGER_conll/tiger_release_aug07.corrected.16012013.conll09
836INFO:my_utils:Sending Request 0 to Parser Server...
837INFO:__main__:Time Elapsed: 45.208128929138184. Processed 10000. [221.19915680816106 Sents/sec]
838
839INFO:my_utils:Sending Request 1 to Parser Server...
840INFO:__main__:Time Elapsed: 92.34467482566833. Processed 20000. [216.57989524308505 Sents/sec]
841
842INFO:my_utils:Sending Request 2 to Parser Server...
843INFO:__main__:Time Elapsed: 138.04999089241028. Processed 30000. [217.31258224696734 Sents/sec]
844
845INFO:my_utils:Sending Request 3 to Parser Server...
846INFO:__main__:Time Elapsed: 181.3346757888794. Processed 40000. [220.58660223690683 Sents/sec]
847
848INFO:my_utils:Sending Request 4 to Parser Server...
849INFO:__main__:Time Elapsed: 226.86525297164917. Processed 50000. [220.39514357118577 Sents/sec]
850
851INFO:my_utils:Sending Request 5 to Parser Server...
852INFO:__main__:Time Elapsed: 232.3156774044037. Processed 50472. [217.25610842931115 Sents/sec]
853
854INFO:__main__:Processing File /home/daza/datasets/TIGER_conll/tiger_release_aug07.corrected.16012013.conll09 took 232.31602954864502 seconds!
855INFO:__main__:Chunking TIGER Corpus in chunks of 10000 Sentences
856INFO:my_utils:Reading instances from lines in file at: /home/daza/datasets/TIGER_conll/tiger_release_aug07.corrected.16012013.conll09
857INFO:my_utils:Sending Request 0 to Parser Server...
858INFO:__main__:Time Elapsed: 44.833308696746826. Processed 10000. [223.0484497060021 Sents/sec]
859
860INFO:my_utils:Sending Request 1 to Parser Server...
861INFO:__main__:Time Elapsed: 91.50138306617737. Processed 20000. [218.5759310931423 Sents/sec]
862
863INFO:my_utils:Sending Request 2 to Parser Server...
864INFO:__main__:Time Elapsed: 137.80317568778992. Processed 30000. [217.70180440520977 Sents/sec]
865
866INFO:my_utils:Sending Request 3 to Parser Server...
867INFO:__main__:Time Elapsed: 183.3420286178589. Processed 40000. [218.1714705653895 Sents/sec]
868
869INFO:my_utils:Sending Request 4 to Parser Server...
870INFO:__main__:Time Elapsed: 228.61404871940613. Processed 50000. [218.7092187906985 Sents/sec]
871
872INFO:my_utils:Sending Request 5 to Parser Server...
873INFO:__main__:Time Elapsed: 234.00832319259644. Processed 50472. [215.68463596254185 Sents/sec]
874
875INFO:__main__:Processing File /home/daza/datasets/TIGER_conll/tiger_release_aug07.corrected.16012013.conll09 took 234.00871419906616 seconds!