daza | cd9cf01 | 2020-08-31 17:19:11 +0200 | [diff] [blame^] | 1 | INFO:__main__:Start Logging |
| 2 | INFO:__main__:Chunking in Files of 20000 Sentences |
| 3 | INFO:__main__:File /export/netapp/kupietz/N-GRAMM-STUDIE/conllu/a00.conllu is already uncompressed. Skipping this step... |
| 4 | INFO:__main__:Successfully fixed comments on file |
| 5 | INFO:__main__:Reading instances from lines in file at: /export/netapp/kupietz/N-GRAMM-STUDIE/conllu/a00.conllu.fixed |
| 6 | INFO:__main__:Sending Request 0 to Parser Server... |
| 7 | INFO:__main__:Time Elapsed: 98.19491934776306. Processed 20000. [203.67652555595905 Sents/sec] |
| 8 | |
| 9 | INFO:__main__:Sending Request 1 to Parser Server... |
| 10 | INFO:__main__:Time Elapsed: 178.8947925567627. Processed 40000. [223.5951054154253 Sents/sec] |
| 11 | |
| 12 | INFO:__main__:Sending Request 2 to Parser Server... |
| 13 | INFO:__main__:Time Elapsed: 258.42775654792786. Processed 60000. [232.1732030702841 Sents/sec] |
| 14 | |
| 15 | INFO:__main__:Sending Request 3 to Parser Server... |
| 16 | INFO:__main__:Time Elapsed: 337.31846141815186. Processed 80000. [237.16460600366958 Sents/sec] |
| 17 | |
| 18 | INFO:__main__:Sending Request 4 to Parser Server... |
| 19 | INFO:__main__:Time Elapsed: 420.1129512786865. Processed 100000. [238.03122397353542 Sents/sec] |
| 20 | |
| 21 | INFO:__main__:Sending Request 5 to Parser Server... |
| 22 | INFO:__main__:Time Elapsed: 499.3560426235199. Processed 120000. [240.30949814794118 Sents/sec] |
| 23 | |
| 24 | INFO:__main__:Sending Request 6 to Parser Server... |
| 25 | INFO:__main__:Time Elapsed: 580.2616112232208. Processed 140000. [241.27048436803 Sents/sec] |
| 26 | |
| 27 | INFO:__main__:Sending Request 7 to Parser Server... |
| 28 | INFO:__main__:Time Elapsed: 664.2827656269073. Processed 160000. [240.86128419875877 Sents/sec] |
| 29 | |
| 30 | INFO:__main__:Sending Request 8 to Parser Server... |
| 31 | INFO:__main__:Time Elapsed: 744.8023872375488. Processed 180000. [241.67484299777146 Sents/sec] |
| 32 | |
| 33 | INFO:__main__:Sending Request 9 to Parser Server... |
| 34 | INFO:__main__:Time Elapsed: 825.8918900489807. Processed 200000. [242.16244572656927 Sents/sec] |
| 35 | |
| 36 | INFO:__main__:Sending Request 10 to Parser Server... |
| 37 | INFO:__main__:Time Elapsed: 903.7794210910797. Processed 220000. [243.42222766524927 Sents/sec] |
| 38 | |
| 39 | INFO:__main__:Sending Request 11 to Parser Server... |
| 40 | INFO:__main__:Time Elapsed: 983.4670946598053. Processed 240000. [244.03460095736023 Sents/sec] |
| 41 | |
| 42 | INFO:__main__:Sending Request 12 to Parser Server... |
| 43 | INFO:__main__:Time Elapsed: 1064.4692878723145. Processed 260000. [244.25317194420325 Sents/sec] |
| 44 | |
| 45 | INFO:__main__:Sending Request 13 to Parser Server... |
| 46 | INFO:__main__:Time Elapsed: 1148.1249577999115. Processed 280000. [243.8758935582661 Sents/sec] |
| 47 | |
| 48 | INFO:__main__:Sending Request 14 to Parser Server... |
| 49 | INFO:__main__:Time Elapsed: 1231.3249888420105. Processed 300000. [243.63998352874535 Sents/sec] |
| 50 | |
| 51 | INFO:__main__:Sending Request 15 to Parser Server... |
| 52 | INFO:__main__:Time Elapsed: 1313.075716972351. Processed 320000. [243.70262572355384 Sents/sec] |
| 53 | |
| 54 | INFO:__main__:Sending Request 16 to Parser Server... |
| 55 | INFO:__main__:Time Elapsed: 1394.967396736145. Processed 340000. [243.73329498274305 Sents/sec] |
| 56 | |
| 57 | INFO:__main__:Sending Request 17 to Parser Server... |
| 58 | INFO:__main__:Time Elapsed: 1476.8235352039337. Processed 360000. [243.76642937931499 Sents/sec] |
| 59 | |
| 60 | INFO:__main__:Sending Request 18 to Parser Server... |
| 61 | INFO:__main__:Time Elapsed: 1557.1394641399384. Processed 380000. [244.03722900304697 Sents/sec] |
| 62 | |
| 63 | INFO:__main__:Sending Request 19 to Parser Server... |
| 64 | INFO:__main__:Time Elapsed: 1641.3248417377472. Processed 400000. [243.70556627687506 Sents/sec] |
| 65 | |
| 66 | INFO:__main__:Sending Request 20 to Parser Server... |
| 67 | INFO:__main__:Time Elapsed: 1721.7012026309967. Processed 420000. [243.944767743777 Sents/sec] |
| 68 | |
| 69 | INFO:__main__:Sending Request 21 to Parser Server... |
| 70 | INFO:__main__:Time Elapsed: 1804.4057919979095. Processed 440000. [243.84758791580612 Sents/sec] |
| 71 | |
| 72 | INFO:__main__:Sending Request 22 to Parser Server... |
| 73 | INFO:__main__:Time Elapsed: 1887.0067677497864. Processed 460000. [243.77231065712593 Sents/sec] |
| 74 | |
| 75 | INFO:__main__:Sending Request 23 to Parser Server... |
| 76 | INFO:__main__:Time Elapsed: 2015.9566264152527. Processed 480000. [238.10036074711073 Sents/sec] |
| 77 | |
| 78 | INFO:__main__:Sending Request 24 to Parser Server... |
| 79 | INFO:__main__:Time Elapsed: 2139.8701055049896. Processed 500000. [233.6590425342685 Sents/sec] |
| 80 | |
| 81 | INFO:__main__:Sending Request 25 to Parser Server... |
| 82 | INFO:__main__:Time Elapsed: 2273.1346604824066. Processed 520000. [228.75899481012056 Sents/sec] |
| 83 | |
| 84 | INFO:__main__:Sending Request 26 to Parser Server... |
| 85 | INFO:__main__:Time Elapsed: 2404.8847119808197. Processed 540000. [224.54298840596846 Sents/sec] |
| 86 | |
| 87 | INFO:__main__:Sending Request 27 to Parser Server... |
| 88 | INFO:__main__:Time Elapsed: 2530.600071668625. Processed 560000. [221.29138707830182 Sents/sec] |
| 89 | |
| 90 | INFO:__main__:Sending Request 28 to Parser Server... |
| 91 | INFO:__main__:Time Elapsed: 2656.4930505752563. Processed 580000. [218.33296340617287 Sents/sec] |
| 92 | |
| 93 | INFO:__main__:Sending Request 29 to Parser Server... |
| 94 | INFO:__main__:Time Elapsed: 2781.2974302768707. Processed 600000. [215.72665816624712 Sents/sec] |
| 95 | |
| 96 | INFO:__main__:Sending Request 30 to Parser Server... |
| 97 | INFO:__main__:Time Elapsed: 2907.4323580265045. Processed 620000. [213.24657761628586 Sents/sec] |
| 98 | |
| 99 | INFO:__main__:Sending Request 31 to Parser Server... |
| 100 | INFO:__main__:Time Elapsed: 3030.6001527309418. Processed 640000. [211.17929378551693 Sents/sec] |
| 101 | |
| 102 | INFO:__main__:Sending Request 32 to Parser Server... |
| 103 | INFO:__main__:Time Elapsed: 3155.522436141968. Processed 660000. [209.15712480464404 Sents/sec] |
| 104 | |
| 105 | INFO:__main__:Sending Request 33 to Parser Server... |
| 106 | INFO:__main__:Time Elapsed: 3279.3324024677277. Processed 680000. [207.35927821415535 Sents/sec] |
| 107 | |
| 108 | INFO:__main__:Sending Request 34 to Parser Server... |
| 109 | INFO:__main__:Time Elapsed: 3403.92253446579. Processed 700000. [205.6451029399991 Sents/sec] |
| 110 | |
| 111 | INFO:__main__:Sending Request 35 to Parser Server... |
| 112 | INFO:__main__:Time Elapsed: 3523.8551886081696. Processed 720000. [204.3216765341544 Sents/sec] |
| 113 | |
| 114 | INFO:__main__:Sending Request 36 to Parser Server... |
| 115 | INFO:__main__:Time Elapsed: 3649.4880363941193. Processed 740000. [202.76816710191434 Sents/sec] |
| 116 | |
| 117 | INFO:__main__:Sending Request 37 to Parser Server... |
| 118 | INFO:__main__:Time Elapsed: 3769.89262509346. Processed 760000. [201.59725370988747 Sents/sec] |
| 119 | |
| 120 | INFO:__main__:Sending Request 38 to Parser Server... |
| 121 | INFO:__main__:Time Elapsed: 3896.9183082580566. Processed 780000. [200.1581604487532 Sents/sec] |
| 122 | |
| 123 | INFO:__main__:Sending Request 39 to Parser Server... |
| 124 | INFO:__main__:Time Elapsed: 4012.452913761139. Processed 800000. [199.3792867341356 Sents/sec] |
| 125 | |
| 126 | INFO:__main__:Sending Request 40 to Parser Server... |
| 127 | INFO:__main__:Time Elapsed: 4123.85481595993. Processed 820000. [198.84308167845248 Sents/sec] |
| 128 | |
| 129 | INFO:__main__:Sending Request 41 to Parser Server... |
| 130 | INFO:__main__:Time Elapsed: 4244.3920249938965. Processed 840000. [197.9082033548039 Sents/sec] |
| 131 | |
| 132 | INFO:__main__:Sending Request 42 to Parser Server... |
| 133 | INFO:__main__:Time Elapsed: 4366.287281751633. Processed 860000. [196.96367749191987 Sents/sec] |
| 134 | |
| 135 | INFO:__main__:Sending Request 43 to Parser Server... |
| 136 | INFO:__main__:Time Elapsed: 4488.923060178757. Processed 880000. [196.0381116367267 Sents/sec] |
| 137 | |
| 138 | INFO:__main__:Sending Request 44 to Parser Server... |
| 139 | INFO:__main__:Time Elapsed: 4610.694122076035. Processed 900000. [195.19837494549768 Sents/sec] |
| 140 | |
| 141 | INFO:__main__:Sending Request 45 to Parser Server... |
| 142 | INFO:__main__:Time Elapsed: 4731.4308161735535. Processed 920000. [194.44435219366284 Sents/sec] |
| 143 | |
| 144 | INFO:__main__:Sending Request 46 to Parser Server... |
| 145 | INFO:__main__:Time Elapsed: 4855.6209988594055. Processed 940000. [193.59006813357297 Sents/sec] |
| 146 | |
| 147 | INFO:__main__:Sending Request 47 to Parser Server... |
| 148 | INFO:__main__:Time Elapsed: 4980.613188266754. Processed 960000. [192.74735132243396 Sents/sec] |
| 149 | |
| 150 | INFO:__main__:Sending Request 48 to Parser Server... |
| 151 | INFO:__main__:Time Elapsed: 5098.693638086319. Processed 980000. [192.20609622032933 Sents/sec] |
| 152 | |
| 153 | INFO:__main__:Sending Request 49 to Parser Server... |
| 154 | INFO:__main__:Time Elapsed: 5221.365651845932. Processed 1000000. [191.5207757277956 Sents/sec] |
| 155 | |
| 156 | INFO:__main__:Sending Request 50 to Parser Server... |
| 157 | INFO:__main__:Time Elapsed: 5339.519736289978. Processed 1020000. [191.02841648240064 Sents/sec] |
| 158 | |
| 159 | INFO:__main__:Sending Request 51 to Parser Server... |
| 160 | INFO:__main__:Time Elapsed: 5461.673362731934. Processed 1040000. [190.41783184921024 Sents/sec] |
| 161 | |
| 162 | INFO:__main__:Sending Request 52 to Parser Server... |
| 163 | INFO:__main__:Time Elapsed: 5584.106055259705. Processed 1060000. [189.82447494914237 Sents/sec] |
| 164 | |
| 165 | INFO:__main__:Sending Request 53 to Parser Server... |
| 166 | INFO:__main__:Time Elapsed: 5703.546013832092. Processed 1080000. [189.35588445868797 Sents/sec] |
| 167 | |
| 168 | INFO:__main__:Sending Request 54 to Parser Server... |
| 169 | INFO:__main__:Time Elapsed: 5821.955971479416. Processed 1100000. [188.93993795017988 Sents/sec] |
| 170 | |
| 171 | INFO:__main__:Sending Request 55 to Parser Server... |
| 172 | INFO:__main__:Time Elapsed: 5940.822002887726. Processed 1120000. [188.52609949525308 Sents/sec] |
| 173 | |
| 174 | INFO:__main__:Sending Request 56 to Parser Server... |
| 175 | INFO:__main__:Time Elapsed: 6057.515177726746. Processed 1140000. [188.19597913542782 Sents/sec] |
| 176 | |
| 177 | INFO:__main__:Sending Request 57 to Parser Server... |
| 178 | INFO:__main__:Time Elapsed: 6175.445195436478. Processed 1160000. [187.84070836823477 Sents/sec] |
| 179 | |
| 180 | INFO:__main__:Sending Request 58 to Parser Server... |
| 181 | INFO:__main__:Time Elapsed: 6293.141885995865. Processed 1180000. [187.50570404679024 Sents/sec] |
| 182 | |
| 183 | INFO:__main__:Sending Request 59 to Parser Server... |
| 184 | INFO:__main__:Time Elapsed: 6407.568333148956. Processed 1200000. [187.27853338557657 Sents/sec] |
| 185 | |
| 186 | INFO:__main__:Sending Request 60 to Parser Server... |
| 187 | INFO:__main__:Time Elapsed: 6519.235458374023. Processed 1220000. [187.13850846312013 Sents/sec] |
| 188 | |
| 189 | INFO:__main__:Sending Request 61 to Parser Server... |
| 190 | INFO:__main__:Time Elapsed: 6633.7648096084595. Processed 1240000. [186.92251467883858 Sents/sec] |
| 191 | |
| 192 | INFO:__main__:Sending Request 62 to Parser Server... |
| 193 | INFO:__main__:Time Elapsed: 6748.994223117828. Processed 1260000. [186.69448488843403 Sents/sec] |
| 194 | |
| 195 | INFO:__main__:Sending Request 63 to Parser Server... |
| 196 | INFO:__main__:Time Elapsed: 6866.852972269058. Processed 1280000. [186.4027095336281 Sents/sec] |
| 197 | |
| 198 | INFO:__main__:Sending Request 64 to Parser Server... |
| 199 | INFO:__main__:Time Elapsed: 6990.777011871338. Processed 1300000. [185.95930005955194 Sents/sec] |
| 200 | |
| 201 | INFO:__main__:Sending Request 65 to Parser Server... |
| 202 | INFO:__main__:Time Elapsed: 7105.517110586166. Processed 1320000. [185.77113804052289 Sents/sec] |
| 203 | |
| 204 | INFO:__main__:Sending Request 66 to Parser Server... |
| 205 | INFO:__main__:Time Elapsed: 7225.482071638107. Processed 1340000. [185.45475398241564 Sents/sec] |
| 206 | |
| 207 | INFO:__main__:Sending Request 67 to Parser Server... |
| 208 | INFO:__main__:Time Elapsed: 7337.8775935173035. Processed 1360000. [185.33969566370268 Sents/sec] |
| 209 | |
| 210 | INFO:__main__:Sending Request 68 to Parser Server... |
| 211 | INFO:__main__:Time Elapsed: 7455.035196065903. Processed 1380000. [185.10979005548356 Sents/sec] |
| 212 | |
| 213 | INFO:__main__:Sending Request 69 to Parser Server... |
| 214 | INFO:__main__:Time Elapsed: 7578.5934200286865. Processed 1400000. [184.7308494344193 Sents/sec] |
| 215 | |
| 216 | INFO:__main__:Sending Request 70 to Parser Server... |
| 217 | INFO:__main__:Time Elapsed: 7692.598174333572. Processed 1420000. [184.59302927557604 Sents/sec] |
| 218 | |
| 219 | INFO:__main__:Sending Request 71 to Parser Server... |
| 220 | INFO:__main__:Time Elapsed: 7809.916503667831. Processed 1440000. [184.38097248846665 Sents/sec] |
| 221 | |
| 222 | INFO:__main__:Sending Request 72 to Parser Server... |
| 223 | INFO:__main__:Time Elapsed: 7931.408297300339. Processed 1460000. [184.07828033477347 Sents/sec] |
| 224 | |
| 225 | INFO:__main__:Sending Request 73 to Parser Server... |
| 226 | INFO:__main__:Time Elapsed: 8043.090455055237. Processed 1480000. [184.00887174777347 Sents/sec] |
| 227 | |
| 228 | INFO:__main__:Sending Request 74 to Parser Server... |
| 229 | INFO:__main__:Time Elapsed: 8154.90810251236. Processed 1500000. [183.93830821194427 Sents/sec] |
| 230 | |
| 231 | INFO:__main__:Sending Request 75 to Parser Server... |
| 232 | INFO:__main__:Time Elapsed: 8268.902240037918. Processed 1520000. [183.821256543605 Sents/sec] |
| 233 | |
| 234 | INFO:__main__:Sending Request 76 to Parser Server... |
| 235 | INFO:__main__:Time Elapsed: 8386.647283315659. Processed 1540000. [183.6252256683867 Sents/sec] |
| 236 | |
| 237 | INFO:__main__:Sending Request 77 to Parser Server... |
| 238 | INFO:__main__:Time Elapsed: 8499.714630842209. Processed 1560000. [183.535573575536 Sents/sec] |
| 239 | |
| 240 | INFO:__main__:Sending Request 78 to Parser Server... |
| 241 | INFO:__main__:Time Elapsed: 8609.53560590744. Processed 1580000. [183.51744766766302 Sents/sec] |
| 242 | |
| 243 | INFO:__main__:Sending Request 79 to Parser Server... |
| 244 | INFO:__main__:Time Elapsed: 8720.773554086685. Processed 1600000. [183.46996285096935 Sents/sec] |
| 245 | |
| 246 | INFO:__main__:Sending Request 80 to Parser Server... |
| 247 | INFO:__main__:Time Elapsed: 8831.752426862717. Processed 1620000. [183.42905481279087 Sents/sec] |
| 248 | |
| 249 | INFO:__main__:Sending Request 81 to Parser Server... |
| 250 | INFO:__main__:Time Elapsed: 8940.69381070137. Processed 1640000. [183.43095454594783 Sents/sec] |
| 251 | |
| 252 | INFO:__main__:Sending Request 82 to Parser Server... |
| 253 | INFO:__main__:Time Elapsed: 9054.10047864914. Processed 1660000. [183.34234349558156 Sents/sec] |
| 254 | |
| 255 | INFO:__main__:Sending Request 83 to Parser Server... |
| 256 | INFO:__main__:Time Elapsed: 9169.408634662628. Processed 1680000. [183.21792243495238 Sents/sec] |
| 257 | |
| 258 | INFO:__main__:Sending Request 84 to Parser Server... |
| 259 | INFO:__main__:Time Elapsed: 9278.584917545319. Processed 1700000. [183.21759353469827 Sents/sec] |
| 260 | |
| 261 | INFO:__main__:Sending Request 85 to Parser Server... |
| 262 | INFO:__main__:Time Elapsed: 9385.278182506561. Processed 1720000. [183.26574519719065 Sents/sec] |
| 263 | |
| 264 | INFO:__main__:Sending Request 86 to Parser Server... |
| 265 | INFO:__main__:Time Elapsed: 9499.239807844162. Processed 1740000. [183.17255224604023 Sents/sec] |
| 266 | |
| 267 | INFO:__main__:Sending Request 87 to Parser Server... |
| 268 | INFO:__main__:Time Elapsed: 9611.59985089302. Processed 1760000. [183.1120757525582 Sents/sec] |
| 269 | |
| 270 | INFO:__main__:Sending Request 88 to Parser Server... |
| 271 | INFO:__main__:Time Elapsed: 9722.264467716217. Processed 1780000. [183.0849187358227 Sents/sec] |
| 272 | |
| 273 | INFO:__main__:Sending Request 89 to Parser Server... |
| 274 | INFO:__main__:Time Elapsed: 9835.523452997208. Processed 1800000. [183.01008671292232 Sents/sec] |
| 275 | |
| 276 | INFO:__main__:Sending Request 90 to Parser Server... |
| 277 | INFO:__main__:Time Elapsed: 9946.680324554443. Processed 1820000. [182.97562006764562 Sents/sec] |
| 278 | |
| 279 | INFO:__main__:Sending Request 91 to Parser Server... |
| 280 | INFO:__main__:Time Elapsed: 10007.997486114502. Processed 1830665. [182.92020981619333 Sents/sec] |
| 281 | |
| 282 | INFO:__main__:Processing File /export/netapp/kupietz/N-GRAMM-STUDIE/conllu/a00.conllu.gz took 10007.997836351395 seconds! |