Diffusion cop-mining-participants (master) History

History
master62f11a926efb2adfb21faea…

Oct 20 2020

Minor bugfixes and improvements
62f11a926efb
·Jan Linder on Oct 20 2020, 23:20.
Explain Analyzer in readme
0b5560f27517
·Jan Linder on Oct 20 2020, 22:55.
Rename cop1to5, included cop5 there
3fd706cf5bd0
·Jan Linder on Oct 20 2020, 22:50.
Improve Analyzers, especially cop7to8
97b00603c9f4
·Jan Linder on Oct 20 2020, 22:48.

Oct 19 2020

Implement cop7to8_analyzer and affilition list extractor.
67a5ee11403c
·Jan Linder on Oct 19 2020, 18:52.
Added party recognition for all cops
883bce5e3184
·Jan Linder on Oct 19 2020, 17:29.

Oct 17 2020

First edition of affiliation category extraction. Only works for cop5+ yet
8b9912f6d1fa
·Jan Linder on Oct 17 2020, 14:07.

Oct 14 2020

minor adaption op salutory addresses
fa3369344206
·Jan Linder on Oct 14 2020, 09:13.
Make pdfToText unstatic.
2186bf7609de
·Jan Linder on Oct 14 2020, 08:24.

Oct 13 2020

Add todo week5
7514566bb3e2
·Jan Linder on Oct 13 2020, 21:11.

Oct 12 2020

Improve pdftotext and its analysis.
dc91f390862e
·Jan Linder on Oct 12 2020, 22:39.
Implement pdfToTxt manually quite correctly
e22f3e528e6a
·Jan Linder on Oct 12 2020, 12:48.

Oct 10 2020

implement PDFPageDetailedAggregator to get the positions of LTContainers
a0f6ce99d856
·Jan Linder on Oct 10 2020, 12:14.

Oct 6 2020

bring copnewer_analyzer to work
c66cb28f7eac
·Jan Linder on Oct 6 2020, 17:32.
add todos week4
9dd74b6c1ab6
·Jan Linder on Oct 6 2020, 14:33.
Remove old code files
0f3b244e9c77
·Jan Linder on Oct 6 2020, 13:50.
IMPLEMENT PDF TO TXT CORRECTLY Now use pdfminer with the laparam argument to…
29e001a8ff57
·Jan Linder on Oct 6 2020, 00:36.

Oct 5 2020

the ocr now works correctly
66d3e48b2e2a
·Jan Linder on Oct 5 2020, 21:38.
blacklist
154caa57dcc3
·Jan Linder on Oct 5 2020, 21:12.
whitelist ocr: not perfect
2f69d7e02c12
·Jan Linder on Oct 5 2020, 20:41.
Improve analysis for cop3 and cop4
9cc36860b206
·Jan Linder on Oct 5 2020, 14:16.
Small corrections for OCR
0d36b15c21a8
·Jan Linder on Oct 5 2020, 13:16.
finish modularization
67d367f6243d
·Jan Linder on Oct 5 2020, 00:14.

Oct 4 2020

File structure updated. (untested)
e2ddd912c5b8
·Jan Linder on Oct 4 2020, 15:15.
Begin with making a proper modularization
26f03fd369c3
·Jan Linder on Oct 4 2020, 14:22.

Sep 30 2020

inserted boxes for OCR and right parameters
2d93960b8990
·Jan Linder on Sep 30 2020, 21:52.

Sep 29 2020

added todo week3
75edac7ca39e
·Jan Linder on Sep 29 2020, 11:36.

Sep 28 2020

minor changes of process, added raw of cop3
d37074c1d20f
·Jan Linder on Sep 28 2020, 16:55.
progress on cop2-4
5b6aa3b3ac8b
·Jan Linder on Sep 28 2020, 15:55.

Sep 27 2020

Use of process_copX.py precised in README
57cdc59e9210
·Jan Linder on Sep 27 2020, 12:16.
Implemented processing of cop2-4. Works good for countries, but has major…
355f0c163915
·Jan Linder on Sep 27 2020, 11:46.
try with pypdf2
a557a870c334
·Jan Linder on Sep 27 2020, 09:47.

Sep 26 2020

implemented process cop for 5 - 25 with textract but there are major errors in…
13691532eec5
·Jan Linder on Sep 26 2020, 18:44.

Sep 23 2020

progress on the class and process script
7f3f311f331c
·Jan Linder on Sep 23 2020, 08:40.

Sep 22 2020

Began the copx file
c747832a97fe
·Jan Linder on Sep 22 2020, 17:28.
added todo
0055a1d8e4a0
·Jan Linder on Sep 22 2020, 10:25.
added raw txt for cop25
aa92caa65e57
·Jan Linder on Sep 22 2020, 09:44.
added my testing files for OCR with cop1
37b4e9f47446
·Jan Linder on Sep 22 2020, 00:16.

Sep 17 2020

data complete
9514a37465f4
·Jan Linder on Sep 17 2020, 15:00.
data complete
77b17d5e7bd6
·Jan Linder on Sep 17 2020, 15:00.
first part of the lists
45310b6c42f1
·Jan Linder on Sep 17 2020, 11:34.