Diffusion warcbase (master) History

R1473/warcbase-core
master

Sep 30 2016

Fixed Issue #251: java.lang.NullPointerException on Collection
ec426771d44e
·lintool on Sep 30 2016, 20:21.
Fix fo issue #244: NPE from link extraction.
abc6d5bef700
·lintool on Sep 30 2016, 18:20.
Merge pull request #253 from ukwa/master
a83eed067bb5
·Jimmy Lin / GitHub on Sep 30 2016, 03:13.
Better error trapping for issue #244: java.util.zip.ZipException: invalid…
ae517ff3096e
·lintool on Sep 30 2016, 03:10.

Sep 29 2016

Also allow XHTML through, as per #252.
a190ceace8bf
·Andrew Jackson on Sep 29 2016, 23:52.

Aug 2 2016

Multiple partitions
7f9de3dbcbf8
·Youngbin Kim on Aug 2 2016, 19:52.

Jul 31 2016

Changed output type to rdd
71069610d8b4
·Youngbin Kim on Jul 31 2016, 18:52.

Jul 27 2016

checksum
3b4ebe297a21
·Youngbin Kim on Jul 27 2016, 03:04.

Jun 29 2016

Skips corrupt WARC records with negative lengths.
165d8f38fffe
·lintool on Jun 29 2016, 00:12.

Jun 28 2016

Fixed Scala matching issue with NER extractor.
6a90426a3d1a
·lintool on Jun 28 2016, 16:50.

Jun 24 2016

Upgraded to CDH 5.7.1.
19be6edfa8cd
·lintool on Jun 24 2016, 23:08.

Jun 22 2016

Added dependencies for boilerpipe.
0dfabaeb484b
·lintool on Jun 22 2016, 17:57.

Jun 17 2016

Cleaned up and simplified dependencies, etc.
e8c43f1b9d24
·lintool on Jun 17 2016, 19:46.

Jun 16 2016

Moved HBase and non-core code out of warcbase-core into warcbase-hbase.
0db46be7ef7f
·lintool on Jun 16 2016, 17:30.
Created warcbase-core module.
f972206db516
·lintool on Jun 16 2016, 15:43.