Fixed issues #71, #70, #66, #63 and #62 (partially)
a00e413edff4
Actions

Authored by lintool <jimmylin@umd.edu> on Aug 16 2014, 15:43.

Description

Fixed issues #71, #70, #66, #63 and #62 (partially)

Issue #71: Cleanup UrlUtil/Util
Issue #70: Clean up pom.xml
Issue #66: Build issue with overlapping fastutil versions
Issue #63: Ingestion bug: OOM error
Issue #62: Ingestion bug in copyStream, wrong number of bytes expected

Details

Committed

lintool <jimmylin@umd.edu>

Aug 16 2014, 15:43

Pushed

dportabella

Oct 19 2016, 16:29

Parents

R1473:377a3e3a429f: Better handling of ARC parse errors.
R1473:55a7334ae0bb: Fixed issue #60: Merge in Clemens et al. contributions to Warcbase

Branches

Unknown

Tags

Unknown

Event Timeline

lintool <jimmylin@umd.edu> committed R1473:a00e413edff4: Fixed issues #71, #70, #66, #63 and #62 (partially) (authored by lintool <jimmylin@umd.edu>).Aug 16 2014, 15:43

Merged Changes

Commit	Author	Details	Committed
377a3e3a429f	lintool	Better handling of ARC parse errors.	Aug 15 2014
2d16fd032060	lintool	Bump max value size up to 10 MB, tweak WAL settings.	Aug 14 2014
bf606c07d453	lintool	Refactoring UrlUtil and related classes.	Aug 14 2014
ff34480981dd	lintool	Restored some sanity to versions and transitive dependencies.	Aug 14 2014

Changes (16)

				Path
	M			pom.xml
	M			src/main/java/org/warcbase/analysis/CountRowTypes.java
	M			src/main/java/org/warcbase/analysis/ExtractText.java
	M			src/main/java/org/warcbase/analysis/PrintAllUris.java
	M			src/main/java/org/warcbase/analysis/graph/InvertAnchorText.java
	M			src/main/java/org/warcbase/browser/WarcBrowserServlet.java
	M			src/main/java/org/warcbase/data/HBaseTableManager.java
	V			src/main/java/org/warcbase/data/{UrlUtil.java → UrlUtils.java}
	V			src/main/java/org/warcbase/data/{UrlUtils.java ← UrlUtil.java}
	D			src/main/java/org/warcbase/data/Util.java
	M			src/main/java/org/warcbase/ingest/IngestFiles.java
	M			src/main/java/org/warcbase/ingest/SearchForUri.java
	V			src/test/java/org/warcbase/data/{UriMappingTest.java → UrlMappingTest.java}
	V			src/test/java/org/warcbase/data/{UrilUtilTest.java → UrlUtilsTest.java}
	V			src/test/java/org/warcbase/data/{UrlMappingTest.java ← UriMappingTest.java}
	V			src/test/java/org/warcbase/data/{UrlUtilsTest.java ← UrilUtilTest.java}