Diffusion warcbase f5d8edf50506

Killed all the Pig stuff.
f5d8edf50506
Actions

Authored by lintool <jimmylin@uwaterloo.ca> on Nov 24 2015, 22:05.

Description

Killed all the Pig stuff.

Details

Committed

lintool <jimmylin@uwaterloo.ca>

Nov 24 2015, 22:05

Pushed

dportabella

Oct 19 2016, 16:29

Parents

R1473:924df687ce28: Make ExtractEntities load a new classifier per partition

Branches

Unknown

Tags

Unknown

Event Timeline

lintool <jimmylin@uwaterloo.ca> committed R1473:f5d8edf50506: Killed all the Pig stuff. (authored by lintool <jimmylin@uwaterloo.ca>).Nov 24 2015, 22:05

Changes (30)

				Path
	M			README.md
	M			pom.xml
	D			src/main/java/org/warcbase/pig
	D			src/main/java/org/warcbase/pig/ArcLoader.java
	D			src/main/java/org/warcbase/pig/WarcLoader.java
	D			src/main/java/org/warcbase/pig/piggybank
	D			src/main/java/org/warcbase/pig/piggybank/DetectLanguage.java
	D			src/main/java/org/warcbase/pig/piggybank/DetectMimeTypeMagic.java
	D			src/main/java/org/warcbase/pig/piggybank/DetectMimeTypeTika.java
	D			src/main/java/org/warcbase/pig/piggybank/ExtractBoilerpipeText.java
	D			src/main/java/org/warcbase/pig/piggybank/ExtractLinks.java
	D			src/main/java/org/warcbase/pig/piggybank/ExtractRawText.java
	D			src/main/java/org/warcbase/pig/piggybank/ExtractTextFromPDFs.java
	D			src/main/java/org/warcbase/pig/piggybank/ExtractTopLevelDomain.java
	D			src/main/java/org/warcbase/pig/piggybank/NER3ClassUDF.java
	M			src/main/scala/org/warcbase/spark/matchbox/ExtractTextFromPDFs.scala
	D			src/test/java/org/warcbase/pig
	D			src/test/java/org/warcbase/pig/PigArcLoaderTest.java
	D			src/test/java/org/warcbase/pig/PigWarcLoaderTest.java
	D			src/test/java/org/warcbase/pig/piggybank
	D			src/test/java/org/warcbase/pig/piggybank/ExtractLinksTest.java
	D			src/test/java/org/warcbase/pig/piggybank/ExtractTopLevelDomainTest.java
	D			src/test/resources/scripts
	D			src/test/resources/scripts/TestArcCountLinks.pig
	D			src/test/resources/scripts/TestArcLoader.pig
	D			src/test/resources/scripts/TestArcLoaderCount.pig
	D			src/test/resources/scripts/TestDetectLanguage.pig
	D			src/test/resources/scripts/TestDetectMimeTypeMagic.pig
	D			src/test/resources/scripts/TestDetectMimeTypeTika.pig
	D			src/test/resources/scripts/TestWarcLoaderCount.pig