Iterim progress on Issue #146 Prototype fluent Spark API for manipulating…
69c49a0f2989
Actions

Authored by lintool <jimmylin@umd.edu> on Oct 28 2015, 17:43.

Description

Iterim progress on Issue #146 Prototype fluent Spark API for manipulating archive data.

Committed

lintool <jimmylin@umd.edu>

Oct 28 2015, 17:43

Pushed

dportabella

Oct 19 2016, 16:29

Parents

Branches

Unknown

Tags

Unknown

Commit	Author	Details	Committed
35e39da6e72d	Alice-Z	add extractCrawldateDomainUrlBody	Oct 23 2015
e5821091ecca	Alice-Z	update ArcRecords interface	Oct 21 2015
cfe76f600c7d	Alice-Z	extend RDD	Oct 15 2015
c20eecbe5a3c	Alice-Z	Merge branch 'master' of github.com:lintool/warcbase into alicez-sparkplug	Oct 15 2015
e77201892789	Alice-Z	first commit	Oct 15 2015

		Path
M		src/main/java/org/warcbase/pig/piggybank/ExtractLinks.java
A	(dir)	src/main/scala/org/warcbase/spark/matchbox/
A		src/main/scala/org/warcbase/spark/matchbox/ArcRecords.scala
A		src/main/scala/org/warcbase/spark/matchbox/ExtractRawText.scala
A		src/main/scala/org/warcbase/spark/matchbox/ExtractTopLevelDomain.scala
A	(dir)	src/main/scala/org/warcbase/spark/scripts/
A		src/main/scala/org/warcbase/spark/scripts/Filter.scala