Diffusion warcbase 26d2ef518fb3

Killed RecordUtils, ExtractLinksAndText, JwatArcLoaderTest (Issues #172, #173…
26d2ef518fb3
Actions

Authored by lintool <jimmylin@uwaterloo.ca> on Nov 25 2015, 03:53.

Description

Killed RecordUtils, ExtractLinksAndText, JwatArcLoaderTest (Issues #172, #173, #176)

Details

Committed

lintool <jimmylin@uwaterloo.ca>

Nov 25 2015, 03:53

Pushed

dportabella

Oct 19 2016, 16:29

Parents

R1473:5e316b1bb129: Killed RecordUtils, ExtractLinksAndText, JwatArcLoaderTest
R1473:b7dd047a8dde: Add Scaladoc generation info

Branches

Unknown

Tags

Unknown

Event Timeline

lintool <jimmylin@uwaterloo.ca> committed R1473:26d2ef518fb3: Killed RecordUtils, ExtractLinksAndText, JwatArcLoaderTest (Issues #172, #173… (authored by lintool <jimmylin@uwaterloo.ca>).Nov 25 2015, 03:53

Merged Changes

Commit	Author	Details	Committed
5e316b1bb129	lintool	Killed RecordUtils, ExtractLinksAndText, JwatArcLoaderTest	Nov 25 2015
0b0839bdbaa9	lintool	Fixed CR/LF issues (i.e., DOS formatting).	Nov 25 2015
2e88c1b19afb	lintool	Slapped Apache License boilerplate -- now we're a real open-source project :)	Nov 25 2015

Changes (67)

				Path
	M			src/main/java/org/warcbase/WarcbaseAdmin.java
	M			src/main/java/org/warcbase/analysis/FindArcUrls.java
	M			src/main/java/org/warcbase/analysis/FindWarcUrls.java
	M			src/main/java/org/warcbase/analysis/graph/ExtractLinksWac.java
	M			src/main/java/org/warcbase/analysis/graph/ExtractSiteLinks.java
	M			src/main/java/org/warcbase/analysis/graph/InvertAnchorText.java
	M			src/main/java/org/warcbase/analysis/graph/PrefixMapping.java
	M			src/main/java/org/warcbase/browser/SeleniumBrowser.java
	M			src/main/java/org/warcbase/browser/WarcBrowser.java
	M			src/main/java/org/warcbase/browser/WarcBrowserServlet.java
	M			src/main/java/org/warcbase/data/ArcRecordUtils.java
	M			src/main/java/org/warcbase/data/HBaseTableManager.java
	D			src/main/java/org/warcbase/data/RecordUtils.java
	M			src/main/java/org/warcbase/data/UrlMapping.java
	M			src/main/java/org/warcbase/data/UrlMappingBuilder.java
	M			src/main/java/org/warcbase/data/UrlMappingMapReduceBuilder.java
	M			src/main/java/org/warcbase/data/UrlUtils.java
	M			src/main/java/org/warcbase/data/WarcRecordUtils.java
	M			src/main/java/org/warcbase/demo/WacMapReduceArcDemo.java
	M			src/main/java/org/warcbase/demo/WacMapReduceHBaseDemo.java
	M			src/main/java/org/warcbase/demo/WacMapReduceHBaseWrapperDemo.java
	M			src/main/java/org/warcbase/index/IndexerMapper.java
	M			src/main/java/org/warcbase/index/IndexerReducer.java
	M			src/main/java/org/warcbase/index/IndexerRunner.java
	M			src/main/java/org/warcbase/ingest/IngestFiles.java
	M			src/main/java/org/warcbase/ingest/SearchForUrl.java
	M			src/main/java/org/warcbase/io/ArcRecordWritable.java
	M			src/main/java/org/warcbase/io/WarcRecordWritable.java
	M			src/main/java/org/warcbase/mapreduce/WacArcInputFormat.java
	M			src/main/java/org/warcbase/mapreduce/WacWarcInputFormat.java
	M			src/main/java/org/warcbase/mapreduce/lib/Chain.java
	M			src/main/java/org/warcbase/mapreduce/lib/ChainMapContextImpl.java
	M			src/main/java/org/warcbase/mapreduce/lib/HBaseRowToArcRecordWritableMapper.java
	M			src/main/java/org/warcbase/mapreduce/lib/TableChainMapper.java
	M			src/main/java/org/warcbase/wayback/WarcbaseResourceIndex.java
	M			src/main/java/org/warcbase/wayback/WarcbaseResourceStore.java
	M			src/main/scala/org/warcbase/spark/matchbox/DetectLanguage.scala
	M			src/main/scala/org/warcbase/spark/matchbox/DetectMimeTypeTika.scala
	M			src/main/scala/org/warcbase/spark/matchbox/ExtractBoilerpipeText.scala
	M			src/main/scala/org/warcbase/spark/matchbox/ExtractEntities.scala
	M			src/main/scala/org/warcbase/spark/matchbox/ExtractLinks.scala
	D			src/main/scala/org/warcbase/spark/matchbox/ExtractLinksAndText.scala
	M			src/main/scala/org/warcbase/spark/matchbox/ExtractRawText.scala
	M			src/main/scala/org/warcbase/spark/matchbox/ExtractTextFromPDFs.scala
	M			src/main/scala/org/warcbase/spark/matchbox/ExtractTopLevelDomain.scala
	M			src/main/scala/org/warcbase/spark/matchbox/NER3Classifier.scala
	M			src/main/scala/org/warcbase/spark/matchbox/RecordLoader.scala
	M			src/main/scala/org/warcbase/spark/matchbox/RecordTransformers.scala
	M			src/main/scala/org/warcbase/spark/pythonconverters/ArcRecordConverter.scala
	M			src/main/scala/org/warcbase/spark/rdd/RecordRDD.scala
	M			src/main/scala/org/warcbase/spark/scripts/Filter.scala
	M			src/main/scala/org/warcbase/spark/scripts/SocialMediaLinks.scala
	M			src/test/java/org/warcbase/data/UrlMappingTest.java
	M			src/test/java/org/warcbase/data/UrlUtilsTest.java
	D			src/test/java/org/warcbase/ingest/JwatArcLoaderTest.java
	M			src/test/java/org/warcbase/ingest/WacArcLoaderTest.java
	M			src/test/java/org/warcbase/ingest/WacWarcLoaderTest.java
	M			src/test/java/org/warcbase/io/ArcRecordWritableTest.java
	M			src/test/java/org/warcbase/io/WarcRecordWritableTest.java
	M			src/test/java/org/warcbase/mapreduce/WacArcInputFormatTest.java
	M			src/test/java/org/warcbase/mapreduce/WacWarcInputFormatTest.java
	M			src/test/scala/org/warcbase/spark/ArcTest.scala
	M			src/test/scala/org/warcbase/spark/WarcTest.scala
	M			src/test/scala/org/warcbase/spark/matchbox/ExtractEntitiesTest.scala
	M			src/test/scala/org/warcbase/spark/matchbox/ExtractLinksTest.scala
	M			src/test/scala/org/warcbase/spark/matchbox/ExtractTopLevelDomainTest.scala
	M			src/test/scala/org/warcbase/spark/rdd/CountableRDDTest.scala