History Graph
History Graph
Commit | Author | Details | Committed | |||
---|---|---|---|---|---|---|
13619567667f | lintool | Changed over to WacWarcInputFormatTest as the underlying InputFormat. | Jun 6 2015 | |||
a3a2cd7853c8 | lintool | tries to fix issues with relative links | May 13 2015 | |||
0a781f364480 | lintool | Added test case for ExtractLinks UDF. | May 6 2015 | |||
5b10497c2d53 | lintool | Updated UDF to handle relative paths (with source page). Added test case. | May 6 2015 | |||
0145d74ed35e | lintool | Refactoring to create method that extracts MIME from WARC response records. | Oct 22 2014 | |||
410cfd81a069 | lintool | WARC-related Hadoop bindings. | Oct 19 2014 | |||
f4a249469cbc | lintool | Minor refactoring. | Oct 19 2014 | |||
3af097ea655d | lintool | Fixed test cases. | Oct 19 2014 | |||
4798a4314b6e | lintool | Figured out how to extract MIME type and date from WARC. | Aug 30 2014 | |||
f3516c7fd7f0 | lintool | Added test cases to try loading WARC records from a stream; back-ported same… | Aug 29 2014 | |||
28c5c007f4fd | lintool | Added simple test case. | Aug 28 2014 | |||
ccee8fd2204a | lintool | Implemented ArcRecordWritable. | Aug 23 2014 | |||
846ebb216100 | lintool | Minor refactoring. | Aug 23 2014 | |||
47f3c46c099d | lintool | Added Hadoop bindings for webarchive-commons ARC readers, demo, test cases. | Aug 22 2014 | |||
b07376aba3fe | lintool | Added/refactored test cases for JWAT. | Aug 22 2014 | |||
bf606c07d453 | lintool | Refactoring UrlUtil and related classes. | Aug 14 2014 | |||
93f6d42f4ff4 | lintool | Fixed compile and broken test issues. | Aug 12 2014 | |||
accd1978862d | lintool | Merge branch 'master' of github.com:cneud/warcbase into cneud-integration | Aug 12 2014 | |||
f3015cd7ba4b | lintool | issue #50 | Jun 18 2014 | |||
02c26d6d8ea4 | lintool | Started working on issue #46 cleanup of org.warcbase.data.Util | Jun 17 2014 | |||
a6be4375e0c7 | lintool | ExtractLinks using HBase appears to be working. | Jun 13 2014 | |||
60b827d1c174 | lintool | Refactored getIdRange method signature, add more test cases to UriMapping. | Jun 5 2014 | |||
7fc1b92d60a7 | Jeffyrao | fix issue 40 that UriMapping prefix search should return empty result when no… | Jun 5 2014 | |||
a8953616248c | lintool | Refactoring, added test case (currently broken). | Jun 4 2014 | |||
758948b463b9 | lintool | Light refactoring, fixed a few errors. | Mar 31 2014 | |||
71c68ecae0fa | Jeffyrao | add prefix search feature to UriMapping class; add test class for UriMapping… | Mar 31 2014 | |||
db4ebe9f4826 | pmd | Added a null pointer check and a more Pig friendly return value from the UDFs | Dec 19 2013 | |||
bedac9288080 | pmd | Corrected an error in the DetectMimeTypeMagic Pig script and the corresponding… | Dec 19 2013 | |||
5d312a3f80ec | pmd | Removed warnings | Dec 19 2013 | |||
b3fdd488fdcb | pmd | Refactored the DetectMimeType into two seperate methods: one for each detection… | Dec 19 2013 | |||
842012e0de5f | pmd | Corrected a comment | Dec 10 2013 | |||
e71f20141a36 | pmd | Changed unit test to match the change in ArcLoader that removed the filter for… | Dec 10 2013 | |||
10b02ec31780 | pmd | Changed unit test to match the change in ArcLoader that removed the filter for… | Dec 10 2013 | |||
b8f63da4d685 | pmd | Use the provided ARC file for the unit test. | Dec 9 2013 | |||
25ca4df65a50 | pmd | Improving the unit test of the DetectMimeType by using the two identification… | Dec 9 2013 | |||
1a209cf5b04a | pmd | First version of a magic lib UDF | Dec 4 2013 | |||
c0e996ec2e61 | pmd | Added unit test for the language detection UDF. | Dec 3 2013 | |||
a4282d81d6e9 | lintool | Cleaned up Pig test cases, added JWAT test case. | Dec 2 2013 | |||
17bc9616a180 | graemon | added a pig unit test | Dec 2 2013 | |||
8885f5db4ded | graemon | added a pig unit test | Dec 2 2013 |
c4science · Help