Homec4science
Diffusion warcbase 649f1674352b

Initial experiments with Python converters to use Hadoop InputFormat from…
649f1674352b
Actions

Authored by lintool <jimmylin@umd.edu> on May 27 2015, 01:31.

Description

Initial experiments with Python converters to use Hadoop InputFormat from pyspark. Works but janky.

Details

Committed
lintool <jimmylin@umd.edu>May 27 2015, 01:31
Pushed
dportabellaOct 19 2016, 16:29
Parents
R1473:46a6069f9b07: Fixed issues #101, #103, #115
Branches
Unknown
Tags
Unknown

Event Timeline

lintool <jimmylin@umd.edu> committed R1473:649f1674352b: Initial experiments with Python converters to use Hadoop InputFormat from… (authored by lintool <jimmylin@umd.edu>).May 27 2015, 01:31

Changes (7)

Path
Mpom.xml
A(dir)src/main/scala/
A(dir)src/main/scala/org/
A(dir)src/main/scala/org/warcbase/
A(dir)src/main/scala/org/warcbase/spark/
A(dir)src/main/scala/org/warcbase/spark/pythonconverters/
Asrc/main/scala/org/warcbase/spark/pythonconverters/ArcRecordConverter.scala

R1473:649f1674352b

View Options

pom.xml

Loading...
View Options

src/main/scala/org/warcbase/spark/pythonconverters/ArcRecordConverter.scala

Loading...
c4science · Help