Homec4science

Implement a stream iterator and hashing iterator

Authored by epriestley <git@epriestley.com> on Mar 18 2016, 13:00.

Description

Implement a stream iterator and hashing iterator

Summary:
Ref T10604. For Git LFS, we need to compute file hashes as we accept data.

This allows a stream to be wrapped in an iterator, and an iterator to be wrapped in another iterator which does hashing.

This will ultimately let us pump data into Files without needing 100GB of memory to accept a 100GB file.

Test Plan: Added unit test, ran unit test.

Reviewers: chad

Reviewed By: chad

Maniphest Tasks: T10604

Differential Revision: https://secure.phabricator.com/D15491

Details

Committed
epriestley <git@epriestley.com>Mar 18 2016, 17:11
Pushed
aubortMar 17 2017, 12:03
Parents
rPHUa4ca530644be: Move request decoding/streaming to AphrontRequestStream
Branches
Unknown
Tags
Unknown

Event Timeline

epriestley <git@epriestley.com> committed rPHUb4f38af38480: Implement a stream iterator and hashing iterator (authored by epriestley <git@epriestley.com>).Mar 18 2016, 17:11