Homec4science

Split the GitHub import cursor into separate repository and issues event…

Authored by epriestley <git@epriestley.com> on Mar 9 2016, 14:35.

Description

Split the GitHub import cursor into separate repository and issues event importers

Summary:
Ref T10538. The primary GitHub event activity stream does not report minor events (labels, milestones, etc).

GitHub has a second, similar activity stream which does report these events (the "Issues Events API").

Use two separate cursors: one consumes the primary stream; the second consumes the events stream.

One possible issue with this is that we may write events in a different order than they occurred, so GitHub shows "comment, label, close" but we show "comment, close, label" or similar. This is probably OK because the secondary API doesn't seem to have any very important events (e.g., it's probably fine if label changes are out-of-order), but we can conceivably put some buffer stage in between the two if it's an issue.

Test Plan: {F1164894}

Reviewers: chad

Reviewed By: chad

Maniphest Tasks: T10538

Differential Revision: https://secure.phabricator.com/D15446

Details

Committed
epriestley <git@epriestley.com>Mar 9 2016, 18:27
Pushed
aubortJan 31 2017, 17:16
Parents
rPH1e83aef88080: Give Nuance items some basic descriptive text
Branches
Unknown
Tags
Unknown

Event Timeline

epriestley <git@epriestley.com> committed rPH72889c09bf08: Split the GitHub import cursor into separate repository and issues event… (authored by epriestley <git@epriestley.com>).Mar 9 2016, 18:27