Diffusion dslab-final-project (master) History

R10546/notebooks
mastercd42c9e3bd49fd0fe57d6cb…

May 24 2020

few note de bouque
1fe0d3b2f81a
·coudray on May 24 2020, 11:32.
readme more
84786816c9ba
·coudray on May 24 2020, 11:23.
corrected None for departure and arrival times in stop_times
9f4bec1e3e7b
·pulver on May 24 2020, 11:18.
notebooks
f5a26b1b11b4
·coudray on May 24 2020, 11:15.

May 23 2020

notebook saturday night
55c011d7880e
·coudray on May 23 2020, 22:33.
hdfs_ notebooks done re-run all
a8755c23720e
·coudray on May 23 2020, 20:10.
proofreading tomas's arrays, found the problem with counting nstops in routes
9246e1f674c0
·pulver on May 23 2020, 19:19.
Use stop name and trip headsign when printing the journey
cacf44a37a82
·grimbot on May 23 2020, 18:27.
Add function to sort the solutions by departure time
da090bc35342
·grimbot on May 23 2020, 17:50.
finished comments on Array_Cyrill_data
606ae1d9c12e
·Tomas Erland Turner on May 23 2020, 16:54.
hdfs_match_datasets clean
767dec94c3f3
·coudray on May 23 2020, 16:37.
update arrays saturday late afternoon
564eb750adbb
·Tomas Erland Turner on May 23 2020, 16:20.
Merge branch 'master' of https://renku.iccluster.epfl.
ab14aff1c04a
·grimbot on May 23 2020, 16:07.
Add correspondance between stop_int and stop_id
4315054f25c2
·grimbot on May 23 2020, 16:07.
monotonically_increasing_id on stop_times and transfers, verified transfers and…
cab08c886424
·pulver on May 23 2020, 13:56.
transfers Cyril
247c8a565f5f
·pulver on May 23 2020, 12:19.
rename hdfs_ files
c179d67d005b
·coudray on May 23 2020, 12:02.
proba notebooks
b8097eb016ce
·coudray on May 23 2020, 12:00.
added notebook with from stopid to stop_int function
e2421544ce3f
·Tomas Erland Turner on May 23 2020, 11:59.
corrected error None arrival times
66f21d7456b4
·Tomas Erland Turner on May 23 2020, 11:22.

May 22 2020

Put the condition on k+3 back
05b5d796ad1c
·grimbot on May 22 2020, 23:02.
Merge branch 'master' of https://renku.iccluster.epfl.
b030f4f0e440
·grimbot on May 22 2020, 22:58.
Arrays from Cyril's data
8f88c9e50248
·Tomas Erland Turner on May 22 2020, 18:21.
Merge branch 'master' of https://renku.iccluster.epfl.
0bd6cc9c79c0
·Tomas Erland Turner on May 22 2020, 18:03.
created notebook to process data of cyrill
06b44fd00555
·Tomas Erland Turner on May 22 2020, 18:03.
added coordinates to stop_times
3bc5a8f63f80
·pulver on May 22 2020, 16:17.
QC on routes with sbb.ch, all seems fine
e6344adaf292
·pulver on May 22 2020, 15:25.
cleaned to_begin_with
30b8d85ae68d
·Tomas Erland Turner on May 22 2020, 15:07.
corrected stop_times spark
709f395ad897
·pulver on May 22 2020, 15:00.
Uncover another inconsistency in the data arrays
d39f7e80d074
·grimbot on May 22 2020, 14:19.
Discard columns 0 and 3 from during pre-processing
80b6534fbcc6
·grimbot on May 22 2020, 13:29.
keeping track of stop names, directions for stop_times
fc775bc4a50b
·pulver on May 22 2020, 11:41.
MAC_RAPTOR with PROBA !!
c32079cc5077
·coudray on May 22 2020, 10:50.
stops general indexed in stop_times
5a9d26827857
·pulver on May 22 2020, 09:34.
last notebook before sleep no lfs
92ae35b87dcd
·coudray on May 22 2020, 02:36.
ntoebook thursday night
5e4b45e082cc
·coudray on May 22 2020, 02:02.

May 21 2020

Run MC_RAPTOR including foot paths
6295255df090
·grimbot on May 21 2020, 20:42.
Run MC_RAPTOR with new data
4ee6db5c2f55
·grimbot on May 21 2020, 20:35.
finished stop_times, ready to generate RAPTOR entries from it
7e4ec122a272
·pulver on May 21 2020, 19:48.
check if stops in stop_routes can be found correctly in routes_stop
6c096365c0e7
·Tomas Erland Turner on May 21 2020, 19:41.
Working arrays for all
e2c34b61187b
·Tomas Erland Turner on May 21 2020, 19:29.
Merge branch 'master' of https://renku.iccluster.epfl.
000388658093
·grimbot on May 21 2020, 18:24.
Run MC_RAPTOR with SBB data, detect stopRoutes/routeStops mismatch
df99f5ab9771
·grimbot on May 21 2020, 18:21.
Update on .pkl with 741 routes
387ae7e19c49
·Tomas Erland Turner on May 21 2020, 18:13.
unique trips
b0b5e5f0e5d0
·pulver on May 21 2020, 18:00.
added types of transport in data/stop_times_df.pkl
6a596fef5271
·Tomas Erland Turner on May 21 2020, 17:41.
changing routes, switch to more memory
a68ce3056228
·Tomas Erland Turner on May 21 2020, 17:24.
filtered in business days
da541475b133
·pulver on May 21 2020, 15:20.
starting data processing on stop_times
55cc016f9317
·pulver on May 21 2020, 15:06.
Routes, routes_stops, stopTimes, ready
c5bfd54c1142
·Tomas Erland Turner on May 21 2020, 15:04.
Merge branch 'master' of https://renku.iccluster.epfl.
e2537511f325
·grimbot on May 21 2020, 14:46.
Add foot-paths to MC_RAPTOR
d2b0410dd512
·grimbot on May 21 2020, 14:45.
update thrusday
7e9d8ecd7e91
·coudray on May 21 2020, 14:23.
Merge branch 'master' of https://renku.iccluster.epfl.
d21a456cec26
·grimbot on May 21 2020, 13:33.
Define MC_RAPTOR algo in a function
d440cc905715
·grimbot on May 21 2020, 13:33.
updates Tomas 21-05 matin
bcb5bf303c3a
·Tomas Erland Turner on May 21 2020, 12:54.
proofreading to_begin_with.py (Cyril) and uploading a fully working example of…
f667d80b1bf7
·pulver on May 21 2020, 12:27.
change to_begin_with, comments and eliminate trimming trip
ad71a2fa2f60
·Tomas Erland Turner on May 21 2020, 10:53.

May 20 2020

function to delete all trips with departure before 7 am and after 7 pm
b755bf1e01e3
·Tomas Erland Turner on May 20 2020, 22:51.
Tomas notebooks update
2d2e2606fc30
·Tomas Erland Turner on May 20 2020, 19:23.
Add MC_RAPTOR.ipynb, load pickles.
9611dd5c9265
·grimbot on May 20 2020, 12:43.
proba_functions
d321992e5e56
·Tomas Erland Turner on May 20 2020, 10:06.
update proba_functions
30792a622227
·Tomas Erland Turner on May 20 2020, 10:04.
again wednesday
86962b9b50d2
·coudray on May 20 2020, 10:04.
LFS DF before array creation for translation + update stop_routes
69336af5c4c8
·Tomas Erland Turner on May 20 2020, 10:04.
proba last wed
79bdd46b8497
·coudray on May 20 2020, 09:41.
p functions morning wed
f4445017c8f6
·coudray on May 20 2020, 08:02.
last tuesday night
4c6382870dee
·coudray on May 20 2020, 00:22.

May 19 2020

proba last tuesday
e74400a6c4c9
·coudray on May 19 2020, 23:56.
proba_functions
b7e686fc4d05
·coudray on May 19 2020, 23:37.
last change proba
16256facb560
·coudray on May 19 2020, 23:12.
LFS Arrays in pickle
58a1902eb88b
·Tomas Erland Turner on May 19 2020, 18:57.
fixed merged conflict on requirements
b8034a6e1525
·Tomas Erland Turner on May 19 2020, 14:50.
deleted unnecessary bash norebook and alex's notebook
fcf8b2483a6b
·Tomas Erland Turner on May 19 2020, 14:25.
recover saved notebooks
890a7e84792b
·coudray on May 19 2020, 14:16.
changed order array and added markdown with paths to array
358c9a5a4fc8
·Tomas Erland Turner on May 19 2020, 11:42.

May 18 2020

add hdfs3 to docker
bd8fd3f2f0bc
·coudray on May 18 2020, 14:46.
mondaz afternoon
70fe52e0084f
·coudray on May 18 2020, 14:40.

May 17 2020

sunday night
e3f3f37aadb1
·coudray on May 17 2020, 23:39.
Sunday at noon
49cf1c6a9153
·coudray on May 17 2020, 12:44.
more from sunday
edaf2a6791ad
·coudray on May 17 2020, 10:19.
match dataset sunday morning
ef41bb552ad5
·coudray on May 17 2020, 07:42.

May 16 2020

finished data structures: added none in times, route_int and stop:int, deleted…
372be05c9231
·Tomas Erland Turner on May 16 2020, 19:22.
satureday afternoon
a6766a6b5cb1
·coudray on May 16 2020, 17:38.

May 15 2020

put stops and routes on int ids, saved array as txt
9d8122f616fe
·Tomas Erland Turner on May 15 2020, 18:29.
last friday afternoon
1ed096514ea7
·coudray on May 15 2020, 16:57.
New file to match datasets
ac30976cad9c
·coudray on May 15 2020, 15:47.
added hdfs3 to requirements.txt
89e8d79884b2
·Tomas Erland Turner on May 15 2020, 10:09.
trial if hdfs32 works
ab1c14cf526a
·Tomas Erland Turner on May 15 2020, 09:59.
last thur
5640159cfbd1
·coudray on May 15 2020, 00:12.
proba last Thursday
f1d49a05b671
·coudray on May 15 2020, 00:09.

May 14 2020

finished code for arrays
b27bf3e14daf
·Tomas Erland Turner on May 14 2020, 18:47.
deleted duplicates
4406d368b087
·Tomas Erland Turner on May 14 2020, 12:42.
added hdfs and os to requirements
b9d074c58b13
·Tomas Erland Turner on May 14 2020, 09:39.
proba last time wednesday night
0cd0d3e3a530
·coudray on May 14 2020, 01:30.
proba first push
fdf7053d7adc
·coudray on May 14 2020, 00:52.

May 12 2020

deleted departures before 7 and after 21 + added directionality to routes
4e5777eb2c6b
·Tomas Erland Turner on May 12 2020, 11:45.

May 9 2020

started preparing data structures raptor
9735b780c4b6
·Tomas Erland Turner on May 9 2020, 19:22.
Preprocessed data leaving only data within 15 km and active on all business days
072dcd8f004e
·Tomas Erland Turner on May 9 2020, 17:55.

Apr 29 2020

Add to_begin_with notebook
31289964be7c
·• tao.sun on Apr 29 2020, 14:22.

R10546/notebooksmastercd42c9e3bd49fd0fe57d6cb…

May 24 2020

May 23 2020

May 22 2020

May 21 2020

May 20 2020

May 19 2020

May 18 2020

May 17 2020

May 16 2020

May 15 2020

May 14 2020

May 12 2020

May 9 2020

Apr 29 2020

R10546/notebooks
mastercd42c9e3bd49fd0fe57d6cb…