Comment by forgotmyoldacc
5 years ago
Really interesting read. From what's described: Walpole (distributed job runner), Dagger (DAG that recalculates when dependencies change), Barbara (global key value store) and monorepo/fast deployment, its not so different from some big tech companies.
You can see how it's tied together in this presentation https://youtu.be/M9o9SF5-Pzw
At JPM, Athena: Walpole = Bob job runner Dagger = pixies Barbara = hydra
The python 3 migration is still ongoing
Jesus I can imagine how difficult it is to migrate the whole solution to Python3.
Indeed.
Thankfully, I think it can be said the light is now strongly visible at the end of the tunnel on Python 3 (but it’s not completely done).