Azkaban Flow UI

One of the most important aspects of a production offline processing system is a workflow scheduler. A workflow scheduler allows you to string together a group of processes to run in an order that respects the dependencies between the jobs (i.e. one processes output is another’s input). At LinkedIn we run a number of very [...]

Tagged