Loading presentation...

Present Remotely

Send the link below via email or IM


Present to your audience

Start remote presentation

  • Invited audience members will follow you as you navigate and present
  • People invited to a presentation do not need a Prezi account
  • This link expires 10 minutes after you close the presentation
  • A maximum of 30 users can follow your presentation
  • Learn more about this feature in our knowledge base article

Do you really want to delete this prezi?

Neither you, nor the coeditors you shared it with will be able to recover it again.


Azkaban: Next level job scheduling

No description

Irfan Khan

on 16 December 2013

Comments (0)

Please log in to add your comment.

Report abuse

Transcript of Azkaban: Next level job scheduling

Azkaban: Next level job scheduling
Why Azkaban?
Easy to view and schedule jobs

Easy to manage job workflows
Add dependencies
Success/failure emails
History of job executions

Web GUI shows stores run information
How it works
Read and write jobs using the Web Service

Jobs are stored in the MySQL DB

Executor services pick up jobs from DB and act on them

Executors will also write output and log data to DB which can be read via Web Service
Pros and Cons vs Cron jobs
Implementation Strategies
SSH between servers

One Web Service per Server
Create custom homepage to route to correct port

Create custom Executor classes
DEMO then questions!
All componenets involved
Runs as local processes

Fault tolerant, maintainable, and customizable

Security in web app

Extensible Executors
cmd line, java, ruby
1-1 relationship between web service and executors

Unlike Cron, requires a MySQL DB (but size of DB is small)
job file
Full transcript