Main Page

From MegajobBOF


Update: Presentations Available

Presentations are now available in the Presentations and Abstracts section.

Megajobs: How to Run One Million Jobs

  • What: Birds-of-a-Feather Session at Supercomputing 2008, Austin Texas
  • Date: Tuesday, November 18th, 2008
  • Time: 05:30PM - 07:00PM
  • Location: Room 13A/13B
  • BOF Organizers
    • Marlon Pierce (Indiana University)
    • Ioan Raicu (University of Chicago)
    • Ruth Pordes (Fermi National Laboratory)
    • John McGee (Renaissance Computing Institute)
    • Dick Repasky (Indiana University)

BOF Format

We will have 7 short (10 minute) presentations followed by a directed discussion phase. For a list of selected presentations, see Presenters and Abstracts. See Discussion Questions for a list of discussion topics.

Call for Participation

As large systems surpass 200K CPU cores and as applications increase in complexity, more scientists need to run thousands to millions of closely related jobs that are associated with individual projects. Scientists seek convenient means to specify and manage many jobs, arranging inputs, aggregating outputs, identifying successful and failed jobs and repairing failures. System administrators seek methods to process extraordinary numbers of jobs for multiple users without overwhelming queuing systems or disrupting fair-share usage policies. Under development are a new generation of queuing and scheduling systems and multi-level schedulers for use with existing queuing and scheduling systems, schedulers designed to handle millions of jobs. This Birds-of-feather session provides a venue for the exchange of information about processing large numbers of jobs. Short presentations of an invited sample of projects will be followed by discussion.

For the latest information hosted by SC08, see The Megajobs BOF handout can also be found here.

Related SC08 Activities

Related activities at SC08, that might be of interest to BOF attendees are: