Swarm
From Ogce
Contents |
Overview
Swarm is a high-level job scheduling Web service framework. Swarm is developed for scientific applications that must submit massive number of high-throughput jobs or workflows to highly distributed computing clusters. The Swarm service itself is designed to be extensible, lightweight, and easily installable on a desktop or small server. As a Web service, derivative services based on Swarm can be straightforwardly integrated with Web portals and science gateways.
Status
Swarm is currently in active development and should be considered an incubator project. If you are interested in using it, please contact us.
How to Access Swarm
Swarm provides standard WebService interface. Java RPC client and PHP Web Service client have been tested.
Getting Swarm Code
Swarm may be checked out using any SVN client. The command line is
svn checkout https://ogce.svn.sourceforge.net/svnroot/ogce/ogce-services-incubator/swarm
Building Swarm
Swarm is compiled with Apache Ant. Simply type
ant clean ant
Deploying
The ant build creates an Axis2 compatible .aar file, JobSub.aar. Copy this into an Axis 2 container, such as the one provided by OGCE-Axis-Services. In detail, assuming you install everything in $HOME,
- cd $HOME/swarm/
- ant clean; ant
- cd $HOME/ogce-axis-serivces
- mvn clean install
- cd $HOME/ogce-axis-services/portal_deploy/apache-tomcat-5.5.27/webapps/axis2/WEB-INF/services
- cp $HOME/swarm/bin/JobSub.aar .
- cd $HOME/ogce-axis-services
- ./shutdown-tomcat.sh
- ./startup-tomcat.sh
Your service will now be available from http://your.host.server:9090/axis2/services/Swarm?
More Information
Swarm is more extensively documented here: http://ogce.svn.sourceforge.net/viewvc/ogce/ogce-services-incubator/swarm/docs/swarm-userguide.pdf This documented is included in the download.
See also "Sangmi Lee Pallickara and Marlon Pierce SWARM: Scheduling Large-scale Jobs over the Loosely-Coupled HPC Clusters Proceedings of the IEEE International Conference on e-Science. Indianapolis. 2008. December 7-12 2008". Paper is available from http://grids.ucs.indiana.edu/ptliupages/publications/Pallickara-SWARMjobsubmission.pdf.
