publication . Conference object . Article . 2013

Design and Implementation of GXP Make -- A Workflow System Based on Make

Taura, Kenjiro; Matsuzaki, Takuya; Miwa, Makoto; Kamoshida, Yoshikazu; Yokoyama, Daisaku; Dun, Nan; Shibata, Takeshi; Jun, Choi Sung; Tsujii, Jun'ichi;
Open Access
  • Published: 01 Feb 2013
  • Publisher: IEEE
Abstract
This paper describes a rationale behind designing workflow systems based on the Unix make by showing a number of idioms useful for workflows comprising many tasks. It also demonstrates a specific design and implementation of such a workflow system called GXP make. GXP make supports all the features of GNU make and extends its platforms from single node systems to clusters, clouds, supercomputers, and distributed systems. Interestingly, it is achieved by a very small code base that does not modify GNU make implementation at all. While not being ideal for performance, it achieved a useful performance and scalability of dispatching one million tasks in approximatel...
Subjects
free text keywords: Computer science, User interface, Scalability, Unix, Operating system, computer.software_genre, computer, Grid computing, Workflow, Scientific workflow system, Distributed computing, Supercomputer, Graphical user interface, business.industry, business, Computer Networks and Communications, Hardware and Architecture, Software, Throughput, Makefile, Multi-core processor, Real-time computing, Dependence analysis
Related Organizations
Powered by OpenAIRE Open Research Graph
Any information missing or wrong?Report an Issue
publication . Conference object . Article . 2013

Design and Implementation of GXP Make -- A Workflow System Based on Make

Taura, Kenjiro; Matsuzaki, Takuya; Miwa, Makoto; Kamoshida, Yoshikazu; Yokoyama, Daisaku; Dun, Nan; Shibata, Takeshi; Jun, Choi Sung; Tsujii, Jun'ichi;