Extending the Open Community Runtime with External Application Support

Jiri Dokulil; Siegfried Benkner

doi:10.1145/3152041.3152088

Extending the Open Community Runtime with External Application Support

Jiri Dokulil
, Siegfried Benkner

Research Group Scientific Computing

Publications: Contribution to book › Contribution to proceedings › Peer Reviewed

Abstract

The Open Community Runtime specification prescribes the way a task-parallel application has to be written, in order to give the runtime system the ability to automatically migrate work and data, provide fault tolerance, improve portability, etc. These constraints prevent an application from efficiently starting a new process to run another external program. We have designed an extension of the specification which provides exactly this functionality in a way that fits the task-based model. The bulk of our work is devoted to exploring the way the task-parallel application can interact with an external application without having to resort to using files on a physical drive for data exchange. To eliminate the need to make changes to the external application, the data is exposed via a virtual file system using the filesystem-in-userspace architecture.

Original language	English
Title of host publication	Proceedings of ESPM2 2017
Subtitle of host publication	3rd International Workshop on Extreme Scale Programming Models and Middleware - Held in conjunction with SC 2017: The International Conference for High Performance Computing, Networking, Storage and Analysis
Place of Publication	New York
Publisher	ACM
Pages	1-7
Number of pages	7
ISBN (Print)	978-1-4503-5133-1
DOIs	https://doi.org/10.1145/3152041.3152088
Publication status	Published - Nov 2017

Austrian Fields of Science 2012

102025 Distributed systems

Keywords

Filesystem in Userspace (FUSE)
Open Community Runtime
inter-process communication
task parallelism
virtual file system
Task parallelism
Open community runtime
Virtual file system
Inter-process communication

Access to Document

10.1145/3152041.3152088

http://doi.acm.org/10.1145/3152041.3152088

Cite this

Dokulil, J., & Benkner, S. (2017). Extending the Open Community Runtime with External Application Support. In Proceedings of ESPM2 2017: 3rd International Workshop on Extreme Scale Programming Models and Middleware - Held in conjunction with SC 2017: The International Conference for High Performance Computing, Networking, Storage and Analysis (pp. 1-7). Article 7 ACM. https://doi.org/10.1145/3152041.3152088

Dokulil, Jiri ; Benkner, Siegfried. / Extending the Open Community Runtime with External Application Support. Proceedings of ESPM2 2017: 3rd International Workshop on Extreme Scale Programming Models and Middleware - Held in conjunction with SC 2017: The International Conference for High Performance Computing, Networking, Storage and Analysis. New York : ACM, 2017. pp. 1-7

@inproceedings{d2aa247affe047388e280889c51a55f8,

title = "Extending the Open Community Runtime with External Application Support",

abstract = "The Open Community Runtime specification prescribes the way a task-parallel application has to be written, in order to give the runtime system the ability to automatically migrate work and data, provide fault tolerance, improve portability, etc. These constraints prevent an application from efficiently starting a new process to run another external program. We have designed an extension of the specification which provides exactly this functionality in a way that fits the task-based model. The bulk of our work is devoted to exploring the way the task-parallel application can interact with an external application without having to resort to using files on a physical drive for data exchange. To eliminate the need to make changes to the external application, the data is exposed via a virtual file system using the filesystem-in-userspace architecture.",

keywords = "Filesystem in Userspace (FUSE), Open Community Runtime, inter-process communication, task parallelism, virtual file system, Task parallelism, Open community runtime, Virtual file system, Inter-process communication",

author = "Jiri Dokulil and Siegfried Benkner",

note = "Publisher Copyright: {\textcopyright} 2017 Copyright held by the owner/author(s).",

year = "2017",

month = nov,

doi = "10.1145/3152041.3152088",

language = "English",

isbn = "978-1-4503-5133-1",

pages = "1--7",

booktitle = "Proceedings of ESPM2 2017",

publisher = "ACM",

}

Dokulil, J & Benkner, S 2017, Extending the Open Community Runtime with External Application Support. in Proceedings of ESPM2 2017: 3rd International Workshop on Extreme Scale Programming Models and Middleware - Held in conjunction with SC 2017: The International Conference for High Performance Computing, Networking, Storage and Analysis., 7, ACM, New York, pp. 1-7. https://doi.org/10.1145/3152041.3152088

Extending the Open Community Runtime with External Application Support. / Dokulil, Jiri; Benkner, Siegfried.
Proceedings of ESPM2 2017: 3rd International Workshop on Extreme Scale Programming Models and Middleware - Held in conjunction with SC 2017: The International Conference for High Performance Computing, Networking, Storage and Analysis. New York: ACM, 2017. p. 1-7 7.

Publications: Contribution to book › Contribution to proceedings › Peer Reviewed

TY - GEN

T1 - Extending the Open Community Runtime with External Application Support

AU - Dokulil, Jiri

AU - Benkner, Siegfried

PY - 2017/11

Y1 - 2017/11

N2 - The Open Community Runtime specification prescribes the way a task-parallel application has to be written, in order to give the runtime system the ability to automatically migrate work and data, provide fault tolerance, improve portability, etc. These constraints prevent an application from efficiently starting a new process to run another external program. We have designed an extension of the specification which provides exactly this functionality in a way that fits the task-based model. The bulk of our work is devoted to exploring the way the task-parallel application can interact with an external application without having to resort to using files on a physical drive for data exchange. To eliminate the need to make changes to the external application, the data is exposed via a virtual file system using the filesystem-in-userspace architecture.

AB - The Open Community Runtime specification prescribes the way a task-parallel application has to be written, in order to give the runtime system the ability to automatically migrate work and data, provide fault tolerance, improve portability, etc. These constraints prevent an application from efficiently starting a new process to run another external program. We have designed an extension of the specification which provides exactly this functionality in a way that fits the task-based model. The bulk of our work is devoted to exploring the way the task-parallel application can interact with an external application without having to resort to using files on a physical drive for data exchange. To eliminate the need to make changes to the external application, the data is exposed via a virtual file system using the filesystem-in-userspace architecture.

KW - Filesystem in Userspace (FUSE)

KW - Open Community Runtime

KW - inter-process communication

KW - task parallelism

KW - virtual file system

KW - Task parallelism

KW - Open community runtime

KW - Virtual file system

KW - Inter-process communication

UR - https://www.scopus.com/pages/publications/85055145600

U2 - 10.1145/3152041.3152088

DO - 10.1145/3152041.3152088

M3 - Contribution to proceedings

SN - 978-1-4503-5133-1

SP - 1

EP - 7

BT - Proceedings of ESPM2 2017

PB - ACM

CY - New York

ER -

Dokulil J, Benkner S. Extending the Open Community Runtime with External Application Support. In Proceedings of ESPM2 2017: 3rd International Workshop on Extreme Scale Programming Models and Middleware - Held in conjunction with SC 2017: The International Conference for High Performance Computing, Networking, Storage and Analysis. New York: ACM. 2017. p. 1-7. 7 doi: 10.1145/3152041.3152088

Extending the Open Community Runtime with External Application Support

Abstract

Austrian Fields of Science 2012

Keywords

Access to Document

Other files and links

Fingerprint