Pilot-Streaming: Design Considerations for a Stream Processing Framework for High-Performance Computing
Andre Luckow; Peter Kasson; Shantenu Jha;
- Subject: HPC, Streaming Data, Resource Management, Middleware
This White Paper (submitted to STREAM 2016) identifies an approach to integrate streaming data with HPC resources. The paper outlines the design of Pilot-Streaming, which extends the concept of Pilot-abstraction to streaming real-time data.