Cloud resource provisioning for combined stream and batch workflows

Research output: Chapter in Book / Conference PaperConference Paperpeer-review

3 Citations (Scopus)

Abstract

![CDATA[The increasing adoption of Internet of Thing (IoT) technology in many application domains generates a new need for rationalized utilization of computing resources supporting such computations. IoT applications can be represented as workflows in which stream and batch applications are integrated to accomplish data analytics objectives in many application domains such as smart home, health care, bioinformatics, astronomy, education, etc. The main challenge of this combination is the differentiation of service quality constraints between the two computation paradigms. Stream processing is highly sensitive to real-time constraint while batch processes are usually resource-intensive. In this work we propose a resource provisioning framework for combined workflows which aims to find an optimal workflow configuration plan to minimize execution time and monetary cost. The framework has functions of execution plan generation, task clustering, and resource provisioning. Results show that framework is capable to control the execution of combined-workflows by efficient tunning several parameters including stream arrival rate and processing throughput.]]
Original languageEnglish
Title of host publicationProceedings of the 37th IEEE International Performance Computing and Communications Conference (IPCCC 2018), 17-19 November 2018, Orlando, Florida
PublisherIEEE
Number of pages8
ISBN (Print)9781538668085
DOIs
Publication statusPublished - 2018
EventIEEE International Performance Computing and Communications Conference -
Duration: 17 Nov 2018 → …

Conference

ConferenceIEEE International Performance Computing and Communications Conference
Period17/11/18 → …

Keywords

  • Internet of things
  • batch processing
  • cloud computing
  • real-time data processing
  • workflow

Fingerprint

Dive into the research topics of 'Cloud resource provisioning for combined stream and batch workflows'. Together they form a unique fingerprint.

Cite this