Heterogeneity-Aware Scheduler for Stream Processing Frameworks

Heterogeneity-Aware Scheduler for Stream Processing Frameworks

Software

Prototype of a scheduler for Apache Storm that exploits features of clusters with a heterogeneous hardware. When run the first time, the scheduler performs a few testing deployments of the topology executors (bolts) to check the HW type to executor type suitability (benchmarking). Later, the scheduler prepares a near optimal schedule based on the data gathered during the benchmarking phase.

Prototype of a scheduler for Apache Storm that exploits features of clusters with a heterogeneous hardware. When run the first time, the scheduler performs a few testing deployments of the topology executors (bolts) to check the HW type to executor type suitability (benchmarking). Later, the scheduler prepares a near optimal schedule based on the data gathered during the benchmarking phase.

scheduling; resource-awareness; benchmarking; heterogeneous clusters; stream processing; Apache Storm

scheduling; resource-awareness; benchmarking; heterogeneous clusters; stream processing; Apache Storm

https://github.com/radkovo/webstorm

In order to use the result by another entity, it is always necessary to acquire a license

https://github.com/radkovo/webstorm