TY - GEN
T1 - ENSURE
T2 - 1st IEEE International Conference on Autonomic Computing and Self-Organizing Systems, ACSOS 2020
AU - Suresh, Amoghavarsha
AU - Somashekar, Gagan
AU - Varadarajan, Anandh
AU - Kakarla, Veerendra Ramesh
AU - Upadhyay, Hima
AU - Gandhi, Anshul
N1 - Publisher Copyright:
© 2020 IEEE.
PY - 2020/8
Y1 - 2020/8
N2 - An imminent challenge in the serverless computing landscape is the escalating cost of infrastructure needed to handle the growing traffic at scale. This work presents ENSURE, a function-level scheduler and autonomous resource manager designed to minimize provider resource costs while meeting customer performance requirements. ENSURE works by classifying incoming function requests at runtime and carefully regulating the resource usage of colocated functions on each invoker. Beyond a single invoker, ENSURE elastically scales capacity, using concepts from operations research, in response to varying workload traffic to prevent cold starts. Finally, ENSURE schedules requests by concentrating load on an adequate number of invokers to encourage reuse of active hosts (thus further avoiding cold starts) and allow unneeded capacity to provably and gracefully time out. We implement ENSURE on Apache OpenWhisk and show that, across several serverless applications and compared to existing baselines, ENSURE significantly improves resource efficiency, by as much as 52%, while providing acceptable application latency.
AB - An imminent challenge in the serverless computing landscape is the escalating cost of infrastructure needed to handle the growing traffic at scale. This work presents ENSURE, a function-level scheduler and autonomous resource manager designed to minimize provider resource costs while meeting customer performance requirements. ENSURE works by classifying incoming function requests at runtime and carefully regulating the resource usage of colocated functions on each invoker. Beyond a single invoker, ENSURE elastically scales capacity, using concepts from operations research, in response to varying workload traffic to prevent cold starts. Finally, ENSURE schedules requests by concentrating load on an adequate number of invokers to encourage reuse of active hosts (thus further avoiding cold starts) and allow unneeded capacity to provably and gracefully time out. We implement ENSURE on Apache OpenWhisk and show that, across several serverless applications and compared to existing baselines, ENSURE significantly improves resource efficiency, by as much as 52%, while providing acceptable application latency.
UR - https://www.scopus.com/pages/publications/85092746691
U2 - 10.1109/ACSOS49614.2020.00020
DO - 10.1109/ACSOS49614.2020.00020
M3 - Conference contribution
AN - SCOPUS:85092746691
T3 - Proceedings - 2020 IEEE International Conference on Autonomic Computing and Self-Organizing Systems, ACSOS 2020
SP - 1
EP - 10
BT - Proceedings - 2020 IEEE International Conference on Autonomic Computing and Self-Organizing Systems, ACSOS 2020
A2 - El-Araby, Esam
A2 - Tomforde, Sven
A2 - Wood, Timothy
A2 - Kumar, Pradeep
A2 - Raibulet, Claudia
A2 - Petri, Ioan
A2 - Valentini, Gabriele
A2 - Nelson, Phyllis
A2 - Porter, Barry
PB - Institute of Electrical and Electronics Engineers Inc.
Y2 - 17 August 2020 through 21 August 2020
ER -