TY - GEN
T1 - EASY
T2 - 38th IEEE International Conference on Distributed Computing Systems, ICDCS 2018
AU - Javadi, Seyyed Ahmad
AU - Gupta, Harsh
AU - Manhas, Robin
AU - Sahu, Shweta
AU - Gandhi, Anshul
N1 - Publisher Copyright:
© 2018 IEEE.
PY - 2018/7/19
Y1 - 2018/7/19
N2 - Customer facing online services, such as LinkedIn and Uber, rely on scalable and low-latency data stores to maintain acceptable query tail latencies. An important challenge for managing the performance of these systems is the assignment of newly created data segments to data nodes to balance load. Given the rate at which these services are accessed (thus generating new data), the segment assignment problem is particularly important. This paper presents EASY, an efficient segment assignment strategy that leverages analytical modeling to predict the future load induced by data segments, thus allowing for long-term balancing of load across data nodes. Our implementation and evaluation of EASY on Pinot shows that we can significantly reduce query tail latencies in the presence of dynamically generated data segments.
AB - Customer facing online services, such as LinkedIn and Uber, rely on scalable and low-latency data stores to maintain acceptable query tail latencies. An important challenge for managing the performance of these systems is the assignment of newly created data segments to data nodes to balance load. Given the rate at which these services are accessed (thus generating new data), the segment assignment problem is particularly important. This paper presents EASY, an efficient segment assignment strategy that leverages analytical modeling to predict the future load induced by data segments, thus allowing for long-term balancing of load across data nodes. Our implementation and evaluation of EASY on Pinot shows that we can significantly reduce query tail latencies in the presence of dynamically generated data segments.
KW - Pinot
KW - Segment assignment strategy
KW - Tail latency
UR - https://www.scopus.com/pages/publications/85050984174
U2 - 10.1109/ICDCS.2018.00144
DO - 10.1109/ICDCS.2018.00144
M3 - Conference contribution
AN - SCOPUS:85050984174
T3 - Proceedings - International Conference on Distributed Computing Systems
SP - 1432
EP - 1437
BT - Proceedings - 2018 IEEE 38th International Conference on Distributed Computing Systems, ICDCS 2018
PB - Institute of Electrical and Electronics Engineers Inc.
Y2 - 2 July 2018 through 5 July 2018
ER -