TY - GEN
T1 - Coflow Scheduling with Unknown Prior Information in Data Center Networks
AU - Wei, Zhe
AU - Guo, Songtao
AU - Liu, Guiyan
AU - Yang, Yuanyuan
N1 - Publisher Copyright:
© 2021 IEEE.
PY - 2021/6
Y1 - 2021/6
N2 - In order to solve the problem of flow scheduling in cluster computing framework, the scheduling strategy based on coflow has become a research hot spot. A coflow is a collection of data flows between two different stages of the same parallel computing task. Coflow scheduling in the case of unknown prior information depends on the data flow information of the sent part to infer the data size of coflow and allocate the scheduling sequence for coflow, which is easy to cause congestion. In this paper, we design an effective coflow scheduling mechanism namely, Classification According to Ports Number (CAPN). In the mechanism, firstly, coflows are quickly classified according to the Few Ports Number Scheduling First (FPSF) algorithm, and then coflows with different priorities are scheduled and adjusted, which greatly reduce the average coflow completion time (CCT). Simulation results show that compared with the classical Aalo and MCS mechanisms, our CAPN mechanism can reduce the completion time of coflow by by 31.32% and 25.72%, respectively.
AB - In order to solve the problem of flow scheduling in cluster computing framework, the scheduling strategy based on coflow has become a research hot spot. A coflow is a collection of data flows between two different stages of the same parallel computing task. Coflow scheduling in the case of unknown prior information depends on the data flow information of the sent part to infer the data size of coflow and allocate the scheduling sequence for coflow, which is easy to cause congestion. In this paper, we design an effective coflow scheduling mechanism namely, Classification According to Ports Number (CAPN). In the mechanism, firstly, coflows are quickly classified according to the Few Ports Number Scheduling First (FPSF) algorithm, and then coflows with different priorities are scheduled and adjusted, which greatly reduce the average coflow completion time (CCT). Simulation results show that compared with the classical Aalo and MCS mechanisms, our CAPN mechanism can reduce the completion time of coflow by by 31.32% and 25.72%, respectively.
KW - Average Completion Time
KW - Coflow Priority
KW - Coflow scheduling
KW - Data Center Networks
KW - Unknown Prior Information
UR - https://www.scopus.com/pages/publications/85115719818
U2 - 10.1109/ICC42927.2021.9500870
DO - 10.1109/ICC42927.2021.9500870
M3 - Conference contribution
AN - SCOPUS:85115719818
T3 - IEEE International Conference on Communications
BT - ICC 2021 - IEEE International Conference on Communications, Proceedings
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 2021 IEEE International Conference on Communications, ICC 2021
Y2 - 14 June 2021 through 23 June 2021
ER -