Skip to main navigation Skip to search Skip to main content

LiPS: A cost-efficient data and task co-scheduler for mapreduce

  • Stony Brook University

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

4 Scopus citations

Abstract

We introduce LiPS, a new cost-efficient data and task co-scheduler for MapReduce in a cloud environment. LiPS allows flexible control of job make spans, multi-resource management, and fairness. By using linear programming to simultaneously co-schedule data and tasks, LiPS helps to achieve minimized dollar cost globally. We evaluated LiPS both analytically and on Amazon EC2 in order to measure actual dollar charges. The results were significant; LiPS saved 58-79% of the dollar costs when compared with the Hadoop default scheduler, while also allowing users to fine-tune the cost-performance tradeoff.

Original languageEnglish
Title of host publicationProceedings - IEEE 27th International Parallel and Distributed Processing Symposium Workshops and PhD Forum, IPDPSW 2013
PublisherIEEE Computer Society
Pages2230-2233
Number of pages4
ISBN (Print)9780769549798
DOIs
StatePublished - 2013
Event2013 IEEE 37th Annual Computer Software and Applications Conference, COMPSAC 2013 - Boston, MA, Japan
Duration: Jul 22 2013Jul 26 2013

Publication series

NameProceedings - IEEE 27th International Parallel and Distributed Processing Symposium Workshops and PhD Forum, IPDPSW 2013

Conference

Conference2013 IEEE 37th Annual Computer Software and Applications Conference, COMPSAC 2013
Country/TerritoryJapan
CityBoston, MA
Period07/22/1307/26/13

Keywords

  • Cloud Computing
  • Co-Scheduling

Fingerprint

Dive into the research topics of 'LiPS: A cost-efficient data and task co-scheduler for mapreduce'. Together they form a unique fingerprint.

Cite this