Skip to main navigation Skip to search Skip to main content

SparkGIS: Efficient comparison and evaluation of algorithm results in tissue image analysis studies

  • Stony Brook University

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

18 Scopus citations

Abstract

Algorithm evaluation provides a means to characterize variability across image analysis algorithms, validate algorithms by comparison of multiple results, and facilitate algorithm sensitivity studies. The sizes of images and analysis results in pathology image analysis pose significant challenges in algorithm evaluation. We present SparkGIS, a distributed, in-memory spatial data processing framework to query, retrieve, and compare large volumes of analytical image result data for algorithm evaluation. Our approach combines the in-memory distributed processing capabilities of Apache Spark and the efficient spatial query processing of Hadoop-GIS. The experimental evaluation of SparkGIS for heatmap computations used to compare nucleus segmentation results from multiple images and analysis runs shows that SparkGIS is efficient and scalable, enabling algorithm evaluation and algorithm sensitivity studies on large datasets.

Original languageEnglish
Title of host publicationBiomedical Data Management and Graph Online Querying - VLDB 2015 Workshops, Big-O(Q) and DMAH, Revised Selected Papers
EditorsArijit Khan, Gang Luo, Chunhua Weng, Fusheng Wang, Prasenjit Mitra, Cong Yu
PublisherSpringer Verlag
Pages134-146
Number of pages13
ISBN (Print)9783319415758
DOIs
StatePublished - 2016
Event1st International Workshop on Data Management and Analytics for Medicine and Healthcare, DMAH 2015 and Workshop on Big-Graphs Online Querying, Big-O(Q) 2015 held in conjunction with 41st International Conference on Very Large Data Bases, VLDB 2015 - Waikoloa, United States
Duration: Aug 31 2015Sep 4 2015

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume9579
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference1st International Workshop on Data Management and Analytics for Medicine and Healthcare, DMAH 2015 and Workshop on Big-Graphs Online Querying, Big-O(Q) 2015 held in conjunction with 41st International Conference on Very Large Data Bases, VLDB 2015
Country/TerritoryUnited States
CityWaikoloa
Period08/31/1509/4/15

Fingerprint

Dive into the research topics of 'SparkGIS: Efficient comparison and evaluation of algorithm results in tissue image analysis studies'. Together they form a unique fingerprint.

Cite this