TY - GEN
T1 - Applying database support for large scale data driven science in distributed environments
AU - Narayanan, Sivaramakrishnan
AU - Catalyurek, U.
AU - Kurc, T.
AU - Zhang, X.
AU - Saltz, J.
N1 - Publisher Copyright:
© 2003 IEEE.
PY - 2003
Y1 - 2003
N2 - There is a rapidly growing set of applications, referred to as data driven applications, in which analysis of large amounts of data drives the next steps taken by the scientist, e.g., running new simulations, doing additional measurements, extending the analysis to larger data collections. Critical steps in data analysis are to extract the data of interest from large and potentially distributed datasets and to move it from storage clusters to compute clusters for processing. We have developed a middleware framework, called GridDB-Lite, that is designed to efficiently support these two steps. We describe the application of GridDB-Lite in large scale oil reservoir simulation studies and experimentally evaluate several optimizations that can be employed in the GridDB-Lite runtime system.
AB - There is a rapidly growing set of applications, referred to as data driven applications, in which analysis of large amounts of data drives the next steps taken by the scientist, e.g., running new simulations, doing additional measurements, extending the analysis to larger data collections. Critical steps in data analysis are to extract the data of interest from large and potentially distributed datasets and to move it from storage clusters to compute clusters for processing. We have developed a middleware framework, called GridDB-Lite, that is designed to efficiently support these two steps. We describe the application of GridDB-Lite in large scale oil reservoir simulation studies and experimentally evaluate several optimizations that can be employed in the GridDB-Lite runtime system.
KW - Analytical models
KW - Computational modeling
KW - Data analysis
KW - Data mining
KW - Distributed computing
KW - Distributed databases
KW - Hydrocarbon reservoirs
KW - Large-scale systems
KW - Middleware
KW - Petroleum
UR - https://www.scopus.com/pages/publications/84944453810
U2 - 10.1109/GRID.2003.1261709
DO - 10.1109/GRID.2003.1261709
M3 - Conference contribution
AN - SCOPUS:84944453810
T3 - Proceedings - IEEE/ACM International Workshop on Grid Computing
SP - 141
EP - 148
BT - Proceedings - 4th International Workshop on Grid Computing, GRID 2003
PB - IEEE Computer Society
T2 - 4th International Workshop on Grid Computing, GRID 2003
Y2 - 17 November 2003
ER -