Skip to main navigation Skip to search Skip to main content

HPCFAIR: Enabling FAIR AI for HPC Applications

  • Gaurav Verma
  • , Murali Emani
  • , Chunhua Liao
  • , Pei Hung Lin
  • , Tristan Vanderbruggen
  • , Xipeng Shen
  • , Barbara Chapman
  • Stony Brook University
  • Argonne National Laboratory
  • Lawrence Livermore National Laboratory
  • North Carolina State University

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

9 Scopus citations

Abstract

Artificial Intelligence (AI) is being adopted in different domains at an unprecedented scale. A significant interest in the scientific community also involves leveraging machine learning (ML) to effectively run high performance computing applications at scale. Given multiple efforts in this arena, there are often duplicated efforts when existing rich data sets and ML models could be leveraged instead. The primary challenge is a lack of an ecosystem to reuse and reproduce the models and datasets. In this work, we propose HPCFAIR, a modular, extensible framework to enable AI models to be Findable, Accessible, Interoperable and Reproducible (FAIR). It enables users with a structured approach to search, load, save and reuse the models in their codes. We present the design, implementation of our framework and highlight how it can be seamlessly integrated to ML-driven applications for high performance computing applications and scientific machine learning workloads.

Original languageEnglish
Title of host publicationProceedings of MLHPC 2021
Subtitle of host publicationWorkshop on Machine Learning in High Performance Computing Environments, Held in conjunction with SC 2021: The International Conference for High Performance Computing, Networking, Storage and Analysis
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages58-68
Number of pages11
ISBN (Electronic)9781665411240
DOIs
StatePublished - 2021
Event7th IEEE/ACM Workshop on Machine Learning in High Performance Computing Environments, MLHPC 2021 - St. Louis, United States
Duration: Nov 15 2021 → …

Publication series

NameProceedings of MLHPC 2021: Workshop on Machine Learning in High Performance Computing Environments, Held in conjunction with SC 2021: The International Conference for High Performance Computing, Networking, Storage and Analysis

Conference

Conference7th IEEE/ACM Workshop on Machine Learning in High Performance Computing Environments, MLHPC 2021
Country/TerritoryUnited States
CitySt. Louis
Period11/15/21 → …

Keywords

  • AI models
  • datasets
  • FAIR
  • HPC
  • neural networks

Fingerprint

Dive into the research topics of 'HPCFAIR: Enabling FAIR AI for HPC Applications'. Together they form a unique fingerprint.

Cite this