Loading…
August 19-21 - Co-Located Events
August 21-23 - Conference
Hilton San Diego Bayfront - San Diego, CA
More information for Open Source Summit + Embedded Linux Conference North America 2019
Friday, August 23 • 2:25pm - 3:00pm
Chameleon: Expanding Open-Source Ambari for HPC - Jieun Choi, Korea Institute of Science and Technology Information*

Sign up or log in to save this to your schedule and see who's attending!

Feedback form is now closed.
High performance computing (HPC) community is increasingly demanding big data processing beyond traditional simulation-based computation. Hadoop ecosystem has a roadmap that includes HPC support including GPU, FPGA. With HPC and Big-data converging into one huge ecosystem, we launched the Chameleon project to develop a HPC based big-data platform operation management system.
Chameleon was developed based on Apache Ambari, which is well-known Hadoop management system and extended to support Lustre filesystem management, which is widely used in HPC community for massive storage and HPC resource monitoring including GPU and Infiniband. Chameleon also added advanced YARN app monitoring functionalities based on Linux performance tools so that rich linux performance tools from Linux ecosystem can be dynamically used for YARN app monitoring. Finally, Chameleon has dynamic dashboard for Hadoop and HPC which streamlines HPC based Big-data platform operation and management.

Speakers
JC

Jieun Choi

Researcher, Korea Institute of Science and Technology Information
Jieun Choi is a researcher in National Institute of Supercomputing and Networking (NISN) at KISTI (Korea Institute of Science and Technology Information). She received her B.S. and M.S. degree from Sookmyung Women's University in 2014 and 2016, respectively. Her research interests... Read More →



Friday August 23, 2019 2:25pm - 3:00pm
Sapphire P
  • Session Slides Included Yes
  • Session Recorded Yes