Project

General

Profile

Feature #1573

Make HDF5 library available for AMPI

Added by Matthias Diener about 2 years ago. Updated about 2 years ago.

Status:
Merged
Priority:
Normal
Category:
AMPI
Target version:
Start date:
05/25/2017
Due date:
% Done:

0%


Description

Currently, the hdf5 library needs some changes to work correctly under AMPI:
  • exit vs. CkExit()
  • charmrun output
  • privatizing global variables
  • Changes to build system

We could fix these issues and integrate hdf5, similar to ROMIO.
hdf5 is licensed under a BSD-like license, so copyright should not be an issue.

History

#1 Updated by Matthias Diener about 2 years ago

  • Subject changed from Integrate HDF5 library in to AMPI to Integrate HDF5 library into AMPI

#2 Updated by Matthias Diener about 2 years ago

With some modest changes, hdf5 compiles successfully (serial+parallel version).
The following serial tests (make test in test/) fail:
  • dt_arith (does not terminate)
  • swmr (does not terminate)

#3 Updated by Sam White about 2 years ago

I would recompile AMPI with MSG_ORDER_DEBUG prints (top of ampi.C) enabled. That usually helps debug hangs.

#4 Updated by Matthias Diener about 2 years ago

Ok, I'll do that. Regarding the exit() vs. CkExit() calls, can't we just #define exit(foo) CkExit(foo) in ampi.h ?

#5 Updated by Sam White about 2 years ago

We can now. It used to be that CkExit could only be called once by something on PE 0, I believe. That was changed recently.

#6 Updated by Matthias Diener about 2 years ago

CkExit has no return code parameter - how do charm++ applications signal failure?

#7 Updated by Matthias Diener about 2 years ago

  • Description updated (diff)

#8 Updated by Matthias Diener about 2 years ago

  • Description updated (diff)

#9 Updated by Sam White about 2 years ago

  • Status changed from New to Implemented

#10 Updated by Sam White about 2 years ago

  • Status changed from Implemented to In Progress

Patch to merge hdf5 into the charm/ampi distribution was abandoned in favor of hosting a separate repo for our modified version of hdf5. We can potentially work with the hdf group to get the changes here merged upstream too: https://charm.cs.illinois.edu/gerrit/#/admin/projects/hdf5-ampi

#11 Updated by Matthias Diener about 2 years ago

  • Subject changed from Integrate HDF5 library into AMPI to Make HDF5 library available for AMPI

#12 Updated by Matthias Diener about 2 years ago

  • Description updated (diff)

#13 Updated by Matthias Diener about 2 years ago

  • Target version changed from 6.8.1 to 6.8.0
  • Status changed from In Progress to Implemented

The current version of hdf5-ampi is usable and passes the PlasCom2 tests, which exercises a substantial part of the API.
Some things to followup on:

  • Test if applications work with the shared library
  • SMP mode to check privatization
  • Virtualization
  • Migration
  • Some spurious crashes/segfaults at hdf5 library termination
  • Test other architectures than linux/netlrts

#14 Updated by Matthias Diener about 2 years ago

  • Status changed from Implemented to Merged

Also available in: Atom PDF