Project

General

Profile

Feature #275

Performance testing and tuning of CkIO

Added by Phil Miller almost 6 years ago. Updated almost 2 years ago.

Status:
In Progress
Priority:
Normal
Assignee:
Category:
-
Target version:
-
Start date:
08/22/2013
Due date:
% Done:

0%


Description

Explore things like the following, with subtasks opened for each as they start:
  • getting preferred block sizes from FS-specific (e.g. Lustre, GPFS) metadata
  • node mapping for proximity to IO nodes to get data out of the interconnect
  • O_DIRECT on Lustre to avoid locking
  • performance of many small writes (potential for optimization using TRAM)

History

#1 Updated by Phil Miller almost 6 years ago

  • Assignee changed from Phil Miller to Ronak Buch

#2 Updated by Phil Miller almost 6 years ago

  • Description updated (diff)

#3 Updated by Phil Miller almost 6 years ago

  • Description updated (diff)

#4 Updated by Ronak Buch almost 6 years ago

  • Target version changed from 6.6.0 to 6.7.0

#5 Updated by Eric Bohm over 5 years ago

Comparison (and/or usage of) the GLEAN framework should also be considered (http://www.mcs.anl.gov/project/glean-situ-visualization-and-analysis). It has been used to get close to peak performance out of pnetcdf and HDF5 on BlueGene architectures, which is pretty impressive given how unremarkable HDF5 and PnetCDF are otherwise.

#6 Updated by Sam White over 4 years ago

  • Assignee changed from Ronak Buch to Sam White

#7 Updated by Sam White almost 4 years ago

  • Target version changed from 6.7.0 to 6.8.0

#8 Updated by Sam White over 2 years ago

  • Target version changed from 6.8.0 to 6.8.1
  • Assignee changed from Sam White to Ronak Buch

#9 Updated by Ronak Buch over 2 years ago

  • Status changed from New to In Progress

#10 Updated by Eric Bohm almost 2 years ago

  • Target version changed from 6.8.1 to 6.9.0

#11 Updated by Ronak Buch almost 2 years ago

  • Target version deleted (6.9.0)

Also available in: Atom PDF