Project

General

Profile

Feature #117

Projections traces with fewer files than 1-per-PE

Added by Phil Miller over 6 years ago. Updated almost 2 years ago.

Status:
New
Priority:
Normal
Assignee:
Category:
-
Target version:
-
Start date:
03/16/2013
Due date:
% Done:

0%


Description

On trans-petascale systems with 100k+ cores, a file per PE is enough to seriously overwhelm parallel filesystem metadata servers, even in separate directories. We need to make an adjustment to reduce that burden.

History

#1 Updated by Phil Miller over 5 years ago

  • Target version changed from 6.6.0 to 6.7.0

#2 Updated by Nikhil Jain over 3 years ago

  • Target version changed from 6.7.0 to 6.8.0

#3 Updated by Eric Bohm over 2 years ago

  • Assignee set to Ronak Buch

#4 Updated by Eric Bohm over 2 years ago

  • Target version changed from 6.8.0 to 6.9.0

#5 Updated by Ronak Buch over 2 years ago

This is a good point, and a change should definitely be made to plan ahead. I'll sketch out some possible designs as to what the future file formats can look like. Presumably things should be aggregated at the node level and files should be written at that granularity, too.

#6 Updated by Ronak Buch almost 2 years ago

  • Target version deleted (6.9.0)

Also available in: Atom PDF