charm.git
10 years agoauto tune the SetLBPeriod based on how long is actually takes to run
Eric Bohm [Sat, 26 Feb 2011 00:41:55 +0000 (18:41 -0600)]
auto tune the SetLBPeriod based on how long is actually takes to run
the problem

10 years agoadd -module CommonLBs to the projections target lines.
Eric Bohm [Sat, 26 Feb 2011 00:01:11 +0000 (18:01 -0600)]
add -module CommonLBs to the projections target lines.

10 years agoNumaLB should not be there
Abhinav S Bhatele [Fri, 25 Feb 2011 19:46:37 +0000 (13:46 -0600)]
NumaLB should not be there

10 years agoMerge branch 'charm' of charmgit:charm into bhatele/ldbcputimer
Abhinav S Bhatele [Fri, 25 Feb 2011 19:40:28 +0000 (13:40 -0600)]
Merge branch 'charm' of charmgit:charm into bhatele/ldbcputimer

Conflicts:
src/ck-ldb/Make.lb
src/ck-ldb/Makefile_lb.sh

10 years agoadded two conv-mach macros CMK_MMAP_PROBE and CMK_MMAP_TEST to control the default...
Gengbin Zheng [Fri, 25 Feb 2011 18:59:42 +0000 (12:59 -0600)]
added two conv-mach macros CMK_MMAP_PROBE and CMK_MMAP_TEST to control the default setting.
another command line option +isomalloc_test to switch to testing method.

10 years agoadded two command line options:
Gengbin Zheng [Fri, 25 Feb 2011 18:47:00 +0000 (12:47 -0600)]
added two command line options:
+noisomalloc:  to disable isomalloc for apps that don't need it
+isomalloc_probe:  to use probe method of isomalloc initialization in finding the largest available region.

10 years agoCMK_TAG(Cpv_addr_,v) need to include one extra for comm. thread.
Gengbin Zheng [Fri, 25 Feb 2011 18:41:43 +0000 (12:41 -0600)]
CMK_TAG(Cpv_addr_,v) need to include one extra for comm. thread.

10 years agoMerge branch 'charm' of charmgit:charm into charm
Gengbin Zheng [Fri, 25 Feb 2011 15:45:02 +0000 (09:45 -0600)]
Merge branch 'charm' of charmgit:charm into charm

10 years agoremove the limitation of CMK_MAX_PTHREADS for TLS implementation of Cpv variables.
Gengbin Zheng [Fri, 25 Feb 2011 15:44:32 +0000 (09:44 -0600)]
remove the limitation of CMK_MAX_PTHREADS for TLS implementation of Cpv variables.

10 years agoa CcdTOPOLOGY_AVAIL ccd condition, which is raised when topology info is available...
Gengbin Zheng [Fri, 25 Feb 2011 06:32:30 +0000 (00:32 -0600)]
a CcdTOPOLOGY_AVAIL ccd condition, which is raised when topology info is available on each processor.
neighbor seed load balancer need to initialize itself after topology info is available (which is in charmInit)

10 years agoMerge branch 'charm' of charmgit:charm into charm
Gengbin Zheng [Fri, 25 Feb 2011 06:25:09 +0000 (00:25 -0600)]
Merge branch 'charm' of charmgit:charm into charm

10 years agofixed some minor bugs in LBTopo_torus_nd_smp class to make it actually works
Gengbin Zheng [Fri, 25 Feb 2011 06:23:23 +0000 (00:23 -0600)]
fixed some minor bugs in LBTopo_torus_nd_smp class to make it actually works

10 years agodoc: expand on the available load balancing options
Abhinav S Bhatele [Fri, 25 Feb 2011 03:08:19 +0000 (21:08 -0600)]
doc: expand on the available load balancing options

10 years agowhen skip topology, only rank 0 initialize the topo data structure
Gengbin Zheng [Fri, 25 Feb 2011 00:16:05 +0000 (18:16 -0600)]
when skip topology, only rank 0 initialize the topo data structure

10 years agoMakefile_lb.sh: Remove noise obviated by version control
Phil Miller [Thu, 24 Feb 2011 15:32:45 +0000 (09:32 -0600)]
Makefile_lb.sh: Remove noise obviated by version control

10 years agoMove TempAwareGreedyLB out of the common set
Phil Miller [Thu, 24 Feb 2011 15:31:34 +0000 (09:31 -0600)]
Move TempAwareGreedyLB out of the common set

10 years agoupdated
Gengbin Zheng [Thu, 24 Feb 2011 15:07:29 +0000 (09:07 -0600)]
updated

10 years agofixed the broken Make.depends
Gengbin Zheng [Thu, 24 Feb 2011 15:06:54 +0000 (09:06 -0600)]
fixed the broken Make.depends

10 years agoMake file change for Maj min
Osman Sarood [Thu, 24 Feb 2011 13:51:55 +0000 (07:51 -0600)]
Make file change for Maj min

10 years agoMaj min example
Osman Sarood [Thu, 24 Feb 2011 13:49:21 +0000 (07:49 -0600)]
Maj min example

10 years agoTempAwareLB added
Osman Sarood [Thu, 24 Feb 2011 13:42:41 +0000 (07:42 -0600)]
TempAwareLB added

10 years agoMerge branch 'charm' of charmgit:charm into charm
Gengbin Zheng [Thu, 24 Feb 2011 08:36:10 +0000 (02:36 -0600)]
Merge branch 'charm' of charmgit:charm into charm

10 years agosome minor optimization: reuse messages, remove calls to QD events.
Gengbin Zheng [Thu, 24 Feb 2011 08:35:21 +0000 (02:35 -0600)]
some minor optimization: reuse messages, remove calls to QD events.

10 years agoDistributed Completion Detection: Apps don't need to use QD
Phil Miller [Wed, 23 Feb 2011 22:51:32 +0000 (16:51 -0600)]
Distributed Completion Detection: Apps don't need to use QD

A mechanism to detect the completion of distributed processes, based
on a counts of event generators and events produced and consumed. From
an application's standpoint, this accomplishes the same thing as QD,
but on a more modular basis.

Ideally, this should be able to prioritize itself below the process
it's tracking. That's not implemented yet.

10 years agofixed compilation error for non-Linux platforms.
Gengbin Zheng [Thu, 24 Feb 2011 01:10:13 +0000 (19:10 -0600)]
fixed compilation error for non-Linux platforms.

10 years agoFix reductiontarget code generation for groups and nodegroups
Aaron Becker [Thu, 24 Feb 2011 00:43:51 +0000 (18:43 -0600)]
Fix reductiontarget code generation for groups and nodegroups

10 years agodoc: new image for ckgraph api
Abhinav S Bhatele [Wed, 23 Feb 2011 23:25:44 +0000 (17:25 -0600)]
doc: new image for ckgraph api

10 years agoMerge branch 'charm' of charmgit:charm into charm
Gengbin Zheng [Wed, 23 Feb 2011 22:23:07 +0000 (16:23 -0600)]
Merge branch 'charm' of charmgit:charm into charm

10 years agouse smp lock to protect the syscall and fopen in CmiInitCPUAffinityUtil() function.
Gengbin Zheng [Wed, 23 Feb 2011 22:22:37 +0000 (16:22 -0600)]
use smp lock to protect the syscall and fopen in CmiInitCPUAffinityUtil() function.

10 years agosubtle: added memory read and write fence to CpvInitialize to make sure that after...
Gengbin Zheng [Wed, 23 Feb 2011 22:21:16 +0000 (16:21 -0600)]
subtle: added memory read and write fence to CpvInitialize to make sure that after non-zero ranks exit from the while loop, it gets the cpv variables ready to use.

10 years agolb_test: add sizing information through sizer
Abhinav S Bhatele [Wed, 23 Feb 2011 21:04:38 +0000 (15:04 -0600)]
lb_test: add sizing information through sizer

10 years agoMerge branch 'charm' of charmgit:charm into charm
Gengbin Zheng [Wed, 23 Feb 2011 00:52:29 +0000 (18:52 -0600)]
Merge branch 'charm' of charmgit:charm into charm

10 years agofixed a bug in workstealing that when stealing is in progress, beginIdle should not...
Gengbin Zheng [Wed, 23 Feb 2011 00:51:37 +0000 (18:51 -0600)]
fixed a bug in workstealing that when stealing is in progress, beginIdle should not steal again.

10 years agoa fix for bluedrop multicore startup crash, where it seems that mmap unmap'ed some...
Gengbin Zheng [Wed, 23 Feb 2011 00:08:28 +0000 (18:08 -0600)]
a fix for bluedrop multicore startup crash, where it seems that mmap unmap'ed some lower region (2GB) of memory that makes it available for malloc, which then is trashed by something else.
Fixed so that isomalloc does not touch that lower region of memory.
This sems to only happen on bluedrop's compute node, not on the frontend node.

10 years agostencil3d: fix the calculation of time per step
Abhinav S Bhatele [Tue, 22 Feb 2011 23:31:33 +0000 (17:31 -0600)]
stencil3d: fix the calculation of time per step

10 years agock-ldb: make the ldb debug prints more readable and consistent
Abhinav S Bhatele [Tue, 22 Feb 2011 22:10:33 +0000 (16:10 -0600)]
ck-ldb: make the ldb debug prints more readable and consistent

10 years agochange back to GNU malloc since os malloc did crash megatest.
Gengbin Zheng [Tue, 22 Feb 2011 22:04:50 +0000 (16:04 -0600)]
change back to GNU malloc since os malloc did crash megatest.
will need to investigate it later.

10 years agoMerge branch 'charm' of charmgit:charm into charm
Gengbin Zheng [Tue, 22 Feb 2011 22:03:20 +0000 (16:03 -0600)]
Merge branch 'charm' of charmgit:charm into charm

10 years agonicer looking changes for previous commit
Gengbin Zheng [Tue, 22 Feb 2011 22:02:49 +0000 (16:02 -0600)]
nicer looking changes for previous commit

10 years agoMerge branch 'charm' of charmgit:charm into charm
Gengbin Zheng [Tue, 22 Feb 2011 21:56:41 +0000 (15:56 -0600)]
Merge branch 'charm' of charmgit:charm into charm

10 years agochangedto use generic64 Cth for SMP. it should work on lapi/aix when __thread is...
Gengbin Zheng [Tue, 22 Feb 2011 21:53:41 +0000 (15:53 -0600)]
changedto use generic64 Cth for SMP. it should work on lapi/aix when __thread is supported.

10 years agoMerge branch 'charm' of charmgit:charm into charm
Gengbin Zheng [Tue, 22 Feb 2011 21:52:45 +0000 (15:52 -0600)]
Merge branch 'charm' of charmgit:charm into charm

10 years agogeneric64 did not work with SMP due to using a global pointer mapping table.
Gengbin Zheng [Tue, 22 Feb 2011 21:51:27 +0000 (15:51 -0600)]
generic64 did not work with SMP due to using a global pointer mapping table.
updated this code by using __thread (when supported) to work with SMP.

10 years agodoc: update doc for adding a new load balancer
Abhinav S Bhatele [Tue, 22 Feb 2011 07:29:11 +0000 (01:29 -0600)]
doc: update doc for adding a new load balancer

10 years agock-ldb: add documentation
Abhinav S Bhatele [Tue, 22 Feb 2011 07:16:07 +0000 (01:16 -0600)]
ck-ldb: add documentation

10 years agock-ldb: turn off recording of min and max wall time for chares
Abhinav Bhatele [Tue, 22 Feb 2011 00:41:50 +0000 (19:41 -0500)]
ck-ldb: turn off recording of min and max wall time for chares

10 years agocputimer: turn off cpu timer calls by default
Abhinav Bhatele [Tue, 22 Feb 2011 00:14:39 +0000 (19:14 -0500)]
cputimer: turn off cpu timer calls by default

10 years agocputimer: WSLB will not be compiled by default
Abhinav Bhatele [Tue, 22 Feb 2011 00:13:26 +0000 (19:13 -0500)]
cputimer: WSLB will not be compiled by default

since WSLB depends on using both cpu and wall time

10 years agocputimer: use walltime when cputimer not available
Abhinav Bhatele [Tue, 22 Feb 2011 00:12:43 +0000 (19:12 -0500)]
cputimer: use walltime when cputimer not available

10 years agocputimer: CMK_LB_CPUTIMER ifdefs in NeigborLB code
Abhinav Bhatele [Tue, 22 Feb 2011 00:11:01 +0000 (19:11 -0500)]
cputimer: CMK_LB_CPUTIMER ifdefs in NeigborLB code

10 years agocputimer: change background load to be walltime
Abhinav Bhatele [Tue, 22 Feb 2011 00:09:55 +0000 (19:09 -0500)]
cputimer: change background load to be walltime

10 years agocputimer: this changes the way background time is calculated
Abhinav Bhatele [Tue, 22 Feb 2011 00:08:26 +0000 (19:08 -0500)]
cputimer: this changes the way background time is calculated

bg_walltime is no longer calculated using obj_cputime

10 years agocputimer: guard cputime variables with CMK_LB_CPUTIMER
Abhinav Bhatele [Tue, 22 Feb 2011 00:06:17 +0000 (19:06 -0500)]
cputimer: guard cputime variables with CMK_LB_CPUTIMER

10 years agoMerge branch 'metis' into charm
Phil Miller [Mon, 21 Feb 2011 02:42:58 +0000 (20:42 -0600)]
Merge branch 'metis' into charm

10 years agoMerge branch 'charm' of charmgit:charm into charm
Abhinav S Bhatele [Sun, 20 Feb 2011 09:12:56 +0000 (03:12 -0600)]
Merge branch 'charm' of charmgit:charm into charm

10 years agock-ldb: this should fix MetisLB and ScotchLB crashes
Abhinav S Bhatele [Sun, 20 Feb 2011 09:11:19 +0000 (03:11 -0600)]
ck-ldb: this should fix MetisLB and ScotchLB crashes

Metis and Scotch require a undirected graph it seems with no
duplicate edges.

10 years agoMerge branch 'charm' of charmgit:charm into charm
Yanhua Yanhua [Sun, 20 Feb 2011 07:31:32 +0000 (01:31 -0600)]
Merge branch 'charm' of charmgit:charm into charm

10 years agoCommenting one line of initialization makes program incorrect. Now this line is back
Yanhua Yanhua [Sun, 20 Feb 2011 07:29:51 +0000 (01:29 -0600)]
Commenting one line of initialization makes program incorrect. Now this line is back

10 years agoMerge branch 'charm' of charmgit:charm into charm
Gengbin Zheng [Sun, 20 Feb 2011 06:47:57 +0000 (00:47 -0600)]
Merge branch 'charm' of charmgit:charm into charm

10 years agomoved CmiInitCPUAffinityUtil to be after CmiTmpInit since it may need it.
Gengbin Zheng [Sun, 20 Feb 2011 06:47:13 +0000 (00:47 -0600)]
moved CmiInitCPUAffinityUtil to be after CmiTmpInit since it may need it.

10 years agolb_test: remove unnecessary lib paths
Abhinav S Bhatele [Sun, 20 Feb 2011 05:24:23 +0000 (23:24 -0600)]
lb_test: remove unnecessary lib paths

10 years agodoc: fix compilation errors
Abhinav S Bhatele [Sat, 19 Feb 2011 17:25:08 +0000 (11:25 -0600)]
doc: fix compilation errors

10 years agofix work stealing hanging problem on Jagua
Gengbin Zheng [Sat, 19 Feb 2011 01:52:20 +0000 (20:52 -0500)]
fix work stealing hanging problem on Jagua

10 years agoFixed a bug in setting the starting time of tracing MPI_Isend
Chao Mei [Fri, 18 Feb 2011 23:23:39 +0000 (17:23 -0600)]
Fixed a bug in setting the starting time of tracing MPI_Isend

10 years agoMerge branch 'charm' of charmgit:charm into charm
Chao Mei [Fri, 18 Feb 2011 22:56:01 +0000 (16:56 -0600)]
Merge branch 'charm' of charmgit:charm into charm

10 years agoAdded a macro to turn off user event when tracing MPI_Isend/MPI_Recv in order to...
Chao Mei [Fri, 18 Feb 2011 19:14:08 +0000 (13:14 -0600)]
Added a macro to turn off user event when tracing MPI_Isend/MPI_Recv in order to reduce the overhead of comm thread tracing.

10 years agofix a bug in workstealing for processor=2
Yanhua Yanhua [Fri, 18 Feb 2011 17:38:16 +0000 (11:38 -0600)]
fix a bug in workstealing for processor=2

10 years agoOnly use workstealing when processor number is more than 1
Yanhua Yanhua [Fri, 18 Feb 2011 17:23:29 +0000 (11:23 -0600)]
Only use workstealing when processor number is more than 1

10 years agosmp switch to os malloc.
Gengbin Zheng [Fri, 18 Feb 2011 06:19:49 +0000 (00:19 -0600)]
smp switch to os malloc.

10 years agoMerge branch 'charm' of charmgit:charm into charm
Gengbin Zheng [Fri, 18 Feb 2011 05:53:24 +0000 (23:53 -0600)]
Merge branch 'charm' of charmgit:charm into charm

10 years agoraise CcdUSER event to activate QD.
Gengbin Zheng [Fri, 18 Feb 2011 05:51:43 +0000 (23:51 -0600)]
raise CcdUSER event to activate QD.
disabled immediate message for now.
minor optimization in CldAckNoTaskHandler to reuse the incoming message.

10 years agoregister qd callback in a separate CcdUSER condition event, so that it can be called...
Gengbin Zheng [Fri, 18 Feb 2011 05:50:29 +0000 (23:50 -0600)]
register qd callback in a separate CcdUSER condition event, so that it can be called separately.

10 years agoAdded documentation for typed reductions
Aaron Becker [Fri, 18 Feb 2011 01:13:49 +0000 (19:13 -0600)]
Added documentation for typed reductions

10 years agoconfigure: Add support for external METIS library
Phil Miller [Thu, 17 Feb 2011 23:32:33 +0000 (17:32 -0600)]
configure: Add support for external METIS library

Let the user tell us at configure-time that METIS is available via
--with-metis. If they don't specify a directory, we assume the system
paths include it. If they specify a directory, look for libmetis.a in
exactly that directory, and find metis.h relative to it based on how
METIS 4 and 5 are laid out.

When METIS is available, then we build MetisLB and TeamLB as part of
the charm++ target.

10 years agoMake.lb: List LBs that need external libs for make depends, etc
Phil Miller [Thu, 17 Feb 2011 23:02:56 +0000 (17:02 -0600)]
Make.lb: List LBs that need external libs for make depends, etc

Don't compile MetisLB, ScotchLB, and TeamLB as part of EveryLB, but
still list their various pieces in the generated Makefile.

When running 'make depends', their source files will need to be edited
to leave out the external headers. This should be a much rarer
operation than people wanting to build with those, which is being made
much easier.

10 years agobuild: Make it easier to incorporate new Makefiles in the build process
Phil Miller [Thu, 17 Feb 2011 23:02:08 +0000 (17:02 -0600)]
build: Make it easier to incorporate new Makefiles in the build process

10 years agoMerge branch 'charm' of charmgit:charm into charm
Abhinav S Bhatele [Thu, 17 Feb 2011 22:45:46 +0000 (16:45 -0600)]
Merge branch 'charm' of charmgit:charm into charm

10 years agoWSLB: the target already exists as part of EveryLB
Abhinav S Bhatele [Thu, 17 Feb 2011 22:43:03 +0000 (16:43 -0600)]
WSLB: the target already exists as part of EveryLB

10 years agoInfrastructure for external package interaction
Phil Miller [Thu, 17 Feb 2011 21:39:21 +0000 (15:39 -0600)]
Infrastructure for external package interaction

10 years agoMakefile: Delete warning-generating spurious whitespace
Phil Miller [Thu, 17 Feb 2011 21:29:10 +0000 (15:29 -0600)]
Makefile: Delete warning-generating spurious whitespace

10 years agoFixed message tracing on comm thread (to trace those entry methods that need
Chao Mei [Thu, 17 Feb 2011 19:56:33 +0000 (13:56 -0600)]
Fixed message tracing on comm thread (to trace those entry methods that need
to be traced). And added trace for sending message on comm thread.

10 years agoPointing to the latest xlc compiler.
Sameer Kumar [Thu, 17 Feb 2011 00:21:12 +0000 (18:21 -0600)]
Pointing to the latest xlc compiler.

10 years agoAdd the -lmpl library.
Sameer Kumar [Wed, 16 Feb 2011 23:49:04 +0000 (17:49 -0600)]
Add the -lmpl library.

10 years agoBlue Gene/Q changes for charm++.
Sameer Kumar [Wed, 16 Feb 2011 22:33:28 +0000 (16:33 -0600)]
Blue Gene/Q changes for charm++.

10 years agoMS VC++: Define NOMINMAX at the compiler level, to avoid inclusion order issues
Phil Miller [Tue, 15 Feb 2011 17:09:24 +0000 (11:09 -0600)]
MS VC++: Define NOMINMAX at the compiler level, to avoid inclusion order issues

10 years agoDDT: Update old-style code and remove a VC++-ism
Phil Miller [Tue, 15 Feb 2011 16:31:56 +0000 (10:31 -0600)]
DDT: Update old-style code and remove a VC++-ism

10 years agock-ldb: LDBs which use METIS are using sendToList
Abhinav S Bhatele [Tue, 15 Feb 2011 03:01:06 +0000 (21:01 -0600)]
ck-ldb: LDBs which use METIS are using sendToList

at some point they should be changed to use both sendToList and
recvFromList

10 years agokNeighbor: finally behaving as expected of a load balancing benchmark
Abhinav S Bhatele [Tue, 15 Feb 2011 02:47:36 +0000 (20:47 -0600)]
kNeighbor: finally behaving as expected of a load balancing benchmark

10 years agoAMPI: Remove code that's been dead since 2000
Phil Miller [Tue, 15 Feb 2011 01:28:07 +0000 (19:28 -0600)]
AMPI: Remove code that's been dead since 2000

10 years agocray pmi: make the error more explicit
Abhinav Bhatele [Mon, 14 Feb 2011 22:15:24 +0000 (17:15 -0500)]
cray pmi: make the error more explicit

10 years agoset dependence of location mgr to ckmap group.
Gengbin Zheng [Mon, 14 Feb 2011 21:56:45 +0000 (15:56 -0600)]
set dependence of location mgr to ckmap group.

10 years agoadded a const to the group ID in setGroupDepID
Gengbin Zheng [Mon, 14 Feb 2011 21:53:37 +0000 (15:53 -0600)]
added a const to the group ID in setGroupDepID

10 years agoRemove long-dead code
Phil Miller [Mon, 14 Feb 2011 18:46:31 +0000 (12:46 -0600)]
Remove long-dead code

10 years agolapi-mpcc64: Compiler name and option selection for Linux and AIX support lapi-patch
Phil Miller [Mon, 14 Feb 2011 17:26:40 +0000 (11:26 -0600)]
lapi-mpcc64: Compiler name and option selection for Linux and AIX support

10 years agolapi-smp: Link the right pthread library for Linux or AIX
Phil Miller [Mon, 14 Feb 2011 16:55:30 +0000 (10:55 -0600)]
lapi-smp: Link the right pthread library for Linux or AIX

10 years agoRemove old CVS header
Phil Miller [Mon, 14 Feb 2011 15:32:45 +0000 (09:32 -0600)]
Remove old CVS header

10 years agoMS VC++: Disable spurious macro definitions of min/max
Phil Miller [Mon, 14 Feb 2011 15:30:43 +0000 (09:30 -0600)]
MS VC++: Disable spurious macro definitions of min/max

10 years agokNeighbor: remove more unused functions
Abhinav S Bhatele [Mon, 14 Feb 2011 03:23:50 +0000 (21:23 -0600)]
kNeighbor: remove more unused functions

10 years agokNeighbor: change the load pattern
Abhinav S Bhatele [Mon, 14 Feb 2011 02:46:05 +0000 (20:46 -0600)]
kNeighbor: change the load pattern

10 years agoMerge branch 'charm' of charmgit:charm into charm
Yanhua YanhuaSunLaptop [Sun, 13 Feb 2011 18:09:21 +0000 (12:09 -0600)]
Merge branch 'charm' of charmgit:charm into charm