charm.git
10 years agofixed a typo in getting processor count.
Gengbin Zheng [Tue, 1 Mar 2011 06:16:07 +0000 (00:16 -0600)]
fixed a typo in getting processor count.

10 years agowhen STATS is off, only PE 0 complains if user tries to use +cs.
Gengbin Zheng [Tue, 1 Mar 2011 06:01:37 +0000 (00:01 -0600)]
when STATS is off, only PE 0 complains if user tries to use +cs.

10 years agoget rid of return statements so that it gets to CcdRaiseCondition(CcdTOPOLOGY_AVAIL...
Gengbin Zheng [Tue, 1 Mar 2011 04:51:08 +0000 (22:51 -0600)]
get rid of return statements so that it gets to CcdRaiseCondition(CcdTOPOLOGY_AVAIL) properly.

10 years agopropagate LBRealType for load balancing timer type
Gengbin Zheng [Tue, 1 Mar 2011 04:03:18 +0000 (22:03 -0600)]
propagate LBRealType for load balancing timer type

10 years ago--with-lbtime-type=[float|double} to specify the type of the load balancing timing
Gengbin Zheng [Tue, 1 Mar 2011 03:59:30 +0000 (21:59 -0600)]
--with-lbtime-type=[float|double} to specify the type of the load balancing timing

10 years agoMerge branch 'charm' of charmgit:charm into charm
Gengbin Zheng [Tue, 1 Mar 2011 03:57:53 +0000 (21:57 -0600)]
Merge branch 'charm' of charmgit:charm into charm

10 years agolink conv-mach-opt.sh to include
Gengbin Zheng [Tue, 1 Mar 2011 03:57:16 +0000 (21:57 -0600)]
link conv-mach-opt.sh to include

10 years agoExpose the variable-size envelop refnum field in the API
Phil Miller [Tue, 1 Mar 2011 02:09:15 +0000 (20:09 -0600)]
Expose the variable-size envelop refnum field in the API

10 years agoSelect the size of the envelop refnum field at configure time
Phil Miller [Mon, 28 Feb 2011 23:45:21 +0000 (17:45 -0600)]
Select the size of the envelop refnum field at configure time

10 years agock-graph: fix a problem with translating decisions
Abhinav S Bhatele [Mon, 28 Feb 2011 22:42:13 +0000 (16:42 -0600)]
ck-graph: fix a problem with translating decisions

this code was assuming that strategy code will not reorder the vertex vector

10 years agochanged CMK_OPTIMIZE to CMK_ERROR_CHECKING
Gengbin Zheng [Mon, 28 Feb 2011 22:01:49 +0000 (16:01 -0600)]
changed CMK_OPTIMIZE to CMK_ERROR_CHECKING

10 years agominor change so the build make changes from scratch (some files are hence removed)
Gengbin Zheng [Mon, 28 Feb 2011 19:04:34 +0000 (13:04 -0600)]
minor change so the build make changes from scratch (some files are hence removed)

10 years agonot working when running build on existing build
Gengbin Zheng [Mon, 28 Feb 2011 19:02:14 +0000 (13:02 -0600)]
not working when running build on existing build
Revert "build: Make it easier to incorporate new Makefiles in the build process"

This reverts commit 60019ce028512cc2bd7b0a5a583e7fb3b5642545.

10 years agouse CMK_WITH_STATS to enable stats collection.
Gengbin Zheng [Mon, 28 Feb 2011 18:35:01 +0000 (12:35 -0600)]
use CMK_WITH_STATS to enable stats collection.

10 years agoadded build time option --enable/disable-stats to enable/disable stats collection.
Gengbin Zheng [Mon, 28 Feb 2011 18:32:19 +0000 (12:32 -0600)]
added build time option --enable/disable-stats to enable/disable stats collection.

10 years agoRevert "register qd callback in a separate CcdUSER condition event, so that it can...
Gengbin Zheng [Mon, 28 Feb 2011 06:00:05 +0000 (00:00 -0600)]
Revert "register qd callback in a separate CcdUSER condition event, so that it can be called separately."

This reverts commit 47150110dc2cbfd7dff3b8cb8e7c7e19b3cfc7dc.

10 years agochange the formular in finding the next victim (get rid of notaskpe)
Gengbin Zheng [Mon, 28 Feb 2011 05:57:08 +0000 (23:57 -0600)]
change the formular in finding the next victim (get rid of notaskpe)

10 years agoRevert "Make workstealing more proactive. Still before being idle"
Gengbin Zheng [Mon, 28 Feb 2011 04:02:10 +0000 (22:02 -0600)]
Revert "Make workstealing more proactive. Still before being idle"

This reverts commit d3e0b7dcf9dc5670ec3c3bb85c695b26d1d9ab46.

10 years agoFixed inline bug on blue print
Yanhua Sun [Sun, 27 Feb 2011 23:52:42 +0000 (17:52 -0600)]
Fixed inline bug on blue print

10 years agoadd workstealing proactive option to make stealing more proactive
Yanhua Yanhua [Sun, 27 Feb 2011 23:33:53 +0000 (17:33 -0600)]
add workstealing proactive option to make stealing more proactive

10 years agoMake workstealing more proactive. Still before being idle
Yanhua Yanhua [Sun, 27 Feb 2011 23:24:53 +0000 (17:24 -0600)]
Make workstealing more proactive. Still before being idle

10 years agofixed compiler warnings for icc
Gengbin Zheng [Sun, 27 Feb 2011 07:24:11 +0000 (01:24 -0600)]
fixed compiler warnings for icc

10 years agouse _setjmp when it is supported.
Gengbin Zheng [Sat, 26 Feb 2011 23:43:11 +0000 (17:43 -0600)]
use _setjmp when it is supported.

10 years agotest if _setjmp/_longjmp exist
Gengbin Zheng [Sat, 26 Feb 2011 23:39:28 +0000 (17:39 -0600)]
test if _setjmp/_longjmp exist

10 years agoremove the line: #define CMK_64BIT 0
Gengbin Zheng [Sat, 26 Feb 2011 22:34:35 +0000 (16:34 -0600)]
remove the line: #define CMK_64BIT    0

10 years agofixed the case of using cputimer when not using reduction tree.
Gengbin Zheng [Sat, 26 Feb 2011 16:44:22 +0000 (10:44 -0600)]
fixed the case of using cputimer when not using reduction tree.

10 years agoisomalloc region tmp file can not be under /tmp, because it needs to be on a shared...
Gengbin Zheng [Sat, 26 Feb 2011 03:31:48 +0000 (21:31 -0600)]
isomalloc region tmp file can not be under /tmp, because it needs to be on a shared fiel system for every pe to read.

10 years agoMerge branch 'charm' of charmgit:charm into charm
Gengbin Zheng [Sat, 26 Feb 2011 02:18:11 +0000 (20:18 -0600)]
Merge branch 'charm' of charmgit:charm into charm

10 years agofixed some compilation error on windows.
Gengbin Zheng [Sat, 26 Feb 2011 02:17:40 +0000 (20:17 -0600)]
fixed some compilation error on windows.

10 years agoadd text noting the relevance of LBPeriod to AtSync
Eric Bohm [Sat, 26 Feb 2011 01:20:09 +0000 (19:20 -0600)]
add text noting the relevance of LBPeriod to AtSync

10 years agoauto tune the SetLBPeriod based on how long is actually takes to run
Eric Bohm [Sat, 26 Feb 2011 00:41:55 +0000 (18:41 -0600)]
auto tune the SetLBPeriod based on how long is actually takes to run
the problem

10 years agoadd -module CommonLBs to the projections target lines.
Eric Bohm [Sat, 26 Feb 2011 00:01:11 +0000 (18:01 -0600)]
add -module CommonLBs to the projections target lines.

10 years agoNumaLB should not be there
Abhinav S Bhatele [Fri, 25 Feb 2011 19:46:37 +0000 (13:46 -0600)]
NumaLB should not be there

10 years agoMerge branch 'charm' of charmgit:charm into bhatele/ldbcputimer
Abhinav S Bhatele [Fri, 25 Feb 2011 19:40:28 +0000 (13:40 -0600)]
Merge branch 'charm' of charmgit:charm into bhatele/ldbcputimer

Conflicts:
src/ck-ldb/Make.lb
src/ck-ldb/Makefile_lb.sh

10 years agoadded two conv-mach macros CMK_MMAP_PROBE and CMK_MMAP_TEST to control the default...
Gengbin Zheng [Fri, 25 Feb 2011 18:59:42 +0000 (12:59 -0600)]
added two conv-mach macros CMK_MMAP_PROBE and CMK_MMAP_TEST to control the default setting.
another command line option +isomalloc_test to switch to testing method.

10 years agoadded two command line options:
Gengbin Zheng [Fri, 25 Feb 2011 18:47:00 +0000 (12:47 -0600)]
added two command line options:
+noisomalloc:  to disable isomalloc for apps that don't need it
+isomalloc_probe:  to use probe method of isomalloc initialization in finding the largest available region.

10 years agoCMK_TAG(Cpv_addr_,v) need to include one extra for comm. thread.
Gengbin Zheng [Fri, 25 Feb 2011 18:41:43 +0000 (12:41 -0600)]
CMK_TAG(Cpv_addr_,v) need to include one extra for comm. thread.

10 years agoMerge branch 'charm' of charmgit:charm into charm
Gengbin Zheng [Fri, 25 Feb 2011 15:45:02 +0000 (09:45 -0600)]
Merge branch 'charm' of charmgit:charm into charm

10 years agoremove the limitation of CMK_MAX_PTHREADS for TLS implementation of Cpv variables.
Gengbin Zheng [Fri, 25 Feb 2011 15:44:32 +0000 (09:44 -0600)]
remove the limitation of CMK_MAX_PTHREADS for TLS implementation of Cpv variables.

10 years agoa CcdTOPOLOGY_AVAIL ccd condition, which is raised when topology info is available...
Gengbin Zheng [Fri, 25 Feb 2011 06:32:30 +0000 (00:32 -0600)]
a CcdTOPOLOGY_AVAIL ccd condition, which is raised when topology info is available on each processor.
neighbor seed load balancer need to initialize itself after topology info is available (which is in charmInit)

10 years agoMerge branch 'charm' of charmgit:charm into charm
Gengbin Zheng [Fri, 25 Feb 2011 06:25:09 +0000 (00:25 -0600)]
Merge branch 'charm' of charmgit:charm into charm

10 years agofixed some minor bugs in LBTopo_torus_nd_smp class to make it actually works
Gengbin Zheng [Fri, 25 Feb 2011 06:23:23 +0000 (00:23 -0600)]
fixed some minor bugs in LBTopo_torus_nd_smp class to make it actually works

10 years agodoc: expand on the available load balancing options
Abhinav S Bhatele [Fri, 25 Feb 2011 03:08:19 +0000 (21:08 -0600)]
doc: expand on the available load balancing options

10 years agowhen skip topology, only rank 0 initialize the topo data structure
Gengbin Zheng [Fri, 25 Feb 2011 00:16:05 +0000 (18:16 -0600)]
when skip topology, only rank 0 initialize the topo data structure

10 years agoMakefile_lb.sh: Remove noise obviated by version control
Phil Miller [Thu, 24 Feb 2011 15:32:45 +0000 (09:32 -0600)]
Makefile_lb.sh: Remove noise obviated by version control

10 years agoMove TempAwareGreedyLB out of the common set
Phil Miller [Thu, 24 Feb 2011 15:31:34 +0000 (09:31 -0600)]
Move TempAwareGreedyLB out of the common set

10 years agoupdated
Gengbin Zheng [Thu, 24 Feb 2011 15:07:29 +0000 (09:07 -0600)]
updated

10 years agofixed the broken Make.depends
Gengbin Zheng [Thu, 24 Feb 2011 15:06:54 +0000 (09:06 -0600)]
fixed the broken Make.depends

10 years agoMake file change for Maj min
Osman Sarood [Thu, 24 Feb 2011 13:51:55 +0000 (07:51 -0600)]
Make file change for Maj min

10 years agoMaj min example
Osman Sarood [Thu, 24 Feb 2011 13:49:21 +0000 (07:49 -0600)]
Maj min example

10 years agoTempAwareLB added
Osman Sarood [Thu, 24 Feb 2011 13:42:41 +0000 (07:42 -0600)]
TempAwareLB added

10 years agoMerge branch 'charm' of charmgit:charm into charm
Gengbin Zheng [Thu, 24 Feb 2011 08:36:10 +0000 (02:36 -0600)]
Merge branch 'charm' of charmgit:charm into charm

10 years agosome minor optimization: reuse messages, remove calls to QD events.
Gengbin Zheng [Thu, 24 Feb 2011 08:35:21 +0000 (02:35 -0600)]
some minor optimization: reuse messages, remove calls to QD events.

10 years agoDistributed Completion Detection: Apps don't need to use QD
Phil Miller [Wed, 23 Feb 2011 22:51:32 +0000 (16:51 -0600)]
Distributed Completion Detection: Apps don't need to use QD

A mechanism to detect the completion of distributed processes, based
on a counts of event generators and events produced and consumed. From
an application's standpoint, this accomplishes the same thing as QD,
but on a more modular basis.

Ideally, this should be able to prioritize itself below the process
it's tracking. That's not implemented yet.

10 years agofixed compilation error for non-Linux platforms.
Gengbin Zheng [Thu, 24 Feb 2011 01:10:13 +0000 (19:10 -0600)]
fixed compilation error for non-Linux platforms.

10 years agoFix reductiontarget code generation for groups and nodegroups
Aaron Becker [Thu, 24 Feb 2011 00:43:51 +0000 (18:43 -0600)]
Fix reductiontarget code generation for groups and nodegroups

10 years agodoc: new image for ckgraph api
Abhinav S Bhatele [Wed, 23 Feb 2011 23:25:44 +0000 (17:25 -0600)]
doc: new image for ckgraph api

10 years agoMerge branch 'charm' of charmgit:charm into charm
Gengbin Zheng [Wed, 23 Feb 2011 22:23:07 +0000 (16:23 -0600)]
Merge branch 'charm' of charmgit:charm into charm

10 years agouse smp lock to protect the syscall and fopen in CmiInitCPUAffinityUtil() function.
Gengbin Zheng [Wed, 23 Feb 2011 22:22:37 +0000 (16:22 -0600)]
use smp lock to protect the syscall and fopen in CmiInitCPUAffinityUtil() function.

10 years agosubtle: added memory read and write fence to CpvInitialize to make sure that after...
Gengbin Zheng [Wed, 23 Feb 2011 22:21:16 +0000 (16:21 -0600)]
subtle: added memory read and write fence to CpvInitialize to make sure that after non-zero ranks exit from the while loop, it gets the cpv variables ready to use.

10 years agolb_test: add sizing information through sizer
Abhinav S Bhatele [Wed, 23 Feb 2011 21:04:38 +0000 (15:04 -0600)]
lb_test: add sizing information through sizer

10 years agoMerge branch 'charm' of charmgit:charm into charm
Gengbin Zheng [Wed, 23 Feb 2011 00:52:29 +0000 (18:52 -0600)]
Merge branch 'charm' of charmgit:charm into charm

10 years agofixed a bug in workstealing that when stealing is in progress, beginIdle should not...
Gengbin Zheng [Wed, 23 Feb 2011 00:51:37 +0000 (18:51 -0600)]
fixed a bug in workstealing that when stealing is in progress, beginIdle should not steal again.

10 years agoa fix for bluedrop multicore startup crash, where it seems that mmap unmap'ed some...
Gengbin Zheng [Wed, 23 Feb 2011 00:08:28 +0000 (18:08 -0600)]
a fix for bluedrop multicore startup crash, where it seems that mmap unmap'ed some lower region (2GB) of memory that makes it available for malloc, which then is trashed by something else.
Fixed so that isomalloc does not touch that lower region of memory.
This sems to only happen on bluedrop's compute node, not on the frontend node.

10 years agostencil3d: fix the calculation of time per step
Abhinav S Bhatele [Tue, 22 Feb 2011 23:31:33 +0000 (17:31 -0600)]
stencil3d: fix the calculation of time per step

10 years agock-ldb: make the ldb debug prints more readable and consistent
Abhinav S Bhatele [Tue, 22 Feb 2011 22:10:33 +0000 (16:10 -0600)]
ck-ldb: make the ldb debug prints more readable and consistent

10 years agochange back to GNU malloc since os malloc did crash megatest.
Gengbin Zheng [Tue, 22 Feb 2011 22:04:50 +0000 (16:04 -0600)]
change back to GNU malloc since os malloc did crash megatest.
will need to investigate it later.

10 years agoMerge branch 'charm' of charmgit:charm into charm
Gengbin Zheng [Tue, 22 Feb 2011 22:03:20 +0000 (16:03 -0600)]
Merge branch 'charm' of charmgit:charm into charm

10 years agonicer looking changes for previous commit
Gengbin Zheng [Tue, 22 Feb 2011 22:02:49 +0000 (16:02 -0600)]
nicer looking changes for previous commit

10 years agoMerge branch 'charm' of charmgit:charm into charm
Gengbin Zheng [Tue, 22 Feb 2011 21:56:41 +0000 (15:56 -0600)]
Merge branch 'charm' of charmgit:charm into charm

10 years agochangedto use generic64 Cth for SMP. it should work on lapi/aix when __thread is...
Gengbin Zheng [Tue, 22 Feb 2011 21:53:41 +0000 (15:53 -0600)]
changedto use generic64 Cth for SMP. it should work on lapi/aix when __thread is supported.

10 years agoMerge branch 'charm' of charmgit:charm into charm
Gengbin Zheng [Tue, 22 Feb 2011 21:52:45 +0000 (15:52 -0600)]
Merge branch 'charm' of charmgit:charm into charm

10 years agogeneric64 did not work with SMP due to using a global pointer mapping table.
Gengbin Zheng [Tue, 22 Feb 2011 21:51:27 +0000 (15:51 -0600)]
generic64 did not work with SMP due to using a global pointer mapping table.
updated this code by using __thread (when supported) to work with SMP.

10 years agodoc: update doc for adding a new load balancer
Abhinav S Bhatele [Tue, 22 Feb 2011 07:29:11 +0000 (01:29 -0600)]
doc: update doc for adding a new load balancer

10 years agock-ldb: add documentation
Abhinav S Bhatele [Tue, 22 Feb 2011 07:16:07 +0000 (01:16 -0600)]
ck-ldb: add documentation

10 years agock-ldb: turn off recording of min and max wall time for chares
Abhinav Bhatele [Tue, 22 Feb 2011 00:41:50 +0000 (19:41 -0500)]
ck-ldb: turn off recording of min and max wall time for chares

10 years agocputimer: turn off cpu timer calls by default
Abhinav Bhatele [Tue, 22 Feb 2011 00:14:39 +0000 (19:14 -0500)]
cputimer: turn off cpu timer calls by default

10 years agocputimer: WSLB will not be compiled by default
Abhinav Bhatele [Tue, 22 Feb 2011 00:13:26 +0000 (19:13 -0500)]
cputimer: WSLB will not be compiled by default

since WSLB depends on using both cpu and wall time

10 years agocputimer: use walltime when cputimer not available
Abhinav Bhatele [Tue, 22 Feb 2011 00:12:43 +0000 (19:12 -0500)]
cputimer: use walltime when cputimer not available

10 years agocputimer: CMK_LB_CPUTIMER ifdefs in NeigborLB code
Abhinav Bhatele [Tue, 22 Feb 2011 00:11:01 +0000 (19:11 -0500)]
cputimer: CMK_LB_CPUTIMER ifdefs in NeigborLB code

10 years agocputimer: change background load to be walltime
Abhinav Bhatele [Tue, 22 Feb 2011 00:09:55 +0000 (19:09 -0500)]
cputimer: change background load to be walltime

10 years agocputimer: this changes the way background time is calculated
Abhinav Bhatele [Tue, 22 Feb 2011 00:08:26 +0000 (19:08 -0500)]
cputimer: this changes the way background time is calculated

bg_walltime is no longer calculated using obj_cputime

10 years agocputimer: guard cputime variables with CMK_LB_CPUTIMER
Abhinav Bhatele [Tue, 22 Feb 2011 00:06:17 +0000 (19:06 -0500)]
cputimer: guard cputime variables with CMK_LB_CPUTIMER

10 years agoMerge branch 'metis' into charm
Phil Miller [Mon, 21 Feb 2011 02:42:58 +0000 (20:42 -0600)]
Merge branch 'metis' into charm

10 years agoMerge branch 'charm' of charmgit:charm into charm
Abhinav S Bhatele [Sun, 20 Feb 2011 09:12:56 +0000 (03:12 -0600)]
Merge branch 'charm' of charmgit:charm into charm

10 years agock-ldb: this should fix MetisLB and ScotchLB crashes
Abhinav S Bhatele [Sun, 20 Feb 2011 09:11:19 +0000 (03:11 -0600)]
ck-ldb: this should fix MetisLB and ScotchLB crashes

Metis and Scotch require a undirected graph it seems with no
duplicate edges.

10 years agoMerge branch 'charm' of charmgit:charm into charm
Yanhua Yanhua [Sun, 20 Feb 2011 07:31:32 +0000 (01:31 -0600)]
Merge branch 'charm' of charmgit:charm into charm

10 years agoCommenting one line of initialization makes program incorrect. Now this line is back
Yanhua Yanhua [Sun, 20 Feb 2011 07:29:51 +0000 (01:29 -0600)]
Commenting one line of initialization makes program incorrect. Now this line is back

10 years agoMerge branch 'charm' of charmgit:charm into charm
Gengbin Zheng [Sun, 20 Feb 2011 06:47:57 +0000 (00:47 -0600)]
Merge branch 'charm' of charmgit:charm into charm

10 years agomoved CmiInitCPUAffinityUtil to be after CmiTmpInit since it may need it.
Gengbin Zheng [Sun, 20 Feb 2011 06:47:13 +0000 (00:47 -0600)]
moved CmiInitCPUAffinityUtil to be after CmiTmpInit since it may need it.

10 years agolb_test: remove unnecessary lib paths
Abhinav S Bhatele [Sun, 20 Feb 2011 05:24:23 +0000 (23:24 -0600)]
lb_test: remove unnecessary lib paths

10 years agodoc: fix compilation errors
Abhinav S Bhatele [Sat, 19 Feb 2011 17:25:08 +0000 (11:25 -0600)]
doc: fix compilation errors

10 years agofix work stealing hanging problem on Jagua
Gengbin Zheng [Sat, 19 Feb 2011 01:52:20 +0000 (20:52 -0500)]
fix work stealing hanging problem on Jagua

10 years agoFixed a bug in setting the starting time of tracing MPI_Isend
Chao Mei [Fri, 18 Feb 2011 23:23:39 +0000 (17:23 -0600)]
Fixed a bug in setting the starting time of tracing MPI_Isend

10 years agoMerge branch 'charm' of charmgit:charm into charm
Chao Mei [Fri, 18 Feb 2011 22:56:01 +0000 (16:56 -0600)]
Merge branch 'charm' of charmgit:charm into charm

10 years agoAdded a macro to turn off user event when tracing MPI_Isend/MPI_Recv in order to...
Chao Mei [Fri, 18 Feb 2011 19:14:08 +0000 (13:14 -0600)]
Added a macro to turn off user event when tracing MPI_Isend/MPI_Recv in order to reduce the overhead of comm thread tracing.

10 years agofix a bug in workstealing for processor=2
Yanhua Yanhua [Fri, 18 Feb 2011 17:38:16 +0000 (11:38 -0600)]
fix a bug in workstealing for processor=2

10 years agoOnly use workstealing when processor number is more than 1
Yanhua Yanhua [Fri, 18 Feb 2011 17:23:29 +0000 (11:23 -0600)]
Only use workstealing when processor number is more than 1

10 years agosmp switch to os malloc.
Gengbin Zheng [Fri, 18 Feb 2011 06:19:49 +0000 (00:19 -0600)]
smp switch to os malloc.

10 years agoMerge branch 'charm' of charmgit:charm into charm
Gengbin Zheng [Fri, 18 Feb 2011 05:53:24 +0000 (23:53 -0600)]
Merge branch 'charm' of charmgit:charm into charm