Allinea map

[jg piccinali]

MPI/OpenMP (jacobi)

Santis

• which make-profiler-libraries

/apps/common/ddt/6.0-Suse-11/bin/make-profiler-libraries

• cd /apps/common/UES/sandbox/jgp/map/
• make-profiler-libraries --platform=cray --lib-type=shared

Creating Cray shared libraries in /users/piccinal
Created the libraries:
   libmap-sampler.so       (and .so.1, .so.1.0, .so.1.0.0)
   libmap-sampler-pmpi.so  (and .so.1, .so.1.0, .so.1.0.0)

GNU/530

• module swap PrgEnv-cray PrgEnv-gnu
• ftn -g -O3 -dynamic -L. -lmap-sampler-pmpi -lmap-sampler -Wl,--eh-frame-hdr -Wl,-rpath=/apps/common/UES/sandbox/jgp/map w.f90 -o santis.gnu

/usr/bin/ld.x: /tmp/cc6lrKBW.o(.debug_info+0x7f): 
unresolvable R_X86_64_64 relocation against symbol `mpifcmb5_'

CCE/845

• make CC=cc LIB="-dynamic -L. -lmap-sampler-pmpi -lmap-sampler -Wl,--eh-frame-hdr -Wl,-rpath=/apps/common/UES/sandbox/jgp/map"

• ldd CRAY.exe |grep libmap

    libmap-sampler-pmpi.so => ./libmap-sampler-pmpi.so (0x00002b0db7693000)
    libmap-sampler.so.1 => ./libmap-sampler.so.1 (0x00002b0db78e2000)

• export MPICC=cc
• export OMP_NUMTHREADS=1
• export ITERATIONS=500
• map --connect srun -n2 -c1 ./CRAY.exe

A new Reverse Connect request is available
from santis01:4201 for Allinea MAP.
Command Line: --connect srun -n2 ./santis.cce
Do you want to accept this request?

[jg piccinali]

MPI/CUDA75

santis

• cd /apps/common/UES/sandbox/jgp/map/jacobi_cuda

compile

• module load craype-accel-nvidia35
• nvcc -G -O3 -arch=sm_35 -c jacobi_cuda_kernel.cu
• cc -DUSE_MPI -G2 -O3 -D_CSCS_ITMAX=500 jacobi_cuda.c jacobi_cuda_kernel.o -o santis
  -dynamic -L.. -lmap-sampler-pmpi -lmap-sampler -Wl,--eh-frame-hdr -Wl,-rpath=/apps/common/UES/sandbox/jgp/map

run

• export OMP_NUMTHREADS=1
• export MPICC=cc
• export ITERATIONS=500

• map --connect srun -n1 -c1 ./santis

• map --connect srun -n2 --ntasks-per-node=1 -c1 ./santis

• hangs forever :-(