View page
Talk page

Intel oneAPI

This page can't be edited. | Page History
    Table of contents
    You are currently comparing two old versions - only when you are comparing against the latest version can you revert. Return to version archive.

    Combined revision comparison

    Comparing version 17:35, 5 Jan 2022 by jwagner with version 17:38, 5 Jan 2022 by jwagner.

    ...

    Intel MPI test:For

    $ ssh oper@fxmanager
$ source /opt/intel/oneapi/setvars.sh
$ which mpirun
/opt/intel/oneapi/mpi/2021.3.1/bin/mpirun

$ cat > intel.hostfile <<EOF
fxmanager
mark6-01
node02.service
node67.service
node10.service
node11.service
node12.service
EOF

$ mpirun -print-rank-map -prepend-rank -v -n 7 -perhost 1 -machinefile intel.hostfile /usr/bin/hostname

    Environment -DiFXDiFX,

    The startdifx(.py) script of DiFX has to be modified slightly on one source code line:the 

    cmd = 'mpirun -np %d --hostfile %s.machines ...
  change that into
cmd = 'mpirun -np %d --machinefile %s.machines ...

    The usual setup_difx script(s) should have:

    #!/bin/bash

## Get oneAPI environment
# Prepare IPPROOT, CMPLR_ROOT, I_MPI_ROOT, ...
if [[ "$I_MPI_ROOT" == "" ]]; then
        . /opt/intel/oneapi/setvars.sh
fi
if [[ "$IPPROOT" == "" ]]; then
        export IPPROOT=$ONEAPI_ROOT/lib/intel64/
fi
# Intel MPI
export OPENMPIROOT=$I_MPI_ROOT
# Intel Compilers
# Note on icc, vs icpc, vs icx, vs icpx, vs icl: 
#  https://software.intel.com/content/www/us/en/develop/articles/porting-guide-for-icc-users-to-dpcpp-or-icx.html
export CC=icc
export CXX=icpc
export MPIXCC=${OPENMPIROOT}/bin/mpicxx
export MPICXX=${OPENMPIROOT}/bin/mpicxx

# Add Intel-libs path in case the current host has only the runtimes but not entire
# devel toolkit installed; the automatic setvars.sh does not appear to cover that case
export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/opt/intel/oneapi/lib/intel64/

## Rest of DiFX setup
# note: OpenMPI params in DIFX_MPIRUNOPTIONS and the OMPI_MCA_* env vars probably irrelevat for Intel MPI
Intel MPI test:
$ ssh oper@fxmanager
$ source /opt/intel/oneapi/setvars.sh
$ which mpirun
/opt/intel/oneapi/mpi/2021.3.1/bin/mpirun

$ cat > intel.hostfile <<EOF
fxmanager
mark6-01
node02.service
node67.service
node10.service
node11.service
node12.service
EOF

$ mpirun -print-rank-map -prepend-rank -v -n 7 -perhost 1 -machinefile intel.hostfile /usr/bin/hostname

    Version from 17:35, 5 Jan 2022

    This revision modified by jwagner (Ban)

    ...

    For DiFX, the usual setup_difx script(s) should have:

    #!/bin/bash

## Get oneAPI environment
# Prepare IPPROOT, CMPLR_ROOT, I_MPI_ROOT, ...
if [[ "$I_MPI_ROOT" == "" ]]; then
        . /opt/intel/oneapi/setvars.sh
fi
if [[ "$IPPROOT" == "" ]]; then
        export IPPROOT=$ONEAPI_ROOT/lib/intel64/
fi
# Intel MPI
export OPENMPIROOT=$I_MPI_ROOT
# Intel Compilers
# Note on icc, vs icpc, vs icx, vs icpx, vs icl: 
#  https://software.intel.com/content/www/us/en/develop/articles/porting-guide-for-icc-users-to-dpcpp-or-icx.html
export CC=icc
export CXX=icpc
export MPIXCC=${OPENMPIROOT}/bin/mpicxx
export MPICXX=${OPENMPIROOT}/bin/mpicxx

# Add Intel-libs path in case the current host has only the runtimes but not entire
# devel toolkit installed; the automatic setvars.sh does not appear to cover that case
export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/opt/intel/oneapi/lib/intel64/

## Rest of DiFX setup
# note: OpenMPI params in DIFX_MPIRUNOPTIONS and the OMPI_MCA_* env vars probably irrelevat for Intel MPI

    Intel MPI test:

    $ ssh oper@fxmanager
$ source /opt/intel/oneapi/setvars.sh
$ which mpirun
/opt/intel/oneapi/mpi/2021.3.1/bin/mpirun

$ cat > intel.hostfile <<EOF
fxmanager
mark6-01
node02.service
node67.service
node10.service
node11.service
node12.service
EOF

$ mpirun -print-rank-map -prepend-rank -v -n 7 -perhost 1 -machinefile intel.hostfile /usr/bin/hostname

    Version as of 17:38, 5 Jan 2022

    This revision modified by jwagner (Ban)

    ...

    Intel MPI test:

    $ ssh oper@fxmanager
$ source /opt/intel/oneapi/setvars.sh
$ which mpirun
/opt/intel/oneapi/mpi/2021.3.1/bin/mpirun

$ cat > intel.hostfile <<EOF
fxmanager
mark6-01
node02.service
node67.service
node10.service
node11.service
node12.service
EOF

$ mpirun -print-rank-map -prepend-rank -v -n 7 -perhost 1 -machinefile intel.hostfile /usr/bin/hostname

    Environment -DiFX

    The startdifx(.py) script of DiFX has to be modified slightly on one source code line:

    cmd = 'mpirun -np %d --hostfile %s.machines ...
  change that into
cmd = 'mpirun -np %d --machinefile %s.machines ...

    The usual setup_difx script(s) should have:

    ...