Slurm Examples¶

This page provides ready-to-use submit examples for the HoreKa 2 CPU partition. The examples follow the typical progression of parallelization levels:

Serial: one process, one thread.
Multi-threaded (OpenMP): shared-memory parallelism within one node.
Multi-task (MPI): distributed-memory parallelism across cores and nodes.
Hybrid (MPI + OpenMP): distributed-memory parallelism between MPI tasks combined with shared-memory parallelism within each task.

Each example is a "Hello World" program that prints on which node and core each task or thread is running. Every example consists of the source code and the matching Slurm batch script.

The main purpose of this page is to provide reference settings for batch scripts. The resource requests (--nodes, --ntasks-per-node, --ntasks-per-socket, --cpus-per-task, --threads-per-core), the thread-related environment variables (OMP_NUM_THREADS, OMP_PLACES, OMP_PROC_BIND) and the process launch options (mpirun --map-by ... --bind-to ...) have to match each other, so that tasks and threads are placed on the intended cores. Use the scripts as a starting point for your own jobs and adapt only the parts that depend on your application, such as the modules, the compile step and the program call.

A node of the HoreKa 2 CPU partition has two sockets with 96 physical cores each, i.e. 192 physical cores in total. With Hyperthreading (HT), each physical core provides two hardware threads, which results in 192 hardware threads per socket and 384 per node. Hyperthreading is requested with --threads-per-core=2; the default of --threads-per-core=1 uses only one hardware thread per physical core. Whether Hyperthreading improves the performance depends on the application. Examples that use it are marked with "Hyperthreads" or "(HT)" in the tab titles.

Submit a script with:

sbatch <script>.sh

Single-threaded Jobs¶

Serial code, uses a single core.

Source code

hello-world_serial.cpp

Download: hello-world_serial.cpp

#include <iostream>
#include <sched.h>
#include <unistd.h> 
#include <hwloc.h>

using namespace std;

int main (int argc, char *argv[])
{
    hwloc_topology_t topology;
    hwloc_topology_init(&topology);
    hwloc_topology_load(topology);


    int logical_core = sched_getcpu();
    char hostname[HOST_NAME_MAX + 1];

    hwloc_obj_t obj = hwloc_get_pu_obj_by_os_index(topology, logical_core);
    int physical_core = obj->parent->logical_index;

    if (gethostname(hostname, sizeof(hostname)) == 0) {
        std::cout << "Knotenname: " << hostname << std::endl;
    } else {
        std::cerr << "Fehler beim Abrufen des Knotennamens!" << std::endl;
    }

    cout<<"physical core: " << physical_core
        <<" | logical core: " << logical_core <<endl;






    hwloc_topology_destroy(topology);
    return 0;
}

Submit script

The tabs below show only the relevant part of each submit script, i.e. the module setup, the compile step and the program call. The link above each excerpt downloads the complete script, including the Slurm directives.

GCCIntel

Download: hk2_serial.sh

# Load modules
module purge
module load GCC

# Compile source code
g++ -lhwloc hello-world_serial.cpp -o hello-world_serial

./hello-world_serial

The Intel example will be added.

Multi-threaded (OpenMP) Jobs¶

Multi-threaded code, uses all cores of the HoreKa 2 CPU partition, with or without using Hyperthreading.

Source code

hello-world_omp.cpp

Download: hello-world_omp.cpp

#include <omp.h>
#include <iostream>
#include <sched.h>
#include <unistd.h> 
#include <hwloc.h>

using namespace std;

int main (int argc, char *argv[])
{

    char hostname[HOST_NAME_MAX + 1];

    hwloc_topology_t topology;
    hwloc_topology_init(&topology);
    hwloc_topology_load(topology);

    if (gethostname(hostname, sizeof(hostname)) == 0) {
        std::cout << "Knotenname: " << hostname << std::endl;
    } else {
        std::cerr << "Fehler beim Abrufen des Knotennamens!" << std::endl;
    }

    #pragma omp parallel
    {
        int tid = omp_get_thread_num();
        int nthreads = omp_get_num_threads();
        int logical_core = sched_getcpu();

        hwloc_obj_t obj = hwloc_get_pu_obj_by_os_index(topology, logical_core);
        int physical_core = obj->parent->logical_index;

        usleep(logical_core*1000 + tid*10000);

        #pragma omp critical
        cout<<"OpenMP-thread: "<<tid <<" / "<<nthreads
            <<" | physical core: " << physical_core
            <<" | logical core: " << logical_core
            <<endl;

    }

    hwloc_topology_destroy(topology);
    return 0;
}

Submit scripts

The tabs below show only the relevant part of each submit script, i.e. the module setup, the compile step, the export commands and the program call. The link above each excerpt downloads the complete script, including the Slurm directives.

GCCIntel

Physical coresHyperthreads

Download: hk2_openmp.sh

# Load modules
module load GCC/15.2.0

# Compile source code
g++ -fopenmp -lhwloc hello-world_omp.cpp -o hello-world_omp

export OMP_NUM_THREADS=${SLURM_CPUS_PER_TASK}
export OMP_PLACES=cores
export OMP_PROC_BIND=TRUE

./hello-world_omp

Download: hk2_openmp_hyperthreading.sh

# Load modules
module purge
module load GCC

# Compile source code
g++ -fopenmp -lhwloc hello-world_omp.cpp -o hello-world_omp

export OMP_NUM_THREADS=${SLURM_CPUS_PER_TASK}
export OMP_PLACES=threads
export OMP_PROC_BIND=TRUE

./hello-world_omp

Physical coresHyperthreads

Download: hk2_openmp_intel.sh

# Load modules
module purge
module load intel

# Compile source code
icpx -qopenmp -lhwloc hello-world_omp.cpp -o hello-world_omp_intel

export OMP_NUM_THREADS=${SLURM_CPUS_PER_TASK}
export OMP_PLACES=cores
export OMP_PROC_BIND=TRUE


./hello-world_omp_intel

Download: hk2_openmp_hyperthreading_intel.sh

# Load modules
module purge
module load intel

# Compile source code
icpx -qopenmp -lhwloc hello-world_omp.cpp -o hello-world_omp_intel

export OMP_NUM_THREADS=${SLURM_CPUS_PER_TASK}
export OMP_PLACES=threads
export OMP_PROC_BIND=TRUE
export I_MPI_PIN_DOMAIN=socket

./hello-world_omp_intel

MPI Jobs¶

Multi-task code with distributed memory, spawns one MPI task per physical core (192 tasks per node) on the HoreKa 2 CPU partition. For multiple nodes, increase --nodes.

Source code

hello-world_mpi.cpp

Download: hello-world_mpi.cpp

#include <iostream>
#include <mpi.h>
#include <sched.h>
#include <unistd.h>

using namespace std;

int main(int argc, char** argv) {
    MPI_Init(&argc, &argv);

    int rank, size, name_len;
    rank = size = 0;
    char processor_name[MPI_MAX_PROCESSOR_NAME];

    MPI_Comm_rank(MPI_COMM_WORLD, &rank);
    MPI_Comm_size(MPI_COMM_WORLD, &size);
    MPI_Get_processor_name(processor_name, &name_len);

    int logical_core = sched_getcpu();

    cout <<"node: "<<processor_name
     << " | MPI-process: " << rank << " / " << size
         << " | logical core: " << logical_core << endl;

    MPI_Finalize();
    return 0;
}

Submit script

The tabs below show only the relevant part of each submit script, i.e. the module setup, the compile step and the mpirun call. The link above each excerpt downloads the complete script, including the Slurm directives.

OpenMPI

All cores

Download: hk2_mpi.sh

# Load modules
module load OpenMPI

# Compile source code
mpic++ hello-world_mpi.cpp -o hello-world_mpi

mpirun ./hello-world_mpi

Hybrid MPI + OpenMP Jobs¶

Multi-node, multi-threaded code on the HoreKa 2 CPU partition. The job starts either one or two MPI tasks per socket. Each task runs one OpenMP thread per physical core assigned to it, or per hardware thread when HT is used. With one task per socket, each task uses 96 cores (192 hardware threads); with two tasks per socket, each task uses 48 cores (96 hardware threads).

Source code

hello-world_mpi+omp.cpp

Download: hello-world_mpi+omp.cpp

#include <mpi.h>
#include <omp.h>
#include <iostream>
#include <sched.h>
#include <unistd.h> 
#include <hwloc.h>

using namespace std;

int main (int argc, char *argv[])
{
    int size, rank, name_len;
    char processor_name[MPI_MAX_PROCESSOR_NAME];

    hwloc_topology_t topology;
    hwloc_topology_init(&topology);
    hwloc_topology_load(topology);

    MPI_Init(NULL, NULL);
    MPI_Comm_size(MPI_COMM_WORLD, &size);
    MPI_Comm_rank(MPI_COMM_WORLD, &rank);
    MPI_Get_processor_name(processor_name, &name_len);

    #pragma omp parallel
    {
        int tid = omp_get_thread_num();
        int nthreads = omp_get_num_threads();
        int logical_core = sched_getcpu();

        hwloc_obj_t obj = hwloc_get_pu_obj_by_os_index(topology, logical_core);
        int physical_core = obj->parent->logical_index;

        usleep(rank*100 + logical_core*1000 + tid*10000);

        #pragma omp critical
        cout<<"node: "<<processor_name
            <<" | MPI-task: "<<rank<<" / "<<size
            <<" | OpenMP-thread: "<<tid <<" / "<<nthreads
            <<" | physical core: " << physical_core
            <<" | logical core: " << logical_core
            <<endl;

    }

    hwloc_topology_destroy(topology);
    MPI_Finalize();
    return 0;
}

Submit scripts

The tabs below show only the relevant part of each submit script, i.e. the module setup, the compile step, the export commands and the mpirun call. The link above each excerpt downloads the complete script, including the Slurm directives.

OpenMPIIntel MPI

1 task/socket1 task/socket (HT)2 tasks/socket2 tasks/socket (HT)

Download: hk2_one-mpi-task-per-socket.sh

# Load modules
module load OpenMPI

# Compile source code
mpic++ -fopenmp -lhwloc hello-world_mpi+omp.cpp -o hello-world_mpi+omp_openmpi

export OMP_NUM_THREADS=${SLURM_CPUS_PER_TASK}
export OMP_PLACES=cores
export OMP_PROC_BIND=TRUE

mpirun --map-by package --bind-to package ./hello-world_mpi+omp_openmpi

Expected output

$ cat hello-world_mpi+omp_openmpi_one-mpi-task-per-socket_121748.out | grep localdomain | sort -n -k 16
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 0 / 96 | physical core: 0 | logical core: 192
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 1 / 96 | physical core: 1 | logical core: 1
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 2 / 96 | physical core: 2 | logical core: 2
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 3 / 96 | physical core: 3 | logical core: 3
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 4 / 96 | physical core: 4 | logical core: 4
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 5 / 96 | physical core: 5 | logical core: 5
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 6 / 96 | physical core: 6 | logical core: 198
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 7 / 96 | physical core: 7 | logical core: 7
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 32 / 96 | physical core: 8 | logical core: 8
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 33 / 96 | physical core: 9 | logical core: 201
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 34 / 96 | physical core: 10 | logical core: 202
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 35 / 96 | physical core: 11 | logical core: 203
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 36 / 96 | physical core: 12 | logical core: 204
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 37 / 96 | physical core: 13 | logical core: 13
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 38 / 96 | physical core: 14 | logical core: 14
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 39 / 96 | physical core: 15 | logical core: 207
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 64 / 96 | physical core: 16 | logical core: 16
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 65 / 96 | physical core: 17 | logical core: 209
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 66 / 96 | physical core: 18 | logical core: 210
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 67 / 96 | physical core: 19 | logical core: 19
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 68 / 96 | physical core: 20 | logical core: 212
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 69 / 96 | physical core: 21 | logical core: 213
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 70 / 96 | physical core: 22 | logical core: 214
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 71 / 96 | physical core: 23 | logical core: 23
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 16 / 96 | physical core: 24 | logical core: 216
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 17 / 96 | physical core: 25 | logical core: 25
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 18 / 96 | physical core: 26 | logical core: 218
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 19 / 96 | physical core: 27 | logical core: 219
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 20 / 96 | physical core: 28 | logical core: 28
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 21 / 96 | physical core: 29 | logical core: 221
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 22 / 96 | physical core: 30 | logical core: 30
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 23 / 96 | physical core: 31 | logical core: 31
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 48 / 96 | physical core: 32 | logical core: 224
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 49 / 96 | physical core: 33 | logical core: 225
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 50 / 96 | physical core: 34 | logical core: 226
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 51 / 96 | physical core: 35 | logical core: 35
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 52 / 96 | physical core: 36 | logical core: 36
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 53 / 96 | physical core: 37 | logical core: 229
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 54 / 96 | physical core: 38 | logical core: 230
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 55 / 96 | physical core: 39 | logical core: 231
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 80 / 96 | physical core: 40 | logical core: 40
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 81 / 96 | physical core: 41 | logical core: 233
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 82 / 96 | physical core: 42 | logical core: 42
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 83 / 96 | physical core: 43 | logical core: 43
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 84 / 96 | physical core: 44 | logical core: 236
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 85 / 96 | physical core: 45 | logical core: 237
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 86 / 96 | physical core: 46 | logical core: 46
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 87 / 96 | physical core: 47 | logical core: 239
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 24 / 96 | physical core: 48 | logical core: 48
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 25 / 96 | physical core: 49 | logical core: 49
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 26 / 96 | physical core: 50 | logical core: 50
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 27 / 96 | physical core: 51 | logical core: 243
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 28 / 96 | physical core: 52 | logical core: 244
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 29 / 96 | physical core: 53 | logical core: 53
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 30 / 96 | physical core: 54 | logical core: 54
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 31 / 96 | physical core: 55 | logical core: 55
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 56 / 96 | physical core: 56 | logical core: 56
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 57 / 96 | physical core: 57 | logical core: 57
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 58 / 96 | physical core: 58 | logical core: 58
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 59 / 96 | physical core: 59 | logical core: 59
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 60 / 96 | physical core: 60 | logical core: 60
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 61 / 96 | physical core: 61 | logical core: 253
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 62 / 96 | physical core: 62 | logical core: 254
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 63 / 96 | physical core: 63 | logical core: 63
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 88 / 96 | physical core: 64 | logical core: 64
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 89 / 96 | physical core: 65 | logical core: 65
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 90 / 96 | physical core: 66 | logical core: 258
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 91 / 96 | physical core: 67 | logical core: 67
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 92 / 96 | physical core: 68 | logical core: 260
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 93 / 96 | physical core: 69 | logical core: 69
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 94 / 96 | physical core: 70 | logical core: 262
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 95 / 96 | physical core: 71 | logical core: 71
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 8 / 96 | physical core: 72 | logical core: 264
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 9 / 96 | physical core: 73 | logical core: 265
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 10 / 96 | physical core: 74 | logical core: 74
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 11 / 96 | physical core: 75 | logical core: 267
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 12 / 96 | physical core: 76 | logical core: 268
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 13 / 96 | physical core: 77 | logical core: 77
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 14 / 96 | physical core: 78 | logical core: 270
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 15 / 96 | physical core: 79 | logical core: 79
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 40 / 96 | physical core: 80 | logical core: 80
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 41 / 96 | physical core: 81 | logical core: 273
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 42 / 96 | physical core: 82 | logical core: 274
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 43 / 96 | physical core: 83 | logical core: 275
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 44 / 96 | physical core: 84 | logical core: 84
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 45 / 96 | physical core: 85 | logical core: 277
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 46 / 96 | physical core: 86 | logical core: 86
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 47 / 96 | physical core: 87 | logical core: 279
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 72 / 96 | physical core: 88 | logical core: 88
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 73 / 96 | physical core: 89 | logical core: 281
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 74 / 96 | physical core: 90 | logical core: 282
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 75 / 96 | physical core: 91 | logical core: 283
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 76 / 96 | physical core: 92 | logical core: 92
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 77 / 96 | physical core: 93 | logical core: 93
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 78 / 96 | physical core: 94 | logical core: 286
node: hk2n1104.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 79 / 96 | physical core: 95 | logical core: 95
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 0 / 96 | physical core: 96 | logical core: 96
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 1 / 96 | physical core: 97 | logical core: 97
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 2 / 96 | physical core: 98 | logical core: 290
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 3 / 96 | physical core: 99 | logical core: 291
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 4 / 96 | physical core: 100 | logical core: 292
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 5 / 96 | physical core: 101 | logical core: 101
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 6 / 96 | physical core: 102 | logical core: 294
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 7 / 96 | physical core: 103 | logical core: 103
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 32 / 96 | physical core: 104 | logical core: 104
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 33 / 96 | physical core: 105 | logical core: 105
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 34 / 96 | physical core: 106 | logical core: 106
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 35 / 96 | physical core: 107 | logical core: 107
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 36 / 96 | physical core: 108 | logical core: 108
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 37 / 96 | physical core: 109 | logical core: 301
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 38 / 96 | physical core: 110 | logical core: 110
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 39 / 96 | physical core: 111 | logical core: 111
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 64 / 96 | physical core: 112 | logical core: 112
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 65 / 96 | physical core: 113 | logical core: 113
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 66 / 96 | physical core: 114 | logical core: 114
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 67 / 96 | physical core: 115 | logical core: 307
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 68 / 96 | physical core: 116 | logical core: 116
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 69 / 96 | physical core: 117 | logical core: 117
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 70 / 96 | physical core: 118 | logical core: 118
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 71 / 96 | physical core: 119 | logical core: 119
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 16 / 96 | physical core: 120 | logical core: 120
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 17 / 96 | physical core: 121 | logical core: 121
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 18 / 96 | physical core: 122 | logical core: 122
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 19 / 96 | physical core: 123 | logical core: 315
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 20 / 96 | physical core: 124 | logical core: 316
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 21 / 96 | physical core: 125 | logical core: 317
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 22 / 96 | physical core: 126 | logical core: 318
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 23 / 96 | physical core: 127 | logical core: 319
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 48 / 96 | physical core: 128 | logical core: 128
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 49 / 96 | physical core: 129 | logical core: 321
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 50 / 96 | physical core: 130 | logical core: 322
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 51 / 96 | physical core: 131 | logical core: 323
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 52 / 96 | physical core: 132 | logical core: 324
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 53 / 96 | physical core: 133 | logical core: 133
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 54 / 96 | physical core: 134 | logical core: 326
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 55 / 96 | physical core: 135 | logical core: 135
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 80 / 96 | physical core: 136 | logical core: 136
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 81 / 96 | physical core: 137 | logical core: 329
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 82 / 96 | physical core: 138 | logical core: 330
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 83 / 96 | physical core: 139 | logical core: 139
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 84 / 96 | physical core: 140 | logical core: 140
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 85 / 96 | physical core: 141 | logical core: 333
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 86 / 96 | physical core: 142 | logical core: 334
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 87 / 96 | physical core: 143 | logical core: 335
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 24 / 96 | physical core: 144 | logical core: 144
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 25 / 96 | physical core: 145 | logical core: 145
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 26 / 96 | physical core: 146 | logical core: 338
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 27 / 96 | physical core: 147 | logical core: 339
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 28 / 96 | physical core: 148 | logical core: 148
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 29 / 96 | physical core: 149 | logical core: 149
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 30 / 96 | physical core: 150 | logical core: 342
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 31 / 96 | physical core: 151 | logical core: 151
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 56 / 96 | physical core: 152 | logical core: 344
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 57 / 96 | physical core: 153 | logical core: 345
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 58 / 96 | physical core: 154 | logical core: 154
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 59 / 96 | physical core: 155 | logical core: 347
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 60 / 96 | physical core: 156 | logical core: 156
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 61 / 96 | physical core: 157 | logical core: 349
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 62 / 96 | physical core: 158 | logical core: 350
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 63 / 96 | physical core: 159 | logical core: 351
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 88 / 96 | physical core: 160 | logical core: 160
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 89 / 96 | physical core: 161 | logical core: 353
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 90 / 96 | physical core: 162 | logical core: 162
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 91 / 96 | physical core: 163 | logical core: 163
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 92 / 96 | physical core: 164 | logical core: 356
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 93 / 96 | physical core: 165 | logical core: 165
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 94 / 96 | physical core: 166 | logical core: 358
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 95 / 96 | physical core: 167 | logical core: 359
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 8 / 96 | physical core: 168 | logical core: 168
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 9 / 96 | physical core: 169 | logical core: 361
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 10 / 96 | physical core: 170 | logical core: 170
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 11 / 96 | physical core: 171 | logical core: 171
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 12 / 96 | physical core: 172 | logical core: 172
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 13 / 96 | physical core: 173 | logical core: 365
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 14 / 96 | physical core: 174 | logical core: 174
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 15 / 96 | physical core: 175 | logical core: 175
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 40 / 96 | physical core: 176 | logical core: 176
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 41 / 96 | physical core: 177 | logical core: 369
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 42 / 96 | physical core: 178 | logical core: 178
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 43 / 96 | physical core: 179 | logical core: 179
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 44 / 96 | physical core: 180 | logical core: 180
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 45 / 96 | physical core: 181 | logical core: 181
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 46 / 96 | physical core: 182 | logical core: 374
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 47 / 96 | physical core: 183 | logical core: 183
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 72 / 96 | physical core: 184 | logical core: 184
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 73 / 96 | physical core: 185 | logical core: 377
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 74 / 96 | physical core: 186 | logical core: 186
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 75 / 96 | physical core: 187 | logical core: 187
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 76 / 96 | physical core: 188 | logical core: 188
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 77 / 96 | physical core: 189 | logical core: 189
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 78 / 96 | physical core: 190 | logical core: 382
node: hk2n1104.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 79 / 96 | physical core: 191 | logical core: 383

Download: hk2_one-mpi-task-per-socket_hyperthreading.sh

# Load modules
module load OpenMPI

# Compile source code
mpic++ -fopenmp -lhwloc hello-world_mpi+omp.cpp -o hello-world_mpi+omp_openmpi

export OMP_NUM_THREADS=${SLURM_CPUS_PER_TASK}
export OMP_PLACES=threads
export OMP_PROC_BIND=TRUE

mpirun --map-by package --bind-to package ./hello-world_mpi+omp_openmpi

Expected output

$ cat hello-world_mpi+omp_openmpi_one-mpi-task-per-socket_hyperthreading_121746.out | grep localdomain | sort -n -k 16
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 0 / 192 | physical core: 0 | logical core: 0
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 1 / 192 | physical core: 0 | logical core: 192
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 2 / 192 | physical core: 1 | logical core: 1
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 3 / 192 | physical core: 1 | logical core: 193
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 4 / 192 | physical core: 2 | logical core: 2
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 5 / 192 | physical core: 2 | logical core: 194
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 6 / 192 | physical core: 3 | logical core: 3
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 7 / 192 | physical core: 3 | logical core: 195
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 8 / 192 | physical core: 4 | logical core: 4
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 9 / 192 | physical core: 4 | logical core: 196
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 10 / 192 | physical core: 5 | logical core: 5
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 11 / 192 | physical core: 5 | logical core: 197
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 12 / 192 | physical core: 6 | logical core: 6
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 13 / 192 | physical core: 6 | logical core: 198
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 14 / 192 | physical core: 7 | logical core: 7
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 15 / 192 | physical core: 7 | logical core: 199
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 64 / 192 | physical core: 8 | logical core: 8
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 65 / 192 | physical core: 8 | logical core: 200
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 66 / 192 | physical core: 9 | logical core: 9
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 67 / 192 | physical core: 9 | logical core: 201
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 68 / 192 | physical core: 10 | logical core: 10
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 69 / 192 | physical core: 10 | logical core: 202
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 70 / 192 | physical core: 11 | logical core: 11
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 71 / 192 | physical core: 11 | logical core: 203
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 72 / 192 | physical core: 12 | logical core: 12
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 73 / 192 | physical core: 12 | logical core: 204
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 74 / 192 | physical core: 13 | logical core: 13
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 75 / 192 | physical core: 13 | logical core: 205
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 76 / 192 | physical core: 14 | logical core: 14
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 77 / 192 | physical core: 14 | logical core: 206
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 78 / 192 | physical core: 15 | logical core: 15
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 79 / 192 | physical core: 15 | logical core: 207
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 128 / 192 | physical core: 16 | logical core: 16
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 129 / 192 | physical core: 16 | logical core: 208
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 130 / 192 | physical core: 17 | logical core: 17
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 131 / 192 | physical core: 17 | logical core: 209
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 132 / 192 | physical core: 18 | logical core: 18
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 133 / 192 | physical core: 18 | logical core: 210
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 134 / 192 | physical core: 19 | logical core: 19
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 135 / 192 | physical core: 19 | logical core: 211
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 136 / 192 | physical core: 20 | logical core: 20
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 137 / 192 | physical core: 20 | logical core: 212
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 138 / 192 | physical core: 21 | logical core: 21
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 139 / 192 | physical core: 21 | logical core: 213
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 140 / 192 | physical core: 22 | logical core: 22
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 141 / 192 | physical core: 22 | logical core: 214
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 142 / 192 | physical core: 23 | logical core: 23
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 143 / 192 | physical core: 23 | logical core: 215
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 32 / 192 | physical core: 24 | logical core: 24
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 33 / 192 | physical core: 24 | logical core: 216
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 34 / 192 | physical core: 25 | logical core: 25
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 35 / 192 | physical core: 25 | logical core: 217
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 36 / 192 | physical core: 26 | logical core: 26
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 37 / 192 | physical core: 26 | logical core: 218
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 38 / 192 | physical core: 27 | logical core: 27
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 39 / 192 | physical core: 27 | logical core: 219
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 40 / 192 | physical core: 28 | logical core: 28
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 41 / 192 | physical core: 28 | logical core: 220
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 42 / 192 | physical core: 29 | logical core: 29
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 43 / 192 | physical core: 29 | logical core: 221
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 44 / 192 | physical core: 30 | logical core: 30
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 45 / 192 | physical core: 30 | logical core: 222
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 46 / 192 | physical core: 31 | logical core: 31
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 47 / 192 | physical core: 31 | logical core: 223
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 96 / 192 | physical core: 32 | logical core: 32
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 97 / 192 | physical core: 32 | logical core: 224
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 98 / 192 | physical core: 33 | logical core: 33
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 99 / 192 | physical core: 33 | logical core: 225
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 100 / 192 | physical core: 34 | logical core: 34
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 101 / 192 | physical core: 34 | logical core: 226
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 102 / 192 | physical core: 35 | logical core: 35
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 103 / 192 | physical core: 35 | logical core: 227
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 104 / 192 | physical core: 36 | logical core: 36
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 105 / 192 | physical core: 36 | logical core: 228
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 106 / 192 | physical core: 37 | logical core: 37
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 107 / 192 | physical core: 37 | logical core: 229
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 108 / 192 | physical core: 38 | logical core: 38
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 109 / 192 | physical core: 38 | logical core: 230
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 110 / 192 | physical core: 39 | logical core: 39
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 111 / 192 | physical core: 39 | logical core: 231
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 160 / 192 | physical core: 40 | logical core: 40
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 161 / 192 | physical core: 40 | logical core: 232
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 162 / 192 | physical core: 41 | logical core: 41
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 163 / 192 | physical core: 41 | logical core: 233
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 164 / 192 | physical core: 42 | logical core: 42
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 165 / 192 | physical core: 42 | logical core: 234
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 166 / 192 | physical core: 43 | logical core: 43
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 167 / 192 | physical core: 43 | logical core: 235
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 168 / 192 | physical core: 44 | logical core: 44
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 169 / 192 | physical core: 44 | logical core: 236
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 170 / 192 | physical core: 45 | logical core: 45
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 171 / 192 | physical core: 45 | logical core: 237
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 172 / 192 | physical core: 46 | logical core: 46
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 173 / 192 | physical core: 46 | logical core: 238
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 174 / 192 | physical core: 47 | logical core: 47
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 175 / 192 | physical core: 47 | logical core: 239
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 48 / 192 | physical core: 48 | logical core: 48
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 49 / 192 | physical core: 48 | logical core: 240
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 50 / 192 | physical core: 49 | logical core: 49
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 51 / 192 | physical core: 49 | logical core: 241
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 52 / 192 | physical core: 50 | logical core: 50
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 53 / 192 | physical core: 50 | logical core: 242
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 54 / 192 | physical core: 51 | logical core: 51
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 55 / 192 | physical core: 51 | logical core: 243
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 56 / 192 | physical core: 52 | logical core: 52
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 57 / 192 | physical core: 52 | logical core: 244
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 58 / 192 | physical core: 53 | logical core: 53
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 59 / 192 | physical core: 53 | logical core: 245
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 60 / 192 | physical core: 54 | logical core: 54
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 61 / 192 | physical core: 54 | logical core: 246
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 62 / 192 | physical core: 55 | logical core: 55
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 63 / 192 | physical core: 55 | logical core: 247
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 112 / 192 | physical core: 56 | logical core: 56
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 113 / 192 | physical core: 56 | logical core: 248
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 114 / 192 | physical core: 57 | logical core: 57
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 115 / 192 | physical core: 57 | logical core: 249
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 116 / 192 | physical core: 58 | logical core: 58
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 117 / 192 | physical core: 58 | logical core: 250
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 118 / 192 | physical core: 59 | logical core: 59
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 119 / 192 | physical core: 59 | logical core: 251
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 120 / 192 | physical core: 60 | logical core: 60
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 121 / 192 | physical core: 60 | logical core: 252
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 122 / 192 | physical core: 61 | logical core: 61
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 123 / 192 | physical core: 61 | logical core: 253
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 124 / 192 | physical core: 62 | logical core: 62
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 125 / 192 | physical core: 62 | logical core: 254
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 126 / 192 | physical core: 63 | logical core: 63
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 127 / 192 | physical core: 63 | logical core: 255
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 176 / 192 | physical core: 64 | logical core: 64
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 177 / 192 | physical core: 64 | logical core: 256
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 178 / 192 | physical core: 65 | logical core: 65
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 179 / 192 | physical core: 65 | logical core: 257
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 180 / 192 | physical core: 66 | logical core: 66
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 181 / 192 | physical core: 66 | logical core: 258
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 182 / 192 | physical core: 67 | logical core: 67
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 183 / 192 | physical core: 67 | logical core: 259
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 184 / 192 | physical core: 68 | logical core: 68
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 185 / 192 | physical core: 68 | logical core: 260
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 186 / 192 | physical core: 69 | logical core: 69
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 187 / 192 | physical core: 69 | logical core: 261
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 188 / 192 | physical core: 70 | logical core: 70
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 189 / 192 | physical core: 70 | logical core: 262
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 190 / 192 | physical core: 71 | logical core: 71
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 191 / 192 | physical core: 71 | logical core: 263
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 16 / 192 | physical core: 72 | logical core: 72
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 17 / 192 | physical core: 72 | logical core: 264
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 18 / 192 | physical core: 73 | logical core: 73
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 19 / 192 | physical core: 73 | logical core: 265
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 20 / 192 | physical core: 74 | logical core: 74
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 21 / 192 | physical core: 74 | logical core: 266
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 22 / 192 | physical core: 75 | logical core: 75
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 23 / 192 | physical core: 75 | logical core: 267
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 24 / 192 | physical core: 76 | logical core: 76
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 25 / 192 | physical core: 76 | logical core: 268
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 26 / 192 | physical core: 77 | logical core: 77
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 27 / 192 | physical core: 77 | logical core: 269
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 28 / 192 | physical core: 78 | logical core: 78
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 29 / 192 | physical core: 78 | logical core: 270
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 30 / 192 | physical core: 79 | logical core: 79
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 31 / 192 | physical core: 79 | logical core: 271
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 80 / 192 | physical core: 80 | logical core: 80
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 81 / 192 | physical core: 80 | logical core: 272
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 82 / 192 | physical core: 81 | logical core: 81
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 83 / 192 | physical core: 81 | logical core: 273
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 84 / 192 | physical core: 82 | logical core: 82
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 85 / 192 | physical core: 82 | logical core: 274
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 86 / 192 | physical core: 83 | logical core: 83
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 87 / 192 | physical core: 83 | logical core: 275
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 88 / 192 | physical core: 84 | logical core: 84
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 89 / 192 | physical core: 84 | logical core: 276
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 90 / 192 | physical core: 85 | logical core: 85
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 91 / 192 | physical core: 85 | logical core: 277
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 92 / 192 | physical core: 86 | logical core: 86
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 93 / 192 | physical core: 86 | logical core: 278
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 94 / 192 | physical core: 87 | logical core: 87
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 95 / 192 | physical core: 87 | logical core: 279
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 144 / 192 | physical core: 88 | logical core: 88
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 145 / 192 | physical core: 88 | logical core: 280
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 146 / 192 | physical core: 89 | logical core: 89
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 147 / 192 | physical core: 89 | logical core: 281
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 148 / 192 | physical core: 90 | logical core: 90
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 149 / 192 | physical core: 90 | logical core: 282
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 150 / 192 | physical core: 91 | logical core: 91
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 151 / 192 | physical core: 91 | logical core: 283
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 152 / 192 | physical core: 92 | logical core: 92
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 153 / 192 | physical core: 92 | logical core: 284
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 154 / 192 | physical core: 93 | logical core: 93
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 155 / 192 | physical core: 93 | logical core: 285
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 156 / 192 | physical core: 94 | logical core: 94
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 157 / 192 | physical core: 94 | logical core: 286
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 158 / 192 | physical core: 95 | logical core: 95
node: hk2n1024.localdomain | MPI-task: 0 / 2 | OpenMP-thread: 159 / 192 | physical core: 95 | logical core: 287
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 0 / 192 | physical core: 96 | logical core: 96
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 1 / 192 | physical core: 96 | logical core: 288
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 2 / 192 | physical core: 97 | logical core: 97
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 3 / 192 | physical core: 97 | logical core: 289
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 4 / 192 | physical core: 98 | logical core: 98
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 5 / 192 | physical core: 98 | logical core: 290
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 6 / 192 | physical core: 99 | logical core: 99
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 7 / 192 | physical core: 99 | logical core: 291
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 8 / 192 | physical core: 100 | logical core: 100
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 9 / 192 | physical core: 100 | logical core: 292
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 10 / 192 | physical core: 101 | logical core: 101
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 11 / 192 | physical core: 101 | logical core: 293
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 12 / 192 | physical core: 102 | logical core: 102
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 13 / 192 | physical core: 102 | logical core: 294
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 14 / 192 | physical core: 103 | logical core: 103
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 15 / 192 | physical core: 103 | logical core: 295
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 64 / 192 | physical core: 104 | logical core: 104
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 65 / 192 | physical core: 104 | logical core: 296
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 66 / 192 | physical core: 105 | logical core: 105
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 67 / 192 | physical core: 105 | logical core: 297
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 68 / 192 | physical core: 106 | logical core: 106
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 69 / 192 | physical core: 106 | logical core: 298
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 70 / 192 | physical core: 107 | logical core: 107
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 71 / 192 | physical core: 107 | logical core: 299
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 72 / 192 | physical core: 108 | logical core: 108
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 73 / 192 | physical core: 108 | logical core: 300
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 74 / 192 | physical core: 109 | logical core: 109
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 75 / 192 | physical core: 109 | logical core: 301
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 76 / 192 | physical core: 110 | logical core: 110
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 77 / 192 | physical core: 110 | logical core: 302
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 78 / 192 | physical core: 111 | logical core: 111
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 79 / 192 | physical core: 111 | logical core: 303
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 128 / 192 | physical core: 112 | logical core: 112
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 129 / 192 | physical core: 112 | logical core: 304
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 130 / 192 | physical core: 113 | logical core: 113
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 131 / 192 | physical core: 113 | logical core: 305
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 132 / 192 | physical core: 114 | logical core: 114
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 133 / 192 | physical core: 114 | logical core: 306
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 134 / 192 | physical core: 115 | logical core: 115
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 135 / 192 | physical core: 115 | logical core: 307
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 136 / 192 | physical core: 116 | logical core: 116
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 137 / 192 | physical core: 116 | logical core: 308
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 138 / 192 | physical core: 117 | logical core: 117
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 139 / 192 | physical core: 117 | logical core: 309
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 140 / 192 | physical core: 118 | logical core: 118
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 141 / 192 | physical core: 118 | logical core: 310
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 142 / 192 | physical core: 119 | logical core: 119
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 143 / 192 | physical core: 119 | logical core: 311
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 32 / 192 | physical core: 120 | logical core: 120
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 33 / 192 | physical core: 120 | logical core: 312
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 34 / 192 | physical core: 121 | logical core: 121
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 35 / 192 | physical core: 121 | logical core: 313
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 36 / 192 | physical core: 122 | logical core: 122
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 37 / 192 | physical core: 122 | logical core: 314
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 38 / 192 | physical core: 123 | logical core: 123
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 39 / 192 | physical core: 123 | logical core: 315
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 40 / 192 | physical core: 124 | logical core: 124
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 41 / 192 | physical core: 124 | logical core: 316
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 42 / 192 | physical core: 125 | logical core: 125
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 43 / 192 | physical core: 125 | logical core: 317
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 44 / 192 | physical core: 126 | logical core: 126
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 45 / 192 | physical core: 126 | logical core: 318
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 46 / 192 | physical core: 127 | logical core: 127
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 47 / 192 | physical core: 127 | logical core: 319
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 96 / 192 | physical core: 128 | logical core: 128
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 97 / 192 | physical core: 128 | logical core: 320
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 98 / 192 | physical core: 129 | logical core: 129
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 99 / 192 | physical core: 129 | logical core: 321
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 100 / 192 | physical core: 130 | logical core: 130
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 101 / 192 | physical core: 130 | logical core: 322
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 102 / 192 | physical core: 131 | logical core: 131
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 103 / 192 | physical core: 131 | logical core: 323
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 104 / 192 | physical core: 132 | logical core: 132
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 105 / 192 | physical core: 132 | logical core: 324
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 106 / 192 | physical core: 133 | logical core: 133
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 107 / 192 | physical core: 133 | logical core: 325
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 108 / 192 | physical core: 134 | logical core: 134
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 109 / 192 | physical core: 134 | logical core: 326
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 110 / 192 | physical core: 135 | logical core: 135
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 111 / 192 | physical core: 135 | logical core: 327
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 160 / 192 | physical core: 136 | logical core: 136
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 161 / 192 | physical core: 136 | logical core: 328
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 162 / 192 | physical core: 137 | logical core: 137
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 163 / 192 | physical core: 137 | logical core: 329
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 164 / 192 | physical core: 138 | logical core: 138
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 165 / 192 | physical core: 138 | logical core: 330
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 166 / 192 | physical core: 139 | logical core: 139
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 167 / 192 | physical core: 139 | logical core: 331
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 168 / 192 | physical core: 140 | logical core: 140
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 169 / 192 | physical core: 140 | logical core: 332
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 170 / 192 | physical core: 141 | logical core: 141
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 171 / 192 | physical core: 141 | logical core: 333
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 172 / 192 | physical core: 142 | logical core: 142
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 173 / 192 | physical core: 142 | logical core: 334
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 174 / 192 | physical core: 143 | logical core: 143
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 175 / 192 | physical core: 143 | logical core: 335
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 48 / 192 | physical core: 144 | logical core: 144
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 49 / 192 | physical core: 144 | logical core: 336
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 50 / 192 | physical core: 145 | logical core: 145
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 51 / 192 | physical core: 145 | logical core: 337
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 52 / 192 | physical core: 146 | logical core: 146
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 53 / 192 | physical core: 146 | logical core: 338
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 54 / 192 | physical core: 147 | logical core: 147
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 55 / 192 | physical core: 147 | logical core: 339
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 56 / 192 | physical core: 148 | logical core: 148
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 57 / 192 | physical core: 148 | logical core: 340
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 58 / 192 | physical core: 149 | logical core: 149
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 59 / 192 | physical core: 149 | logical core: 341
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 60 / 192 | physical core: 150 | logical core: 150
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 61 / 192 | physical core: 150 | logical core: 342
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 62 / 192 | physical core: 151 | logical core: 151
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 63 / 192 | physical core: 151 | logical core: 343
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 112 / 192 | physical core: 152 | logical core: 152
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 113 / 192 | physical core: 152 | logical core: 344
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 114 / 192 | physical core: 153 | logical core: 153
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 115 / 192 | physical core: 153 | logical core: 345
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 116 / 192 | physical core: 154 | logical core: 154
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 117 / 192 | physical core: 154 | logical core: 346
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 118 / 192 | physical core: 155 | logical core: 155
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 119 / 192 | physical core: 155 | logical core: 347
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 120 / 192 | physical core: 156 | logical core: 156
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 121 / 192 | physical core: 156 | logical core: 348
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 122 / 192 | physical core: 157 | logical core: 157
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 123 / 192 | physical core: 157 | logical core: 349
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 124 / 192 | physical core: 158 | logical core: 158
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 125 / 192 | physical core: 158 | logical core: 350
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 126 / 192 | physical core: 159 | logical core: 159
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 127 / 192 | physical core: 159 | logical core: 351
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 176 / 192 | physical core: 160 | logical core: 160
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 177 / 192 | physical core: 160 | logical core: 352
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 178 / 192 | physical core: 161 | logical core: 161
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 179 / 192 | physical core: 161 | logical core: 353
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 180 / 192 | physical core: 162 | logical core: 162
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 181 / 192 | physical core: 162 | logical core: 354
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 182 / 192 | physical core: 163 | logical core: 163
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 183 / 192 | physical core: 163 | logical core: 355
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 184 / 192 | physical core: 164 | logical core: 164
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 185 / 192 | physical core: 164 | logical core: 356
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 186 / 192 | physical core: 165 | logical core: 165
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 187 / 192 | physical core: 165 | logical core: 357
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 188 / 192 | physical core: 166 | logical core: 166
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 189 / 192 | physical core: 166 | logical core: 358
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 190 / 192 | physical core: 167 | logical core: 167
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 191 / 192 | physical core: 167 | logical core: 359
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 16 / 192 | physical core: 168 | logical core: 168
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 17 / 192 | physical core: 168 | logical core: 360
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 18 / 192 | physical core: 169 | logical core: 169
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 19 / 192 | physical core: 169 | logical core: 361
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 20 / 192 | physical core: 170 | logical core: 170
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 21 / 192 | physical core: 170 | logical core: 362
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 22 / 192 | physical core: 171 | logical core: 171
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 23 / 192 | physical core: 171 | logical core: 363
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 24 / 192 | physical core: 172 | logical core: 172
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 25 / 192 | physical core: 172 | logical core: 364
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 26 / 192 | physical core: 173 | logical core: 173
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 27 / 192 | physical core: 173 | logical core: 365
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 28 / 192 | physical core: 174 | logical core: 174
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 29 / 192 | physical core: 174 | logical core: 366
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 30 / 192 | physical core: 175 | logical core: 175
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 31 / 192 | physical core: 175 | logical core: 367
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 80 / 192 | physical core: 176 | logical core: 176
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 81 / 192 | physical core: 176 | logical core: 368
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 82 / 192 | physical core: 177 | logical core: 177
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 83 / 192 | physical core: 177 | logical core: 369
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 84 / 192 | physical core: 178 | logical core: 178
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 85 / 192 | physical core: 178 | logical core: 370
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 86 / 192 | physical core: 179 | logical core: 179
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 87 / 192 | physical core: 179 | logical core: 371
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 88 / 192 | physical core: 180 | logical core: 180
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 89 / 192 | physical core: 180 | logical core: 372
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 90 / 192 | physical core: 181 | logical core: 181
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 91 / 192 | physical core: 181 | logical core: 373
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 92 / 192 | physical core: 182 | logical core: 182
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 93 / 192 | physical core: 182 | logical core: 374
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 94 / 192 | physical core: 183 | logical core: 183
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 95 / 192 | physical core: 183 | logical core: 375
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 144 / 192 | physical core: 184 | logical core: 184
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 145 / 192 | physical core: 184 | logical core: 376
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 146 / 192 | physical core: 185 | logical core: 185
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 147 / 192 | physical core: 185 | logical core: 377
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 148 / 192 | physical core: 186 | logical core: 186
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 149 / 192 | physical core: 186 | logical core: 378
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 150 / 192 | physical core: 187 | logical core: 187
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 151 / 192 | physical core: 187 | logical core: 379
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 152 / 192 | physical core: 188 | logical core: 188
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 153 / 192 | physical core: 188 | logical core: 380
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 154 / 192 | physical core: 189 | logical core: 189
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 155 / 192 | physical core: 189 | logical core: 381
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 156 / 192 | physical core: 190 | logical core: 190
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 157 / 192 | physical core: 190 | logical core: 382
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 158 / 192 | physical core: 191 | logical core: 191
node: hk2n1024.localdomain | MPI-task: 1 / 2 | OpenMP-thread: 159 / 192 | physical core: 191 | logical core: 383

Download: hk2_two-mpi-tasks-per-socket.sh

# Load modules
module load OpenMPI

# Compile source code
mpic++ -fopenmp -lhwloc hello-world_mpi+omp.cpp -o hello-world_mpi+omp_openmpi

export OMP_NUM_THREADS=${SLURM_CPUS_PER_TASK}
export OMP_PLACES=cores
export OMP_PROC_BIND=TRUE

mpirun --np ${SLURM_NTASKS} --map-by package:PE=48 --bind-to core ./hello-world_mpi+omp_openmpi

Expected output

$ cat hello-world_mpi+omp_openmpi_two-mpi-tasks-per-socket_121752.out | grep localdomain | sort -n -k 16
node: hk2n1024.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 0 / 48 | physical core: 0 | logical core: 192
node: hk2n1024.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 1 / 48 | physical core: 1 | logical core: 1
node: hk2n1024.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 2 / 48 | physical core: 2 | logical core: 2
node: hk2n1024.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 3 / 48 | physical core: 3 | logical core: 3
node: hk2n1024.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 4 / 48 | physical core: 4 | logical core: 4
node: hk2n1024.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 5 / 48 | physical core: 5 | logical core: 5
node: hk2n1024.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 6 / 48 | physical core: 6 | logical core: 198
node: hk2n1024.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 7 / 48 | physical core: 7 | logical core: 199
node: hk2n1024.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 16 / 48 | physical core: 8 | logical core: 200
node: hk2n1024.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 17 / 48 | physical core: 9 | logical core: 201
node: hk2n1024.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 18 / 48 | physical core: 10 | logical core: 10
node: hk2n1024.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 19 / 48 | physical core: 11 | logical core: 11
node: hk2n1024.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 20 / 48 | physical core: 12 | logical core: 12
node: hk2n1024.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 21 / 48 | physical core: 13 | logical core: 205
node: hk2n1024.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 22 / 48 | physical core: 14 | logical core: 14
node: hk2n1024.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 23 / 48 | physical core: 15 | logical core: 15
node: hk2n1024.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 32 / 48 | physical core: 16 | logical core: 16
node: hk2n1024.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 33 / 48 | physical core: 17 | logical core: 17
node: hk2n1024.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 34 / 48 | physical core: 18 | logical core: 18
node: hk2n1024.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 35 / 48 | physical core: 19 | logical core: 19
node: hk2n1024.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 36 / 48 | physical core: 20 | logical core: 20
node: hk2n1024.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 37 / 48 | physical core: 21 | logical core: 213
node: hk2n1024.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 38 / 48 | physical core: 22 | logical core: 22
node: hk2n1024.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 39 / 48 | physical core: 23 | logical core: 23
node: hk2n1024.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 8 / 48 | physical core: 24 | logical core: 216
node: hk2n1024.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 9 / 48 | physical core: 25 | logical core: 25
node: hk2n1024.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 10 / 48 | physical core: 26 | logical core: 26
node: hk2n1024.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 11 / 48 | physical core: 27 | logical core: 27
node: hk2n1024.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 12 / 48 | physical core: 28 | logical core: 220
node: hk2n1024.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 13 / 48 | physical core: 29 | logical core: 221
node: hk2n1024.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 14 / 48 | physical core: 30 | logical core: 222
node: hk2n1024.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 15 / 48 | physical core: 31 | logical core: 223
node: hk2n1024.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 24 / 48 | physical core: 32 | logical core: 224
node: hk2n1024.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 25 / 48 | physical core: 33 | logical core: 33
node: hk2n1024.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 26 / 48 | physical core: 34 | logical core: 226
node: hk2n1024.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 27 / 48 | physical core: 35 | logical core: 35
node: hk2n1024.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 28 / 48 | physical core: 36 | logical core: 228
node: hk2n1024.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 29 / 48 | physical core: 37 | logical core: 229
node: hk2n1024.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 30 / 48 | physical core: 38 | logical core: 38
node: hk2n1024.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 31 / 48 | physical core: 39 | logical core: 39
node: hk2n1024.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 40 / 48 | physical core: 40 | logical core: 40
node: hk2n1024.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 41 / 48 | physical core: 41 | logical core: 233
node: hk2n1024.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 42 / 48 | physical core: 42 | logical core: 42
node: hk2n1024.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 43 / 48 | physical core: 43 | logical core: 43
node: hk2n1024.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 44 / 48 | physical core: 44 | logical core: 236
node: hk2n1024.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 45 / 48 | physical core: 45 | logical core: 237
node: hk2n1024.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 46 / 48 | physical core: 46 | logical core: 238
node: hk2n1024.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 47 / 48 | physical core: 47 | logical core: 239
node: hk2n1024.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 8 / 48 | physical core: 48 | logical core: 240
node: hk2n1024.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 9 / 48 | physical core: 49 | logical core: 241
node: hk2n1024.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 10 / 48 | physical core: 50 | logical core: 50
node: hk2n1024.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 11 / 48 | physical core: 51 | logical core: 243
node: hk2n1024.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 12 / 48 | physical core: 52 | logical core: 244
node: hk2n1024.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 13 / 48 | physical core: 53 | logical core: 53
node: hk2n1024.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 14 / 48 | physical core: 54 | logical core: 246
node: hk2n1024.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 15 / 48 | physical core: 55 | logical core: 247
node: hk2n1024.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 24 / 48 | physical core: 56 | logical core: 56
node: hk2n1024.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 25 / 48 | physical core: 57 | logical core: 249
node: hk2n1024.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 26 / 48 | physical core: 58 | logical core: 250
node: hk2n1024.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 27 / 48 | physical core: 59 | logical core: 251
node: hk2n1024.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 28 / 48 | physical core: 60 | logical core: 60
node: hk2n1024.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 29 / 48 | physical core: 61 | logical core: 61
node: hk2n1024.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 30 / 48 | physical core: 62 | logical core: 62
node: hk2n1024.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 31 / 48 | physical core: 63 | logical core: 255
node: hk2n1024.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 40 / 48 | physical core: 64 | logical core: 256
node: hk2n1024.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 41 / 48 | physical core: 65 | logical core: 65
node: hk2n1024.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 42 / 48 | physical core: 66 | logical core: 66
node: hk2n1024.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 43 / 48 | physical core: 67 | logical core: 67
node: hk2n1024.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 44 / 48 | physical core: 68 | logical core: 260
node: hk2n1024.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 45 / 48 | physical core: 69 | logical core: 69
node: hk2n1024.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 46 / 48 | physical core: 70 | logical core: 262
node: hk2n1024.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 47 / 48 | physical core: 71 | logical core: 263
node: hk2n1024.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 0 / 48 | physical core: 72 | logical core: 72
node: hk2n1024.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 1 / 48 | physical core: 73 | logical core: 265
node: hk2n1024.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 2 / 48 | physical core: 74 | logical core: 74
node: hk2n1024.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 3 / 48 | physical core: 75 | logical core: 267
node: hk2n1024.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 4 / 48 | physical core: 76 | logical core: 76
node: hk2n1024.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 5 / 48 | physical core: 77 | logical core: 77
node: hk2n1024.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 6 / 48 | physical core: 78 | logical core: 270
node: hk2n1024.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 7 / 48 | physical core: 79 | logical core: 271
node: hk2n1024.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 16 / 48 | physical core: 80 | logical core: 80
node: hk2n1024.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 17 / 48 | physical core: 81 | logical core: 81
node: hk2n1024.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 18 / 48 | physical core: 82 | logical core: 274
node: hk2n1024.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 19 / 48 | physical core: 83 | logical core: 275
node: hk2n1024.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 20 / 48 | physical core: 84 | logical core: 276
node: hk2n1024.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 21 / 48 | physical core: 85 | logical core: 277
node: hk2n1024.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 22 / 48 | physical core: 86 | logical core: 86
node: hk2n1024.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 23 / 48 | physical core: 87 | logical core: 279
node: hk2n1024.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 32 / 48 | physical core: 88 | logical core: 88
node: hk2n1024.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 33 / 48 | physical core: 89 | logical core: 89
node: hk2n1024.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 34 / 48 | physical core: 90 | logical core: 90
node: hk2n1024.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 35 / 48 | physical core: 91 | logical core: 91
node: hk2n1024.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 36 / 48 | physical core: 92 | logical core: 92
node: hk2n1024.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 37 / 48 | physical core: 93 | logical core: 93
node: hk2n1024.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 38 / 48 | physical core: 94 | logical core: 286
node: hk2n1024.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 39 / 48 | physical core: 95 | logical core: 95
node: hk2n1024.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 0 / 48 | physical core: 96 | logical core: 288
node: hk2n1024.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 1 / 48 | physical core: 97 | logical core: 97
node: hk2n1024.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 2 / 48 | physical core: 98 | logical core: 98
node: hk2n1024.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 3 / 48 | physical core: 99 | logical core: 291
node: hk2n1024.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 4 / 48 | physical core: 100 | logical core: 292
node: hk2n1024.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 5 / 48 | physical core: 101 | logical core: 293
node: hk2n1024.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 6 / 48 | physical core: 102 | logical core: 102
node: hk2n1024.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 7 / 48 | physical core: 103 | logical core: 103
node: hk2n1024.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 16 / 48 | physical core: 104 | logical core: 296
node: hk2n1024.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 17 / 48 | physical core: 105 | logical core: 297
node: hk2n1024.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 18 / 48 | physical core: 106 | logical core: 106
node: hk2n1024.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 19 / 48 | physical core: 107 | logical core: 107
node: hk2n1024.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 20 / 48 | physical core: 108 | logical core: 108
node: hk2n1024.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 21 / 48 | physical core: 109 | logical core: 301
node: hk2n1024.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 22 / 48 | physical core: 110 | logical core: 302
node: hk2n1024.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 23 / 48 | physical core: 111 | logical core: 303
node: hk2n1024.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 32 / 48 | physical core: 112 | logical core: 304
node: hk2n1024.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 33 / 48 | physical core: 113 | logical core: 305
node: hk2n1024.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 34 / 48 | physical core: 114 | logical core: 306
node: hk2n1024.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 35 / 48 | physical core: 115 | logical core: 307
node: hk2n1024.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 36 / 48 | physical core: 116 | logical core: 116
node: hk2n1024.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 37 / 48 | physical core: 117 | logical core: 117
node: hk2n1024.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 38 / 48 | physical core: 118 | logical core: 310
node: hk2n1024.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 39 / 48 | physical core: 119 | logical core: 119
node: hk2n1024.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 8 / 48 | physical core: 120 | logical core: 312
node: hk2n1024.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 9 / 48 | physical core: 121 | logical core: 121
node: hk2n1024.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 10 / 48 | physical core: 122 | logical core: 122
node: hk2n1024.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 11 / 48 | physical core: 123 | logical core: 315
node: hk2n1024.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 12 / 48 | physical core: 124 | logical core: 316
node: hk2n1024.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 13 / 48 | physical core: 125 | logical core: 125
node: hk2n1024.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 14 / 48 | physical core: 126 | logical core: 126
node: hk2n1024.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 15 / 48 | physical core: 127 | logical core: 127
node: hk2n1024.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 24 / 48 | physical core: 128 | logical core: 128
node: hk2n1024.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 25 / 48 | physical core: 129 | logical core: 129
node: hk2n1024.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 26 / 48 | physical core: 130 | logical core: 130
node: hk2n1024.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 27 / 48 | physical core: 131 | logical core: 131
node: hk2n1024.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 28 / 48 | physical core: 132 | logical core: 324
node: hk2n1024.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 29 / 48 | physical core: 133 | logical core: 133
node: hk2n1024.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 30 / 48 | physical core: 134 | logical core: 134
node: hk2n1024.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 31 / 48 | physical core: 135 | logical core: 135
node: hk2n1024.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 40 / 48 | physical core: 136 | logical core: 136
node: hk2n1024.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 41 / 48 | physical core: 137 | logical core: 329
node: hk2n1024.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 42 / 48 | physical core: 138 | logical core: 138
node: hk2n1024.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 43 / 48 | physical core: 139 | logical core: 331
node: hk2n1024.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 44 / 48 | physical core: 140 | logical core: 332
node: hk2n1024.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 45 / 48 | physical core: 141 | logical core: 333
node: hk2n1024.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 46 / 48 | physical core: 142 | logical core: 334
node: hk2n1024.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 47 / 48 | physical core: 143 | logical core: 335
node: hk2n1024.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 8 / 48 | physical core: 144 | logical core: 144
node: hk2n1024.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 9 / 48 | physical core: 145 | logical core: 337
node: hk2n1024.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 10 / 48 | physical core: 146 | logical core: 146
node: hk2n1024.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 11 / 48 | physical core: 147 | logical core: 339
node: hk2n1024.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 12 / 48 | physical core: 148 | logical core: 148
node: hk2n1024.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 13 / 48 | physical core: 149 | logical core: 341
node: hk2n1024.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 14 / 48 | physical core: 150 | logical core: 342
node: hk2n1024.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 15 / 48 | physical core: 151 | logical core: 343
node: hk2n1024.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 24 / 48 | physical core: 152 | logical core: 344
node: hk2n1024.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 25 / 48 | physical core: 153 | logical core: 345
node: hk2n1024.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 26 / 48 | physical core: 154 | logical core: 346
node: hk2n1024.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 27 / 48 | physical core: 155 | logical core: 155
node: hk2n1024.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 28 / 48 | physical core: 156 | logical core: 156
node: hk2n1024.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 29 / 48 | physical core: 157 | logical core: 349
node: hk2n1024.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 30 / 48 | physical core: 158 | logical core: 158
node: hk2n1024.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 31 / 48 | physical core: 159 | logical core: 351
node: hk2n1024.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 40 / 48 | physical core: 160 | logical core: 352
node: hk2n1024.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 41 / 48 | physical core: 161 | logical core: 353
node: hk2n1024.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 42 / 48 | physical core: 162 | logical core: 354
node: hk2n1024.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 43 / 48 | physical core: 163 | logical core: 163
node: hk2n1024.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 44 / 48 | physical core: 164 | logical core: 356
node: hk2n1024.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 45 / 48 | physical core: 165 | logical core: 165
node: hk2n1024.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 46 / 48 | physical core: 166 | logical core: 166
node: hk2n1024.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 47 / 48 | physical core: 167 | logical core: 167
node: hk2n1024.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 0 / 48 | physical core: 168 | logical core: 360
node: hk2n1024.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 1 / 48 | physical core: 169 | logical core: 169
node: hk2n1024.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 2 / 48 | physical core: 170 | logical core: 362
node: hk2n1024.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 3 / 48 | physical core: 171 | logical core: 363
node: hk2n1024.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 4 / 48 | physical core: 172 | logical core: 172
node: hk2n1024.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 5 / 48 | physical core: 173 | logical core: 365
node: hk2n1024.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 6 / 48 | physical core: 174 | logical core: 174
node: hk2n1024.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 7 / 48 | physical core: 175 | logical core: 367
node: hk2n1024.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 16 / 48 | physical core: 176 | logical core: 368
node: hk2n1024.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 17 / 48 | physical core: 177 | logical core: 177
node: hk2n1024.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 18 / 48 | physical core: 178 | logical core: 178
node: hk2n1024.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 19 / 48 | physical core: 179 | logical core: 371
node: hk2n1024.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 20 / 48 | physical core: 180 | logical core: 180
node: hk2n1024.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 21 / 48 | physical core: 181 | logical core: 373
node: hk2n1024.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 22 / 48 | physical core: 182 | logical core: 374
node: hk2n1024.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 23 / 48 | physical core: 183 | logical core: 375
node: hk2n1024.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 32 / 48 | physical core: 184 | logical core: 184
node: hk2n1024.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 33 / 48 | physical core: 185 | logical core: 185
node: hk2n1024.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 34 / 48 | physical core: 186 | logical core: 186
node: hk2n1024.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 35 / 48 | physical core: 187 | logical core: 187
node: hk2n1024.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 36 / 48 | physical core: 188 | logical core: 188
node: hk2n1024.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 37 / 48 | physical core: 189 | logical core: 381
node: hk2n1024.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 38 / 48 | physical core: 190 | logical core: 382
node: hk2n1024.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 39 / 48 | physical core: 191 | logical core: 383

Download: hk2_two-mpi-tasks-per-socket_hyperthreading.sh

# Load modules
module load OpenMPI

# Compile source code
mpic++ -fopenmp -lhwloc hello-world_mpi+omp.cpp -o hello-world_mpi+omp_openmpi

export OMP_NUM_THREADS=${SLURM_CPUS_PER_TASK}
export OMP_PLACES=threads
export OMP_PROC_BIND=TRUE

mpirun --np ${SLURM_NTASKS} --map-by package:PE=96 --bind-to hwthread ./hello-world_mpi+omp_openmpi

Expected output

$ cat hello-world_mpi+omp_openmpi_two-mpi-tasks-per-socket_hyperthreading_121750.out | grep localdomain | sort -n -k 16
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 0 / 96 | physical core: 0 | logical core: 0
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 1 / 96 | physical core: 0 | logical core: 192
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 2 / 96 | physical core: 1 | logical core: 1
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 3 / 96 | physical core: 1 | logical core: 193
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 4 / 96 | physical core: 2 | logical core: 2
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 5 / 96 | physical core: 2 | logical core: 194
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 6 / 96 | physical core: 3 | logical core: 3
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 7 / 96 | physical core: 3 | logical core: 195
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 8 / 96 | physical core: 4 | logical core: 4
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 9 / 96 | physical core: 4 | logical core: 196
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 10 / 96 | physical core: 5 | logical core: 5
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 11 / 96 | physical core: 5 | logical core: 197
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 12 / 96 | physical core: 6 | logical core: 6
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 13 / 96 | physical core: 6 | logical core: 198
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 14 / 96 | physical core: 7 | logical core: 7
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 15 / 96 | physical core: 7 | logical core: 199
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 32 / 96 | physical core: 8 | logical core: 8
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 33 / 96 | physical core: 8 | logical core: 200
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 34 / 96 | physical core: 9 | logical core: 9
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 35 / 96 | physical core: 9 | logical core: 201
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 36 / 96 | physical core: 10 | logical core: 10
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 37 / 96 | physical core: 10 | logical core: 202
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 38 / 96 | physical core: 11 | logical core: 11
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 39 / 96 | physical core: 11 | logical core: 203
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 40 / 96 | physical core: 12 | logical core: 12
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 41 / 96 | physical core: 12 | logical core: 204
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 42 / 96 | physical core: 13 | logical core: 13
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 43 / 96 | physical core: 13 | logical core: 205
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 44 / 96 | physical core: 14 | logical core: 14
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 45 / 96 | physical core: 14 | logical core: 206
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 46 / 96 | physical core: 15 | logical core: 15
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 47 / 96 | physical core: 15 | logical core: 207
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 64 / 96 | physical core: 16 | logical core: 16
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 65 / 96 | physical core: 16 | logical core: 208
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 66 / 96 | physical core: 17 | logical core: 17
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 67 / 96 | physical core: 17 | logical core: 209
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 68 / 96 | physical core: 18 | logical core: 18
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 69 / 96 | physical core: 18 | logical core: 210
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 70 / 96 | physical core: 19 | logical core: 19
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 71 / 96 | physical core: 19 | logical core: 211
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 72 / 96 | physical core: 20 | logical core: 20
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 73 / 96 | physical core: 20 | logical core: 212
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 74 / 96 | physical core: 21 | logical core: 21
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 75 / 96 | physical core: 21 | logical core: 213
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 76 / 96 | physical core: 22 | logical core: 22
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 77 / 96 | physical core: 22 | logical core: 214
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 78 / 96 | physical core: 23 | logical core: 23
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 79 / 96 | physical core: 23 | logical core: 215
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 16 / 96 | physical core: 24 | logical core: 24
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 17 / 96 | physical core: 24 | logical core: 216
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 18 / 96 | physical core: 25 | logical core: 25
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 19 / 96 | physical core: 25 | logical core: 217
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 20 / 96 | physical core: 26 | logical core: 26
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 21 / 96 | physical core: 26 | logical core: 218
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 22 / 96 | physical core: 27 | logical core: 27
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 23 / 96 | physical core: 27 | logical core: 219
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 24 / 96 | physical core: 28 | logical core: 28
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 25 / 96 | physical core: 28 | logical core: 220
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 26 / 96 | physical core: 29 | logical core: 29
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 27 / 96 | physical core: 29 | logical core: 221
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 28 / 96 | physical core: 30 | logical core: 30
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 29 / 96 | physical core: 30 | logical core: 222
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 30 / 96 | physical core: 31 | logical core: 31
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 31 / 96 | physical core: 31 | logical core: 223
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 48 / 96 | physical core: 32 | logical core: 32
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 49 / 96 | physical core: 32 | logical core: 224
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 50 / 96 | physical core: 33 | logical core: 33
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 51 / 96 | physical core: 33 | logical core: 225
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 52 / 96 | physical core: 34 | logical core: 34
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 53 / 96 | physical core: 34 | logical core: 226
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 54 / 96 | physical core: 35 | logical core: 35
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 55 / 96 | physical core: 35 | logical core: 227
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 56 / 96 | physical core: 36 | logical core: 36
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 57 / 96 | physical core: 36 | logical core: 228
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 58 / 96 | physical core: 37 | logical core: 37
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 59 / 96 | physical core: 37 | logical core: 229
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 60 / 96 | physical core: 38 | logical core: 38
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 61 / 96 | physical core: 38 | logical core: 230
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 62 / 96 | physical core: 39 | logical core: 39
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 63 / 96 | physical core: 39 | logical core: 231
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 80 / 96 | physical core: 40 | logical core: 40
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 81 / 96 | physical core: 40 | logical core: 232
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 82 / 96 | physical core: 41 | logical core: 41
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 83 / 96 | physical core: 41 | logical core: 233
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 84 / 96 | physical core: 42 | logical core: 42
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 85 / 96 | physical core: 42 | logical core: 234
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 86 / 96 | physical core: 43 | logical core: 43
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 87 / 96 | physical core: 43 | logical core: 235
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 88 / 96 | physical core: 44 | logical core: 44
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 89 / 96 | physical core: 44 | logical core: 236
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 90 / 96 | physical core: 45 | logical core: 45
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 91 / 96 | physical core: 45 | logical core: 237
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 92 / 96 | physical core: 46 | logical core: 46
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 93 / 96 | physical core: 46 | logical core: 238
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 94 / 96 | physical core: 47 | logical core: 47
node: hk2n1139.localdomain | MPI-task: 0 / 4 | OpenMP-thread: 95 / 96 | physical core: 47 | logical core: 239
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 16 / 96 | physical core: 48 | logical core: 48
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 17 / 96 | physical core: 48 | logical core: 240
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 18 / 96 | physical core: 49 | logical core: 49
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 19 / 96 | physical core: 49 | logical core: 241
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 20 / 96 | physical core: 50 | logical core: 50
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 21 / 96 | physical core: 50 | logical core: 242
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 22 / 96 | physical core: 51 | logical core: 51
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 23 / 96 | physical core: 51 | logical core: 243
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 24 / 96 | physical core: 52 | logical core: 52
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 25 / 96 | physical core: 52 | logical core: 244
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 26 / 96 | physical core: 53 | logical core: 53
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 27 / 96 | physical core: 53 | logical core: 245
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 28 / 96 | physical core: 54 | logical core: 54
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 29 / 96 | physical core: 54 | logical core: 246
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 30 / 96 | physical core: 55 | logical core: 55
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 31 / 96 | physical core: 55 | logical core: 247
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 48 / 96 | physical core: 56 | logical core: 56
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 49 / 96 | physical core: 56 | logical core: 248
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 50 / 96 | physical core: 57 | logical core: 57
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 51 / 96 | physical core: 57 | logical core: 249
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 52 / 96 | physical core: 58 | logical core: 58
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 53 / 96 | physical core: 58 | logical core: 250
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 54 / 96 | physical core: 59 | logical core: 59
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 55 / 96 | physical core: 59 | logical core: 251
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 56 / 96 | physical core: 60 | logical core: 60
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 57 / 96 | physical core: 60 | logical core: 252
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 58 / 96 | physical core: 61 | logical core: 61
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 59 / 96 | physical core: 61 | logical core: 253
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 60 / 96 | physical core: 62 | logical core: 62
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 61 / 96 | physical core: 62 | logical core: 254
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 62 / 96 | physical core: 63 | logical core: 63
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 63 / 96 | physical core: 63 | logical core: 255
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 80 / 96 | physical core: 64 | logical core: 64
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 81 / 96 | physical core: 64 | logical core: 256
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 82 / 96 | physical core: 65 | logical core: 65
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 83 / 96 | physical core: 65 | logical core: 257
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 84 / 96 | physical core: 66 | logical core: 66
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 85 / 96 | physical core: 66 | logical core: 258
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 86 / 96 | physical core: 67 | logical core: 67
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 87 / 96 | physical core: 67 | logical core: 259
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 88 / 96 | physical core: 68 | logical core: 68
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 89 / 96 | physical core: 68 | logical core: 260
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 90 / 96 | physical core: 69 | logical core: 69
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 91 / 96 | physical core: 69 | logical core: 261
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 92 / 96 | physical core: 70 | logical core: 70
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 93 / 96 | physical core: 70 | logical core: 262
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 94 / 96 | physical core: 71 | logical core: 71
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 95 / 96 | physical core: 71 | logical core: 263
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 0 / 96 | physical core: 72 | logical core: 72
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 1 / 96 | physical core: 72 | logical core: 264
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 2 / 96 | physical core: 73 | logical core: 73
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 3 / 96 | physical core: 73 | logical core: 265
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 4 / 96 | physical core: 74 | logical core: 74
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 5 / 96 | physical core: 74 | logical core: 266
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 6 / 96 | physical core: 75 | logical core: 75
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 7 / 96 | physical core: 75 | logical core: 267
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 8 / 96 | physical core: 76 | logical core: 76
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 9 / 96 | physical core: 76 | logical core: 268
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 10 / 96 | physical core: 77 | logical core: 77
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 11 / 96 | physical core: 77 | logical core: 269
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 12 / 96 | physical core: 78 | logical core: 78
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 13 / 96 | physical core: 78 | logical core: 270
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 14 / 96 | physical core: 79 | logical core: 79
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 15 / 96 | physical core: 79 | logical core: 271
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 32 / 96 | physical core: 80 | logical core: 80
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 33 / 96 | physical core: 80 | logical core: 272
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 34 / 96 | physical core: 81 | logical core: 81
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 35 / 96 | physical core: 81 | logical core: 273
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 36 / 96 | physical core: 82 | logical core: 82
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 37 / 96 | physical core: 82 | logical core: 274
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 38 / 96 | physical core: 83 | logical core: 83
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 39 / 96 | physical core: 83 | logical core: 275
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 40 / 96 | physical core: 84 | logical core: 84
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 41 / 96 | physical core: 84 | logical core: 276
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 42 / 96 | physical core: 85 | logical core: 85
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 43 / 96 | physical core: 85 | logical core: 277
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 44 / 96 | physical core: 86 | logical core: 86
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 45 / 96 | physical core: 86 | logical core: 278
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 46 / 96 | physical core: 87 | logical core: 87
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 47 / 96 | physical core: 87 | logical core: 279
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 64 / 96 | physical core: 88 | logical core: 88
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 65 / 96 | physical core: 88 | logical core: 280
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 66 / 96 | physical core: 89 | logical core: 89
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 67 / 96 | physical core: 89 | logical core: 281
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 68 / 96 | physical core: 90 | logical core: 90
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 69 / 96 | physical core: 90 | logical core: 282
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 70 / 96 | physical core: 91 | logical core: 91
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 71 / 96 | physical core: 91 | logical core: 283
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 72 / 96 | physical core: 92 | logical core: 92
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 73 / 96 | physical core: 92 | logical core: 284
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 74 / 96 | physical core: 93 | logical core: 93
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 75 / 96 | physical core: 93 | logical core: 285
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 76 / 96 | physical core: 94 | logical core: 94
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 77 / 96 | physical core: 94 | logical core: 286
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 78 / 96 | physical core: 95 | logical core: 95
node: hk2n1139.localdomain | MPI-task: 1 / 4 | OpenMP-thread: 79 / 96 | physical core: 95 | logical core: 287
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 0 / 96 | physical core: 96 | logical core: 96
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 1 / 96 | physical core: 96 | logical core: 288
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 2 / 96 | physical core: 97 | logical core: 97
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 3 / 96 | physical core: 97 | logical core: 289
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 4 / 96 | physical core: 98 | logical core: 98
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 5 / 96 | physical core: 98 | logical core: 290
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 6 / 96 | physical core: 99 | logical core: 99
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 7 / 96 | physical core: 99 | logical core: 291
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 8 / 96 | physical core: 100 | logical core: 100
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 9 / 96 | physical core: 100 | logical core: 292
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 10 / 96 | physical core: 101 | logical core: 101
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 11 / 96 | physical core: 101 | logical core: 293
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 12 / 96 | physical core: 102 | logical core: 102
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 13 / 96 | physical core: 102 | logical core: 294
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 14 / 96 | physical core: 103 | logical core: 103
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 15 / 96 | physical core: 103 | logical core: 295
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 32 / 96 | physical core: 104 | logical core: 104
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 33 / 96 | physical core: 104 | logical core: 296
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 34 / 96 | physical core: 105 | logical core: 105
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 35 / 96 | physical core: 105 | logical core: 297
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 36 / 96 | physical core: 106 | logical core: 106
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 37 / 96 | physical core: 106 | logical core: 298
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 38 / 96 | physical core: 107 | logical core: 107
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 39 / 96 | physical core: 107 | logical core: 299
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 40 / 96 | physical core: 108 | logical core: 108
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 41 / 96 | physical core: 108 | logical core: 300
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 42 / 96 | physical core: 109 | logical core: 109
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 43 / 96 | physical core: 109 | logical core: 301
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 44 / 96 | physical core: 110 | logical core: 110
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 45 / 96 | physical core: 110 | logical core: 302
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 46 / 96 | physical core: 111 | logical core: 111
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 47 / 96 | physical core: 111 | logical core: 303
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 64 / 96 | physical core: 112 | logical core: 112
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 65 / 96 | physical core: 112 | logical core: 304
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 66 / 96 | physical core: 113 | logical core: 113
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 67 / 96 | physical core: 113 | logical core: 305
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 68 / 96 | physical core: 114 | logical core: 114
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 69 / 96 | physical core: 114 | logical core: 306
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 70 / 96 | physical core: 115 | logical core: 115
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 71 / 96 | physical core: 115 | logical core: 307
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 72 / 96 | physical core: 116 | logical core: 116
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 73 / 96 | physical core: 116 | logical core: 308
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 74 / 96 | physical core: 117 | logical core: 117
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 75 / 96 | physical core: 117 | logical core: 309
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 76 / 96 | physical core: 118 | logical core: 118
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 77 / 96 | physical core: 118 | logical core: 310
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 78 / 96 | physical core: 119 | logical core: 119
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 79 / 96 | physical core: 119 | logical core: 311
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 16 / 96 | physical core: 120 | logical core: 120
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 17 / 96 | physical core: 120 | logical core: 312
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 18 / 96 | physical core: 121 | logical core: 121
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 19 / 96 | physical core: 121 | logical core: 313
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 20 / 96 | physical core: 122 | logical core: 122
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 21 / 96 | physical core: 122 | logical core: 314
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 22 / 96 | physical core: 123 | logical core: 123
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 23 / 96 | physical core: 123 | logical core: 315
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 24 / 96 | physical core: 124 | logical core: 124
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 25 / 96 | physical core: 124 | logical core: 316
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 26 / 96 | physical core: 125 | logical core: 125
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 27 / 96 | physical core: 125 | logical core: 317
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 28 / 96 | physical core: 126 | logical core: 126
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 29 / 96 | physical core: 126 | logical core: 318
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 30 / 96 | physical core: 127 | logical core: 127
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 31 / 96 | physical core: 127 | logical core: 319
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 48 / 96 | physical core: 128 | logical core: 128
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 49 / 96 | physical core: 128 | logical core: 320
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 50 / 96 | physical core: 129 | logical core: 129
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 51 / 96 | physical core: 129 | logical core: 321
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 52 / 96 | physical core: 130 | logical core: 130
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 53 / 96 | physical core: 130 | logical core: 322
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 54 / 96 | physical core: 131 | logical core: 131
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 55 / 96 | physical core: 131 | logical core: 323
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 56 / 96 | physical core: 132 | logical core: 132
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 57 / 96 | physical core: 132 | logical core: 324
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 58 / 96 | physical core: 133 | logical core: 133
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 59 / 96 | physical core: 133 | logical core: 325
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 60 / 96 | physical core: 134 | logical core: 134
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 61 / 96 | physical core: 134 | logical core: 326
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 62 / 96 | physical core: 135 | logical core: 135
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 63 / 96 | physical core: 135 | logical core: 327
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 80 / 96 | physical core: 136 | logical core: 136
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 81 / 96 | physical core: 136 | logical core: 328
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 82 / 96 | physical core: 137 | logical core: 137
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 83 / 96 | physical core: 137 | logical core: 329
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 84 / 96 | physical core: 138 | logical core: 138
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 85 / 96 | physical core: 138 | logical core: 330
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 86 / 96 | physical core: 139 | logical core: 139
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 87 / 96 | physical core: 139 | logical core: 331
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 88 / 96 | physical core: 140 | logical core: 140
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 89 / 96 | physical core: 140 | logical core: 332
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 90 / 96 | physical core: 141 | logical core: 141
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 91 / 96 | physical core: 141 | logical core: 333
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 92 / 96 | physical core: 142 | logical core: 142
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 93 / 96 | physical core: 142 | logical core: 334
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 94 / 96 | physical core: 143 | logical core: 143
node: hk2n1139.localdomain | MPI-task: 2 / 4 | OpenMP-thread: 95 / 96 | physical core: 143 | logical core: 335
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 16 / 96 | physical core: 144 | logical core: 144
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 17 / 96 | physical core: 144 | logical core: 336
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 18 / 96 | physical core: 145 | logical core: 145
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 19 / 96 | physical core: 145 | logical core: 337
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 20 / 96 | physical core: 146 | logical core: 146
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 21 / 96 | physical core: 146 | logical core: 338
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 22 / 96 | physical core: 147 | logical core: 147
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 23 / 96 | physical core: 147 | logical core: 339
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 24 / 96 | physical core: 148 | logical core: 148
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 25 / 96 | physical core: 148 | logical core: 340
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 26 / 96 | physical core: 149 | logical core: 149
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 27 / 96 | physical core: 149 | logical core: 341
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 28 / 96 | physical core: 150 | logical core: 150
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 29 / 96 | physical core: 150 | logical core: 342
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 30 / 96 | physical core: 151 | logical core: 151
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 31 / 96 | physical core: 151 | logical core: 343
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 48 / 96 | physical core: 152 | logical core: 152
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 49 / 96 | physical core: 152 | logical core: 344
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 50 / 96 | physical core: 153 | logical core: 153
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 51 / 96 | physical core: 153 | logical core: 345
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 52 / 96 | physical core: 154 | logical core: 154
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 53 / 96 | physical core: 154 | logical core: 346
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 54 / 96 | physical core: 155 | logical core: 155
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 55 / 96 | physical core: 155 | logical core: 347
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 56 / 96 | physical core: 156 | logical core: 156
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 57 / 96 | physical core: 156 | logical core: 348
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 58 / 96 | physical core: 157 | logical core: 157
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 59 / 96 | physical core: 157 | logical core: 349
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 60 / 96 | physical core: 158 | logical core: 158
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 61 / 96 | physical core: 158 | logical core: 350
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 62 / 96 | physical core: 159 | logical core: 159
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 63 / 96 | physical core: 159 | logical core: 351
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 80 / 96 | physical core: 160 | logical core: 160
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 81 / 96 | physical core: 160 | logical core: 352
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 82 / 96 | physical core: 161 | logical core: 161
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 83 / 96 | physical core: 161 | logical core: 353
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 84 / 96 | physical core: 162 | logical core: 162
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 85 / 96 | physical core: 162 | logical core: 354
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 86 / 96 | physical core: 163 | logical core: 163
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 87 / 96 | physical core: 163 | logical core: 355
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 88 / 96 | physical core: 164 | logical core: 164
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 89 / 96 | physical core: 164 | logical core: 356
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 90 / 96 | physical core: 165 | logical core: 165
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 91 / 96 | physical core: 165 | logical core: 357
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 92 / 96 | physical core: 166 | logical core: 166
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 93 / 96 | physical core: 166 | logical core: 358
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 94 / 96 | physical core: 167 | logical core: 167
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 95 / 96 | physical core: 167 | logical core: 359
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 0 / 96 | physical core: 168 | logical core: 168
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 1 / 96 | physical core: 168 | logical core: 360
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 2 / 96 | physical core: 169 | logical core: 169
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 3 / 96 | physical core: 169 | logical core: 361
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 4 / 96 | physical core: 170 | logical core: 170
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 5 / 96 | physical core: 170 | logical core: 362
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 6 / 96 | physical core: 171 | logical core: 171
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 7 / 96 | physical core: 171 | logical core: 363
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 8 / 96 | physical core: 172 | logical core: 172
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 9 / 96 | physical core: 172 | logical core: 364
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 10 / 96 | physical core: 173 | logical core: 173
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 11 / 96 | physical core: 173 | logical core: 365
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 12 / 96 | physical core: 174 | logical core: 174
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 13 / 96 | physical core: 174 | logical core: 366
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 14 / 96 | physical core: 175 | logical core: 175
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 15 / 96 | physical core: 175 | logical core: 367
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 32 / 96 | physical core: 176 | logical core: 176
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 33 / 96 | physical core: 176 | logical core: 368
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 34 / 96 | physical core: 177 | logical core: 177
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 35 / 96 | physical core: 177 | logical core: 369
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 36 / 96 | physical core: 178 | logical core: 178
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 37 / 96 | physical core: 178 | logical core: 370
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 38 / 96 | physical core: 179 | logical core: 179
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 39 / 96 | physical core: 179 | logical core: 371
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 40 / 96 | physical core: 180 | logical core: 180
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 41 / 96 | physical core: 180 | logical core: 372
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 42 / 96 | physical core: 181 | logical core: 181
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 43 / 96 | physical core: 181 | logical core: 373
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 44 / 96 | physical core: 182 | logical core: 182
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 45 / 96 | physical core: 182 | logical core: 374
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 46 / 96 | physical core: 183 | logical core: 183
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 47 / 96 | physical core: 183 | logical core: 375
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 64 / 96 | physical core: 184 | logical core: 184
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 65 / 96 | physical core: 184 | logical core: 376
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 66 / 96 | physical core: 185 | logical core: 185
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 67 / 96 | physical core: 185 | logical core: 377
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 68 / 96 | physical core: 186 | logical core: 186
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 69 / 96 | physical core: 186 | logical core: 378
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 70 / 96 | physical core: 187 | logical core: 187
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 71 / 96 | physical core: 187 | logical core: 379
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 72 / 96 | physical core: 188 | logical core: 188
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 73 / 96 | physical core: 188 | logical core: 380
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 74 / 96 | physical core: 189 | logical core: 189
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 75 / 96 | physical core: 189 | logical core: 381
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 76 / 96 | physical core: 190 | logical core: 190
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 77 / 96 | physical core: 190 | logical core: 382
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 78 / 96 | physical core: 191 | logical core: 191
node: hk2n1139.localdomain | MPI-task: 3 / 4 | OpenMP-thread: 79 / 96 | physical core: 191 | logical core: 383

1 task/socket1 task/socket (HT)2 tasks/socket2 tasks/socket (HT)

Download: hk2_one-mpi-task-per-socket_intel.sh

# Load modules
module load intel

# Compile source code
mpiicpx -qopenmp -lhwloc hello-world_mpi+omp.cpp -o hello-world_mpi+omp_intelmpi

export OMP_NUM_THREADS=${SLURM_CPUS_PER_TASK}
export OMP_PLACES=cores
export OMP_PROC_BIND=TRUE
export I_MPI_PIN_DOMAIN=socket

mpirun ./hello-world_mpi+omp_intelmpi

Download: hk2_one-mpi-task-per-socket_hyperthreading_intel.sh

# Load modules
module load intel

# Compile source code
mpic++ -fopenmp -lhwloc hello-world_mpi+omp.cpp -o hello-world_mpi+omp_openmpi

export OMP_NUM_THREADS=${SLURM_CPUS_PER_TASK}
export OMP_PLACES=threads
export OMP_PROC_BIND=TRUE
export I_MPI_PIN_DOMAIN=socket

mpirun ./hello-world_mpi+omp_intelmpi

Download: hk2_two-mpi-tasks-per-socket_intel.sh

# Load modules
module load intel

# Compile source code
mpiicpx -qopenmp -lhwloc hello-world_mpi+omp.cpp -o hello-world_mpi+omp_intelmpi

export OMP_NUM_THREADS=${SLURM_CPUS_PER_TASK}
export OMP_PLACES=cores
export OMP_PROC_BIND=TRUE
export I_MPI_PIN_PROCESSOR_LIST=allcores:map=bunch

mpirun --np ${SLURM_NTASKS} ./hello-world_mpi+omp_intelmpi

Download: hk2_two-mpi-tasks-per-socket_hyperthreading_intel.sh

# Load modules
module load intel

# Compile source code
mpiicpx -qopenmp -lhwloc hello-world_mpi+omp.cpp -o hello-world_mpi+omp_intelmpi

export OMP_NUM_THREADS=${SLURM_CPUS_PER_TASK}
export OMP_PLACES=threads
export OMP_PROC_BIND=TRUE
export I_MPI_PIN_PROCESSOR_LIST=all:map=spread

mpirun --np ${SLURM_NTASKS} ./hello-world_mpi+omp_intelmpi

Slurm Examples¶

Single-threaded Jobs¶

Multi-threaded (OpenMP) Jobs¶

MPI Jobs¶

Hybrid MPI + OpenMP Jobs¶

GPU Jobs¶

Interactive Jobs¶