Learn Parallel Programming

Sharing knowledge on Parallel Programming

Author: Mandar Gurav

  • Message Passing Interface (MPI) : MPI_Scatter example

    —

    by

    Mandar Gurav
    in

    This post talks about an MPI function – MPI_Scatter. MPI_Scatter is a collective operation in the Message Passing Interface (MPI) used in parallel programming. It takes data from a process and distributes chunks to others in a communicator. Syntax for MPI_Scatter int MPI_Scatter(const void *sendbuf, int sendcount, MPI_Datatype sendtype, void *recvbuf, int recvcount, MPI_Datatype recvtype,…

  • Message Passing Interface (MPI) : MPI_Reduce example

    —

    by

    Mandar Gurav
    in

    This post talks about Reduction operation in MPI using MPI_Reduce. In reduction operation, each process contributes its local data, and these values are aggregated according to the specified operation such as summation, finding the maximum, or custom-defined functions. Syntax for MPI_Reduce int MPI_Reduce(const void *sendbuf, void *recvbuf, int count, MPI_Datatype datatype, MPI_Op op, int root,…

  • Message Passing Interface (MPI) : MPI_Bcast example

    —

    by

    Mandar Gurav
    in

    This post talks about a MPI Broadcast function – MPI_Bcast. Broadcast operation is used to send data from one process to all other processes within a communicator. Every process receives the same data. Syntax for MPI_Bcast int MPI_Bcast(void *buffer, int count, MPI_Datatype datatype, int root, MPI_Comm comm) Input Parameters Input/Output Parameters Example code – To…

  • Nvidia Nsight Systems : Profiling for CUDA code

    —

    by

    Mandar Gurav
    in ,

    In this post we will look at steps involved in profiling of the CUDA code using Nvidia Nsight Systems. Let’s take a simple code which performs some array operations. To compile this code, we can use following command. Please note that I am using “-arch=sm_86” which instructs compiler to generate code for compute capability 8.6…

  • Intel Vtune Profiler GUI : Hotspots profiling for serial C code

    —

    by

    Mandar Gurav
    in

    In this post we will look at steps involved in profiling of the serial code using Intel Vtune Profiler GUI. Let’s take a simple code which performs some array operations. To Profile this code, we need to first compile this code. We can compile this code using GNU compiler or Intel Compiler. OR To Profile…