This post talks about Reduction operation in MPI using MPI_Allreduce. MPI_Allreduce is a collective communication operation in the Message Passing Interface (MPI) that combines values from all processes in a communicator and distributes the result back to all processes. Syntax for MPI_Allreduce int MPI_Allreduce(const void *sendbuf, void *recvbuf, int count, MPI_Datatype datatype, MPI_Op op, MPI_Comm…

This post talks about MPI_Allgather function in MPI. MPI_Allgather is a collective communication operation in the Message Passing Interface (MPI) that allows all processes in a communicator to gather data from every other process. Unlike MPI_Gather, where only the root process collects the data, in MPI_Allgather, all processes receive the complete data from every other…

This post talks about Reduction operation in MPI using MPI_Gather. MPI_Gather is a collective operation in the Message Passing Interface (MPI) used to collect data from multiple processes and combine it into a single process. Syntax for MPI_Gather int MPI_Gather(const void *sendbuf, int sendcount, MPI_Datatype sendtype, void *recvbuf, int recvcount, MPI_Datatype recvtype, int root, MPI_Comm…

This post talks about an MPI function – MPI_Scatter. MPI_Scatter is a collective operation in the Message Passing Interface (MPI) used in parallel programming. It takes data from a process and distributes chunks to others in a communicator. Syntax for MPI_Scatter int MPI_Scatter(const void *sendbuf, int sendcount, MPI_Datatype sendtype, void *recvbuf, int recvcount, MPI_Datatype recvtype,…

This post talks about Reduction operation in MPI using MPI_Reduce. In reduction operation, each process contributes its local data, and these values are aggregated according to the specified operation such as summation, finding the maximum, or custom-defined functions. Syntax for MPI_Reduce int MPI_Reduce(const void *sendbuf, void *recvbuf, int count, MPI_Datatype datatype, MPI_Op op, int root,…