Utilize este identificador para referenciar este registo:
https://hdl.handle.net/1822/52874
Título: | Design of an RDMA communication middleware for asynchronous shuffling in analytical processing |
Autor(es): | Gonçalves, Rui Carlos Araújo Pereira, José Jimenez-Peris, Ricardo |
Palavras-chave: | Shuffling Analytical Processing Middleware RDMA |
Data: | 2016 |
Editora: | SCITEPRESS |
Resumo(s): | A key component in a distributed parallel analytical processing engine is shuffling, the distribution of data to multiple nodes such that the computation can be done in parallel. In this paper we describe the initial design of a communication middleware to support asynchronous shuffling of data among multiple processes on a distributed memory environment. The proposed middleware relies on RDMA (Remote Direct Memory Access) operations to transfer data, and provides basic operations to send and queue data on remote machines, and to retrieve this queued data. Preliminary results show that the RDMA-based middleware can provide a 75% reduction on communication costs, when compared with a traditional sockets implementation. |
Tipo: | Artigo em ata de conferência |
URI: | https://hdl.handle.net/1822/52874 |
ISBN: | 9789897581823 |
DOI: | 10.5220/0005923703480351 |
Arbitragem científica: | yes |
Acesso: | Acesso restrito UMinho |
Aparece nas coleções: |
Ficheiros deste registo:
Ficheiro | Descrição | Tamanho | Formato | |
---|---|---|---|---|
P-00K-Q20.pdf Acesso restrito! | 124,37 kB | Adobe PDF | Ver/Abrir |