Utilize este identificador para referenciar este registo:
https://hdl.handle.net/1822/89923
Título: | Dynamic management of distributed machine learning projects |
Autor(es): | Oliveira, Filipe Alves, André Moço, Hugo Monteiro, José Oliveira, Óscar Carneiro, Davide Rua Novais, Paulo |
Data: | Abr-2023 |
Editora: | Springer |
Revista: | Studies in Computational Intelligence |
Resumo(s): | Given the new requirements of Machine Learning problems in the last years, especially in what concerns the volume, diversity and speed of data, new approaches are needed to deal with the associated challenges. In this paper we describe CEDEs - a distributed learning system that runs on top of an Hadoop cluster and takes advantage of blocks, replication and balancing. CEDEs trains models in a distributed manner following the principle of data locality, and is able to change parts of the model through an optimization module, thus allowing a model to evolve over time as the data changes. This paper describes its generic architecture, details the implementation of the first modules, and provides a first validation. |
Tipo: | Artigo em ata de conferência |
URI: | https://hdl.handle.net/1822/89923 |
ISBN: | 978-3-031-29103-6 |
e-ISBN: | 978-3-031-29104-3 |
DOI: | 10.1007/978-3-031-29104-3_3 |
ISSN: | 1860-949X |
e-ISSN: | 1860-9503 |
Versão da editora: | https://link.springer.com/chapter/10.1007/978-3-031-29104-3_3 |
Arbitragem científica: | yes |
Acesso: | Acesso aberto |
Aparece nas coleções: |
Ficheiros deste registo:
Ficheiro | Descrição | Tamanho | Formato | |
---|---|---|---|---|
IDC22_Carneiro.pdf | 560,78 kB | Adobe PDF | Ver/Abrir |