Recent advances in deep learning facilitate the training, testing, and deployment of models through so-called pipelines. Those pipelines are typically orchestrated with general-purpose machine learning frameworks (e.g., Tensorflow Extended), where developers manually call the single steps for each task-specific application. The diversity of task- and technology-specific requirements in deep learning projects increases the orchestration effort. There are recent advances to automate the orchestration with machine learning, which are however, still immature and do not support task-specific applications. Hence, we claim that partial automation of pipeline orchestration with respect to specific tasks and technologies decreases the overall development effort. We verify this claim with the ALOHA tool flow, where task-specific glue code is automated. The gains of the ALOHA tool flow pipeline are evaluated with respect to human effort, computing performance, and security.

Task-Specific Automation in Deep Learning Processes

Meloni P.
;
Busia P.;Deriu G.;Pintor M.;Biggio B.;
2021-01-01

Abstract

Recent advances in deep learning facilitate the training, testing, and deployment of models through so-called pipelines. Those pipelines are typically orchestrated with general-purpose machine learning frameworks (e.g., Tensorflow Extended), where developers manually call the single steps for each task-specific application. The diversity of task- and technology-specific requirements in deep learning projects increases the orchestration effort. There are recent advances to automate the orchestration with machine learning, which are however, still immature and do not support task-specific applications. Hence, we claim that partial automation of pipeline orchestration with respect to specific tasks and technologies decreases the overall development effort. We verify this claim with the ALOHA tool flow, where task-specific glue code is automated. The gains of the ALOHA tool flow pipeline are evaluated with respect to human effort, computing performance, and security.
2021
978-3-030-87100-0
978-3-030-87101-7
Deep learning
Pipeline
Process
Software engineering
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11584/345359
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 1
  • ???jsp.display-item.citation.isi??? 0
social impact