SPACE4AI-R
SPACE4AI-R : runtime management tool for aI applications component placement and resource selection in computing continua
A tool to effectively address the runtime management of AI applications component placement and resource selection in the Computing Continuum. Through a Random Search combined with a Stochastic Local Search algorithm, SPACE4AI-R copes with runtime workload fluctuations by identifying the cost-optimal reconfiguration of the initial production deployment, while providing performance guarantees across heterogeneous resources including Edge devices and servers, Cloud GPU-based Virtual Machines and Function as a Service solutions. Experimental results show that our tool efficiently finds placement reconfigurations in a real use case of identifying wind turbines blade damage, and can manage large-scale systems providing remarkable cost savings over static placements, while keeping execution time in the order of seconds.
SPACE4AI-R Optimizer
The tool is implemented in C++, with a Python-based entrypoint that is in charge of managing the input/output files according to the scenario under testing.
It relies on performance models developed and queried through the aMLLibrary, specifying a regressor file that has to be suitably generated for each application component and computing continuum device.
RUNTIME-MANAGER
Pre-requirements
SPACE4AI-D
It is assumed that all the process with SPACE4AI-D has been done completed and a fully configured AI-SPRINT application is available. For more documentation you can see SPACE4AI-D documentation
Toscarizer
The Toscarizer should been downloaded from the repository and install it following the instructions.
Customize the toscarizer oscar.yaml file (/toscarizer/templates/oscar.yaml) to match the AI-SPRINT application requirements.