SANgo: a storage infrastructure simulator with reinforcement learning support.

Discrete event simulation Optimal control Reinforcement learning Storage array Storage system simulation

Journal

PeerJ. Computer science
ISSN: 2376-5992
Titre abrégé: PeerJ Comput Sci
Pays: United States
ID NLM: 101660598

Informations de publication

Date de publication:
2020
Historique:
received: 30 10 2019
accepted: 28 03 2020
entrez: 5 4 2021
pubmed: 6 4 2021
medline: 6 4 2021
Statut: epublish

Résumé

We introduce SANgo (Storage Area Network in the Go language)-a Go-based package for simulating the behavior of modern storage infrastructure. The software is based on the discrete-event modeling paradigm and captures the structure and dynamics of high-level storage system building blocks. The flexible structure of the package allows us to create a model of a real storage system with a configurable number of components. The granularity of the simulated system can be defined depending on the replicated patterns of actual system behavior. Accurate replication enables us to reach the primary goal of our simulator-to explore the stability boundaries of real storage systems. To meet this goal, SANgo offers a variety of interfaces for easy monitoring and tuning of the simulated model. These interfaces allow us to track the number of metrics of such components as storage controllers, network connections, and hard-drives. Other interfaces allow altering the parameter values of the simulated system effectively in real-time, thus providing the possibility for training a realistic digital twin using, for example, the reinforcement learning (RL) approach. One can train an RL model to reduce discrepancies between simulated and real SAN data. The external control algorithm can adjust the simulator parameters to make the difference as small as possible. SANgo supports the standard OpenAI gym interface; thus, the software can serve as a benchmark for comparison of different learning algorithms.

Identifiants

pubmed: 33816922
doi: 10.7717/peerj-cs.271
pii: cs-271
pmc: PMC7924704
doi:

Types de publication

Journal Article

Langues

eng

Pagination

e271

Informations de copyright

©2020 Arzymatov et al.

Déclaration de conflit d'intérêts

Ivan Tchoub and Artem Ikoev are employees of YADRO Inc., Russia. The authors declare there are no competing interests.

Auteurs

Kenenbek Arzymatov (K)

National Research University Higher School of Economics, Moscow, Russia.

Andrey Sapronov (A)

National Research University Higher School of Economics, Moscow, Russia.

Vladislav Belavin (V)

National Research University Higher School of Economics, Moscow, Russia.

Leonid Gremyachikh (L)

National Research University Higher School of Economics, Moscow, Russia.

Maksim Karpov (M)

National Research University Higher School of Economics, Moscow, Russia.

Andrey Ustyuzhanin (A)

National Research University Higher School of Economics, Moscow, Russia.

Ivan Tchoub (I)

YADRO, Moscow, Russia.

Artem Ikoev (A)

YADRO, Moscow, Russia.

Classifications MeSH