Hard drives monitoring automation approach for Kubernetes container orchestration system
https://doi.org/10.15514/ISPRAS-2020-32(2)-8
Abstract
Today, a laborious and non-trivial task is to automate monitoring of hard drives in a cluster infrastructure using the Kubernetes container management system. The paper discusses existing approaches to monitoring hard drives in the Kubernetes container orchestration system and provides a comparative analysis of them. Based on the presented analysis, a conclusion is drawn on the need to improve and automate approaches. The paper proposes an approach to automating the collection of metrics from hard drives by implementing the Kubernetes “operator” for a tool with which you can effectively obtain information about the state of hard drives in the system. As results, the temporal characteristics of collecting information about disks using existing approaches and the proposed approach are given. Numerical results and graphs showing the gain of the proposed approach are presented
About the Authors
Anastasia Sergeevna SHEMYAKINSKAYARussian Federation
Student of Institute of computer science and technologies
Igor Valerevich NIKIFOROV
Russian Federation
Candidate of engineering sciences, associate professor of High school of software engineering, Institute of computer science and technologies
References
1. Kubernetes, Available at: https://kubernetes.io/, accessed 20.05.2020.
2. Docker Swarm, Available at: https://docs.docker.com/engine/swarm/, accessed 20.05.2020..
3. Mesos, Available at: http://mesos.apache.org/, accessed 20.05.2020.
4. Adam K.D. Linux Administration Cookbook. Birmingham, UK, Packt Publishing, 2016, 783 p.
5. A. Chatzidimitriou, G. Papadimitriou, and D. Gizopoulos. HealthLog Monitor: Errors, Symptoms and Reactions Consolidated. IEEE Transactions on Device and Materials Reliability, vol. 19, no. 1, 2019, pp. 46-54.
6. S. Ganguly et al. A Practical Approach to Hard Disk Failure Prediction in Cloud Platforms: Big Data Model for Failure Management in Datacenters. In Proc of the 2016 IEEE Second International Conference on Big Data Computing Service and Applications (BigDataService), 2016, pp. 105-116.
7. X. Sun et al. System-level hardware failure prediction using deep learning. In Proc of the 2019 56th ACM/IEEE Design Automation Conference (DAC), 2019, pp. 1-6.
8. IPMI Specification. Available at: https://www.intel.ru/content/www/ru/ru/products/docs/servers/ipmi/ipmi-second-gen-interface-spec-v2-rev1-1.html, accessed 20.05.2020.
9. ipmitool man page. Available at: https://linux.die.net/man/1/ipmitool, accessed 20.05.2020.
10. M. Abdelbaky et al. Docker Containers across Multiple Clouds and Data Centers. 2015 IEEE/ACM 8th International Conference on Utility and Cloud Computing, 2015, pp. 368-371.
11. Docker. Available at: https://www.docker.com/, accessed 20.05.2020.
12. I.M.A. Jawarneh et al. Container Orchestration Engines: A Thorough Functional and Performance Comparison. In Proc of the 2019 IEEE International Conference on Communications (ICC), 2019, pp. 1-6.
13. Operator Pattern. Available at: https://kubernetes.io/docs/concepts/extend-kubernetes/operator/, accessed 20.05.2020.
14. Operator SDK. Available at: https://github.com/operator-framework/operator-sdk, accessed 20.05.2020.
15. Kubebuilder. Available at: https://github.com/kubernetes-sigs/kubebuilder, accessed 20.05.2020.
16. Code-generator. Available at: https://github.com/kubernetes/code-generator, accessed 20.05.2020.
17. Helm. Available at: https://helm.sh/, accessed 20.05.2020.
Review
For citations:
SHEMYAKINSKAYA A.S., NIKIFOROV I.V. Hard drives monitoring automation approach for Kubernetes container orchestration system. Proceedings of the Institute for System Programming of the RAS (Proceedings of ISP RAS). 2020;32(2):99-106. https://doi.org/10.15514/ISPRAS-2020-32(2)-8