Machine Learning for Autonomous Root Cause Analysis in Government System Efficiency Engineering
Keywords:
Machine learning, root cause analysis, autonomous systems, performance engineeringAbstract
Government systems are always under pressure for flawless performance in the fast technological world of now-a-day's, especially in relation to handling the mission-critical programs. In answer to this challenge, we propose a fresh approach based on ML-based automated root cause analysis systems meant only for the government systems. Without much more human involvement, this advanced technology is meant to study the performance issues totally & quickly identify the main problems. By means of cutting-edge ML techniques, it assures the identification of the fundamental reasons of performance bottlenecks & supports the quick and effective repairs. By automating the difficult root cause research processes, we want to improve the performance criteria of engineering for government systems thus assuring their continuous capacity to satisfy important requirements. This initiative marks a major progress in the use of artificial intelligence for performance engineering and emphasizes our will to enable the continuous operation of government services, thereby improving the public sector generally.
Downloads
References
Kuwajima, H., Yasuoka, H., & Nakae, T. (2020). Engineering problems in machine learning systems. Machine Learning, 109(5), 1103-1126.
Dey, S., & Lee, S. W. (2021). Multilayered review of safety approaches for machine learning-based systems in the days of AI. Journal of Systems and Software, 176, 110941.
Macaulay, M. O., & Shafiee, M. (2022). Machine learning techniques for robotic and autonomous inspection of mechanical systems and civil infrastructure. Autonomous Intelligent Systems, 2(1), 8.
Santhanam, P. (2020). Quality management of machine learning systems. In Engineering Dependable and Secure Machine Learning Systems: Third International Workshop, EDSMLS 2020, New York City, NY, USA, February 7, 2020, Revised Selected Papers 3 (pp. 1-13). Springer International Publishing.
Chen, K. M., Chang, T. H., Wang, K. C., & Lee, T. S. (2019). Machine learning based automatic diagnosis in mobile communication networks. IEEE Transactions on Vehicular Technology, 68(10), 10081-10093.
Xu, Z., & Saleh, J. H. (2021). Machine learning for reliability engineering and safety applications: Review of current status and future opportunities. Reliability Engineering & System Safety, 211, 107530.
He, Q., Meng, X., Qu, R., & Xi, R. (2020). Machine learning-based detection for cyber security attacks on connected and autonomous vehicles. Mathematics, 8(8), 1311.
Angelopoulos, A., Michailidis, E. T., Nomikos, N., Trakadas, P., Hatziefremidis, A., Voliotis, S., & Zahariadis, T. (2019). Tackling faults in the industry 4.0 era—a survey of machine-learning solutions and key aspects. Sensors, 20(1), 109.
Munoz, P., De La Bandera, I., Khatib, E. J., Gómez-Andrades, A., Serrano, I., & Barco, R. (2016). Root cause analysis based on temporal analysis of metrics toward self-organizing 5G networks. IEEE Transactions on Vehicular Technology, 66(3), 2811-2824.
Coglianese, C., & Lehr, D. (2016). Regulating by robot: Administrative decision making in the machine-learning era. Geo. LJ, 105, 1147.
Dong, G., & Liu, H. (Eds.). (2018). Feature engineering for machine learning and data analytics. CRC press.
Tan, Y. (2017). Paving the Way for Self-driving Cars-Software Testing for Safety-critical Systems Based on Machine Learning: A Systematic Mapping Study and a Survey.
Kettimuthu, R., Liu, Z., Foster, I., Beckman, P. H., Sim, A., Wu, K., ... & Choudhary, A. (2018, June). Towards autonomic science infrastructure: architecture, limitations, and open issues. In Proceedings of the 1st International Workshop on Autonomous Infrastructure for Science (pp. 1-9).
Paek, T., & Pieraccini, R. (2008). Automating spoken dialogue management design using machine learning: An industry perspective. Speech communication, 50(8-9), 716-729.
Varshney, K. R., & Alemzadeh, H. (2017). On the safety of machine learning: Cyber-physical systems, decision sciences, and data products. Big data, 5(3), 246-255.
Katari, A. (2022). Performance Optimization in Delta Lake for Financial Data: Techniques and Best Practices. MZ Computing Journal, 3(2).
Katari, A., Muthsyala, A., & Allam, H. HYBRID CLOUD ARCHITECTURES FOR FINANCIAL DATA LAKES: DESIGN PATTERNS AND USE CASES.
Boda, V. V. R., & Immaneni, J. (2022). Optimizing CI/CD in Healthcare: Tried and True Techniques. Innovative Computer Sciences Journal, 8(1).
Immaneni, J. (2022). End-to-End MLOps in Financial Services: Resilient Machine Learning with Kubernetes. Journal of Computational Innovation, 2(1).
Gade, K. R. (2022). Data Catalogs: The Central Hub for Data Discovery and Governance. Innovative Computer Sciences Journal, 8(1).
Gade, K. R. (2022). Data Lakehouses: Combining the Best of Data Lakes and Data Warehouses. Journal of Computational Innovation, 2(1).
Thumburu, S. K. R. (2022). A Framework for Seamless EDI Migrations to the Cloud: Best Practices and Challenges. Innovative Engineering Sciences Journal, 2(1).
Thumburu, S. K. R. (2022). The Impact of Cloud Migration on EDI Costs and Performance. Innovative Engineering Sciences Journal, 2(1).
Komandla, V. Enhancing Product Development through Continuous Feedback Integration “Vineela Komandla”.
Komandla, V. Enhancing Security and Growth: Evaluating Password Vault Solutions for Fintech Companies.
Nookala, G., Gade, K. R., Dulam, N., & Thumburu, S. K. R. (2021). Unified Data Architectures: Blending Data Lake, Data Warehouse, and Data Mart Architectures. MZ Computing Journal, 2(2).
Nookala, G. (2021). Automated Data Warehouse Optimization Using Machine Learning Algorithms. Journal of Computational Innovation, 1(1).
Komandla, V. Enhancing Security and Fraud Prevention in Fintech: Comprehensive Strategies for Secure Online Account Opening.
Thumburu, S. K. R. (2021). Integrating Blockchain Technology into EDI for Enhanced Data Security and Transparency. MZ Computing Journal, 2(1).
Katari, A. (2019). ETL for Real-Time Financial Analytics: Architectures and Challenges. Innovative Computer Sciences Journal, 5(1).
Sarbaree Mishra. “A Reinforcement Learning Approach for Training Complex Decision Making Models”. Journal of AI-Assisted Scientific Discovery, vol. 2, no. 2, July 2022, pp. 329-52
Sarbaree Mishra, et al. “Leveraging in-Memory Computing for Speeding up Apache Spark and Hadoop Distributed Data Processing”. Journal of AI-Assisted Scientific Discovery, vol. 2, no. 2, Sept. 2022, pp. 304-28
Sarbaree Mishra. “Comparing Apache Iceberg and Databricks in Building Data Lakes and Mesh Architectures”. Journal of AI-Assisted Scientific Discovery, vol. 2, no. 2, Nov. 2022, pp. 278-03
Sarbaree Mishra. “Reducing Points of Failure - a Hybrid and Multi-Cloud Deployment Strategy With Snowflake”. Journal of AI-Assisted Scientific Discovery, vol. 2, no. 1, Jan. 2022, pp. 568-95
Sarbaree Mishra, et al. “A Domain Driven Data Architecture for Data Governance Strategies in the Enterprise”. Journal of AI-Assisted Scientific Discovery, vol. 2, no. 1, Apr. 2022, pp. 543-67
Naresh Dulam, et al. “Serverless AI: Building Scalable AI Applications Without Infrastructure Overhead ”. Journal of AI-Assisted Scientific Discovery, vol. 2, no. 1, May 2021, pp. 519-42
Naresh Dulam, et al. “Data Mesh Best Practices: Governance, Domains, and Data Products”. Australian Journal of Machine Learning Research & Applications, vol. 2, no. 1, May 2022, pp. 524-47
Naresh Dulam, et al. “Apache Iceberg 1.0: The Future of Table Formats in Data Lakes”. Journal of AI-Assisted Scientific Discovery, vol. 2, no. 1, Feb. 2022, pp. 519-42
Naresh Dulam, et al. “Kubernetes at the Edge: Enabling AI and Big Data Workloads in Remote Locations”. Journal of AI-Assisted Scientific Discovery, vol. 2, no. 2, Oct. 2022, pp. 251-77
Naresh Dulam, et al. “Data Mesh and Data Governance: Finding the Balance”. Journal of AI-Assisted Scientific Discovery, vol. 2, no. 2, Dec. 2022, pp. 226-50
Muneer Ahmed Salamkar. Batch Vs. Stream Processing: In-Depth Comparison of Technologies, With Insights on Selecting the Right Approach for Specific Use Cases. Distributed Learning and Broad Applications in Scientific Research, vol. 6, Feb. 2020
Muneer Ahmed Salamkar, and Karthik Allam. Data Integration Techniques: Exploring Tools and Methodologies for Harmonizing Data across Diverse Systems and Sources. Distributed Learning and Broad Applications in Scientific Research, vol. 6, June 2020
Muneer Ahmed Salamkar, et al. The Big Data Ecosystem: An Overview of Critical Technologies Like Hadoop, Spark, and Their Roles in Data Processing Landscapes. Journal of AI-Assisted Scientific Discovery, vol. 1, no. 2, Sept. 2021, pp. 355-77
Muneer Ahmed Salamkar. Scalable Data Architectures: Key Principles for Building Systems That Efficiently Manage Growing Data Volumes and Complexity. Journal of AI-Assisted Scientific Discovery, vol. 1, no. 1, Jan. 2021, pp. 251-70
Muneer Ahmed Salamkar, and Jayaram Immaneni. Automated Data Pipeline Creation: Leveraging ML Algorithms to Design and Optimize Data Pipelines. Journal of AI-Assisted Scientific Discovery, vol. 1, no. 1, June 2021, pp. 230-5
Babulal Shaik. Automating Compliance in Amazon EKS Clusters With Custom Policies . Journal of Artificial Intelligence Research and Applications, vol. 1, no. 1, Jan. 2021, pp. 587-10
Babulal Shaik. Developing Predictive Autoscaling Algorithms for Variable Traffic Patterns . Journal of Bioinformatics and Artificial Intelligence, vol. 1, no. 2, July 2021, pp. 71-90
Babulal Shaik, et al. Automating Zero-Downtime Deployments in Kubernetes on Amazon EKS . Journal of AI-Assisted Scientific Discovery, vol. 1, no. 2, Oct. 2021, pp. 355-77
