Generative Adversarial Networks for Simulated Load Testing in Distributed Systems
Keywords:
Generative Adversarial Networks, load testing, distributed systemsAbstract
Generative Adversarial Networks (GANs) is turn out to be a powerful technique for synthesising realistic data distributions which makes them suitable for simulating load conditions in distributed microservices architectures. The purpose of this paper is to explore the application of GANs which is used for generating diverse, high-fidelity traffic patterns for load testing, surpassing conventional scripted approaches such as Gatling.
Downloads
References
I. Goodfellow et al., “Generative Adversarial Nets,” in Advances in Neural Information Processing Systems, vol. 27, 2014.
M. Arjovsky, S. Chintala, and L. Bottou, “Wasserstein GAN,” in Proc. 34th International Conference on Machine Learning (ICML), Sydney, Australia, 2017, pp. 214–223.
X. Mao, Q. Li, H. Xie, R. Y. K. Lau, Z. Wang, and S. P. Smolley, “Least Squares Generative Adversarial Networks,” in Proc. IEEE International Conference on Computer Vision (ICCV), Venice, Italy, 2017, pp. 2813–2821.
L. Yu, W. Zhang, J. Wang, and Y. Yu, “SeqGAN: Sequence Generative Adversarial Nets with Policy Gradient,” in Proc. AAAI Conference on Artificial Intelligence (AAAI), San Francisco, CA, USA, 2017, pp. 2852–2858.
N. Carlini and D. Wagner, “Adversarial Examples Are Not Easily Detected: Bypassing Ten Detection Methods,” in Proc. 10th ACM Workshop on Artificial Intelligence and Security (AISec), Dallas, TX, USA, 2017, pp. 3–14.
J. Jiang, Z. Wang, and C. Liu, “Performance Testing of Microservices-Based Applications: A Systematic Mapping Study,” IEEE Access, vol. 8, pp. 125345–125363, 2020.
J. D. McGregor, “Testing a Microservice-Based System,” IEEE Software, vol. 35, no. 3, pp. 92–97, May 2018.
K. O. Elish and A. Offutt, “Detecting Performance Antipatterns in Microservice Architectures,” in Proc. IEEE International Conference on Software Testing, Verification and Validation (ICST), Tokyo, Japan, 2017, pp. 165–175.
G. Casale, N. Mi, and L. Cherkasova, “Autonomous Performance Testing of Elastic Systems with Self-Tuned Load Injection,” in Proc. IEEE International Conference on Cloud Engineering (IC2E), San Francisco, CA, USA, 2016, pp. 35–44.
L. Liu, C. Pu, and G. Jiang, “Microservices Performance Testing: From Theory to Practice,” IEEE Internet Computing, vol. 23, no. 6, pp. 79–87, Nov. 2019.
D. Lo, H. C. Lim, F. Ishikawa, and F. Arcelli, “Automated Load Testing Framework for Cloud-Based Microservices Applications,” IEEE Transactions on Services Computing, vol. 14, no. 2, pp. 331–343, Mar. 2021.
R. B. Myerson and A. A. Ganek, “AI-Based Workload Synthesis for Scalable Load Testing,” in Proc. IEEE International Conference on Cloud Computing (CLOUD), Boston, MA, USA, 2019, pp. 120–127.
C. Zheng, X. Luo, and J. Zhang, “GAN-Based Synthetic Workload Generation for Performance Benchmarking in Cloud Environments,” in Proc. IEEE International Conference on Dependable Systems and Networks (DSN), Valencia, Spain, 2018, pp. 15–26.
S. K. Garg, R. Buyya, and H. J. Siegel, “Time and Cost Trade-Off Management for Elastic Cloud Workloads,” IEEE Transactions on Cloud Computing, vol. 2, no. 2, pp. 140–153, Apr. 2014.
A. Makhija, D. J. Dubois, and J. M. Wozniak, “AI-Driven Load Testing for High-Performance Computing Systems,” in Proc. IEEE/ACM International Conference on High Performance Computing, Networking, Storage, and Analysis (SC), Denver, CO, USA, 2020, pp. 1–11.
M. Zaharia et al., “Spark: Cluster Computing with Working Sets,” in Proc. 2nd USENIX Conference on Hot Topics in Cloud Computing (HotCloud), Boston, MA, USA, 2010, pp. 10–18.
P. S. Yu and C. Aggarwal, “The Evolution of Generative AI for Data Synthesis and Augmented Testing,” IEEE Transactions on Knowledge and Data Engineering, vol. 34, no. 6, pp. 2163–2180, Jun. 2022.
J. Han, T. M. Mitchell, and J. Q. Zhang, “Neural Networks for Modeling Workload Dynamics in Cloud Computing,” in Proc. ACM Symposium on Cloud Computing (SoCC), Seattle, WA, USA, 2018, pp. 55–70.
A. Patel and M. J. Fischer, “Evaluating the Scalability of AI-Augmented Load Testing for Kubernetes Deployments,” IEEE Transactions on Network and Service Management, vol. 18, no. 3, pp. 3210–3225, Sep. 2021.
A. S. Baktir, E. Bakir, and K. A. Nahrstedt, “Dynamic Workload Adaptation Using Reinforcement Learning in Microservices Architectures,” IEEE Transactions on Parallel and Distributed Systems, vol. 33, no. 7, pp. 1723–1736, Jul. 2022.
