| Abstract: |
Evaluating the performance, reliability, and scalability of cloud systems remains challenging due to heterogeneous infrastructures and fragmented tooling. This paper presents ModuCloudEval, a modular and extensible framework for automated performance evaluation of cloud databases, load balancers, and microservices applications. The framework unifies offline benchmarking tools (Sysbench, Apache Benchmark, Redis Benchmark) with online monitoring solutions (K6, Prometheus, Grafana), enabling consistent assessment in both pre-deployment and live environments. Its plugin-oriented architecture supports independent subsystem evaluation and straightforward extensibility to new workloads, while YAML-driven automation and secure credential handling ensure reproducibility and scalability. In addition to presenting the architecture, this paper provides a comparative experimental evaluation across multiple cloud providers, including OpenStack, AWS, and Azure, and across representative subsystems such as databases and load balancers. These experiments demonstrate how the framework enables systematic cross-cloud comparison and configuration-aware performance analysis. Furthermore, the framework facilitates reproducible experimentation and enables future integration of cost, energy, and security evaluation modules, which are increasingly relevant for sustainable and trustworthy cloud deployments. Overall, ModuCloudEval addresses key limitations of existing evaluation approaches and provides a practical, automated foundation for reproducible cloud performance analysis. |