The recent increased interest in quantum computing has led to the release of many of opensource quantum frameworks by commercial vendors and researchers alike. The implementation details of each framework could result in very different performances when executing some quantum routine, and thus it is important to be aware of the relative performance advantage a framework may have over the other, such that the proper tool is chosen before undergoing a new project or research. The Automated Benchmarking of Algorithms for Quantum Systems (ABAQUS) project targets this exact issue as part of Quantum Technology Initiative (QTI) at CERN, and a prototype has been developed last year. While the developed prototype served well as a proof-of-concept, it had two main issues. First, it was not intuitively extensible. One of the goals of ABAQUS is for it to be community driven, and therefore, the design had to be more intuitive, especially to people coming from non-CS backgrounds. Secondly, the underlying low-level design was not scalable, which does not fit with the Distributed Quantum Computing paradigm, that is also part of the QTI. Accordingly, the prototype has been modified, getting closer to both goals, by making the different components more modular, and adapting the system such that it can be scaled with the use of container technologies and container orchestration tools. This makes the prototype usable in different configurations: locally, in a virtualized environment, or a distributed cluster.