We introduce a methodology for tracking and auditing feedback, errors and suggestions for software packages. This short paper describes how we innovate on the evaluation mechanism, introducing an (Antecedent, Barrier, Consequence and Development) ABCD form, embedded within a platform to enable end users to easily report on usability issues. The evaluation platform we use is the STEP cloud e-Participation platform (part of the STEP Horizon2020 project http://step4youth.eu/) and it will be tested and validated in real life contexts, with the participation of public authorities that will integrate the service in their regular decision-making practices, involving young people through engagement and motivation strategies. The pilot evaluation aims to demonstrate how open engagement needs to be embedded within public sector processes and identify the key barriers for wide scale deployment of the platform.