Technique to Baseline QE Artefact Generation Aligned to Quality Metrics

2511.15733v1 cs.SE, cs.AI 2025-11-21
Авторы:

Eitan Farchi, Kiran Nayak, Papia Ghosh Majumdar, Saritha Route

Abstract

Large Language Models (LLMs) are transforming Quality Engineering (QE) by automating the generation of artefacts such as requirements, test cases, and Behavior Driven Development (BDD) scenarios. However, ensuring the quality of these outputs remains a challenge. This paper presents a systematic technique to baseline and evaluate QE artefacts using quantifiable metrics. The approach combines LLM-driven generation, reverse generation , and iterative refinement guided by rubrics technique for clarity, completeness, consistency, and testability. Experimental results across 12 projects show that reverse-generated artefacts can outperform low-quality inputs and maintain high standards when inputs are strong. The framework enables scalable, reliable QE artefact validation, bridging automation with accountability.

Ссылки и действия