A Call to Action for a Secure-by-Design Generative AI Paradigm
2510.00451v1
cs.CR, cs.AI, cs.LG, cs.MA
2025-10-04
Авторы:
Dalal Alharthi, Ivan Roberto Kawaminami Garcia
Abstract
Large language models have gained widespread prominence, yet their
vulnerability to prompt injection and other adversarial attacks remains a
critical concern. This paper argues for a security-by-design AI paradigm that
proactively mitigates LLM vulnerabilities while enhancing performance. To
achieve this, we introduce PromptShield, an ontology-driven framework that
ensures deterministic and secure prompt interactions. It standardizes user
inputs through semantic validation, eliminating ambiguity and mitigating
adversarial manipulation. To assess PromptShield's security and performance
capabilities, we conducted an experiment on an agent-based system to analyze
cloud logs within Amazon Web Services (AWS), containing 493 distinct events
related to malicious activities and anomalies. By simulating prompt injection
attacks and assessing the impact of deploying PromptShield, our results
demonstrate a significant improvement in model security and performance,
achieving precision, recall, and F1 scores of approximately 94%. Notably, the
ontology-based framework not only mitigates adversarial threats but also
enhances the overall performance and reliability of the system. Furthermore,
PromptShield's modular and adaptable design ensures its applicability beyond
cloud security, making it a robust solution for safeguarding generative AI
applications across various domains. By laying the groundwork for AI safety
standards and informing future policy development, this work stimulates a
crucial dialogue on the pivotal role of deterministic prompt engineering and
ontology-based validation in ensuring the safe and responsible deployment of
LLMs in high-stakes environments.