What is a Prompt Injection?
A technique that manipulates AI prompts to produce unintended outputs.
✓ Definition copied to clipboard
Understanding Prompt Injection
Prompt injection occurs when a user or system input alters the model's behavior in unexpected ways. This can lead to leaked data, incorrect outputs, or policy violations.
It is a security and compliance risk, especially when AI systems are connected to internal knowledge bases.
Frequently Asked Questions
What is a Prompt Injection?
A technique that manipulates AI prompts to produce unintended outputs.
Prompt injection occurs when a user or system input alters the model's behavior in unexpected ways. This can lead to leaked data, incorrect outputs, or policy violations.
Why is Prompt Injection important?
Prompt injection can compromise brand safety and data integrity. Guardrails and input validation are essential for secure AI workflows.