The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Sep. 22, 2026

Filed:

Sep. 30, 2024
Applicant:

Palo Alto Networks, Inc., Santa Clara, CA (US);

Inventors:

Feng Xiao, San Jose, CA (US);

Yang Ji, San Jose, CA (US);

Wenjun Hu, Santa Clara, CA (US);

Danny Tsechansky, Kirkland, WA (US);

Ali Islam, Fremont, CA (US);

Assignee:

Palo Alto Networks, Inc., Santa Clara, CA (US);

Attorney:
Primary Examiner:
Int. Cl.
CPC ...
G06F 21/57 (2013.01); G06F 21/60 (2013.01);
U.S. Cl.
CPC ...
G06F 21/577 (2013.01); G06F 21/604 (2013.01); G06F 2221/033 (2013.01);
Abstract

Assessments of guardrails of LLMs, whether used by an application or within an AI/LM stack, must be dynamic to protect against the ongoing engineering of jailbreaking prompts. An assessment framework has been created that facilitates assessment of language model guardrails. The assessment framework includes a prompt generator and has access to sensitive data (e.g., source code, trade secret, confidential documents, etc.) that occurs in training data of a model being assessed. The framework provides the prompt generator jailbreaking strategies and categories of the sensitive data (e.g., program code, trade secret, confidential document.). With the data categories and the strategies, the prompt generator generates different prompts and submits them to the AI-powered application or LM stack being assessed. The assessment framework then analyzes the outputs/responses from the AI-powered application or LM stack to determine whether guardrails have been subverted and any of the sensitive data has been exfiltrated.


Find Patent Forward Citations

Loading…