The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Apr. 14, 2026
Filed:
Apr. 19, 2023
Google Llc, Mountain View, CA (US);
Martin Baeuml, Wollerau, CH;
Yanping Huang, Mountain View, CA (US);
Wenhao Jia, Saratoga, CA (US);
Chang Lan, Kirkland, WA (US);
Yuanzhong Xu, Mountain View, CA (US);
Junwhan Ahn, San Jose, CA (US);
Alexander Bailey, Wollerau, CH;
Leif Schelin, Zurich, CH;
Trevor Strohman, Sunnyvale, CA (US);
Emanuel Taropa, Los Altos, CA (US);
Sidharth Mudgal, Mountain View, CA (US);
Yanyan Zheng, Palo Alto, CA (US);
Zhifeng Chen, Sunnyvale, CA (US);
Ahmad Beirami, New York, NY (US);
GOOGLE LLC, Mountain View, CA (US);
Abstract
Implementations relate to reducing latency in generating and/or rendering natural language (NL) output generated using a large language model (LLM). Processor(s) of a system can: receive NL based input associated with a client device, and generate the NL based output utilizing the LLM. The NL based output can be a stream of NL based output in that it includes a plurality of segments, and is generated on a segment-by-segment basis. In some implementations, a first segment of the stream of NL based output is selected for inclusion in the stream of NL based output as a second segment (and any subsequent segment) is being generated to reduce latency in evaluating the NL based output as a whole prior to rendering thereof. In some versions of those implementations, the first segment is rendered as the second segment (and any subsequent segment) is being generated to further reduce latency in rendering thereof.