Intel Corporation

Remeztech Ltd.

Haim Barad

Barak Hurwitz

Uzi Sarel

Eran Geva

Moshe Island

Eli Kfir

Amit Bleiweiss

Barak Battach

Jonathan Skelker

Marina Grechuhin

Systems, apparatuses and methods may provide for technology that processes an inference workload in a first subset of layers of a neural network that prevents or inhibits data dependent branch operations, conducts an exit determination as to whether an output of the first subset of layers satisfies one or more exit criteria, and selectively bypasses processing of the output in a second subset of layers of the neural network based on the exit determination. The technology may also speculatively initiate the processing of the output in the second subset of layers while the exit determination is pending. Additionally, when the inference workloads include a plurality of batches, the technology may mask one or more of the plurality of batches from processing in the second subset of layers.

Deep learning inference efficiency technology with early exit and speculative execution

The disclosure provides a natural language processing (NLP) model arranged to operate on two lexicons, where one lexicon is a sub-set of the other lexicon. The NLP model can be arranged to generate output based on the sub-set lexicon and exit processing of the NLP model, to potentially save computation cycles.

Early exit for natural language processing models

A system and method for mark-up language document rank analysis that may be performed automatically and that may also determine one or more differences between mark-up language documents with regard to their relative rank.

System and method for mark-up language document rank analysis

Growing community of inventors

Zichron Yaakov, Israel

Haim Barad