Siemens Aktiengesellschaft

Yatin Chaudhary

Pankaj Gupta

Florian Büttner

The invention refers to a natural language processing system configured for receiving an input sequence cof input words (v, v, . . . v) representing a first sequence of words in a natural language of a first text and generating an output sequence of output words (,, . . .) representing a second sequence of words in a natural language of a second text and modeled by a multinominal topic model, wherein the multinominal topic model is extended by an incorporation of language structures using a deep contextualized Long-Short-Term Memory model.

System and method for natural language processing with a multinominal topic model

The invention refers to a natural language processing system configured for receiving an input sequence cof input words representing a first sequence of words in a natural language of a first text and generating an output sequence of output words representing a second sequence of words in a natural language of a second text and modeled by a multinominal topic model, wherein the multinominal topic model is extended by an incorporation of full contextual information around each word v, wherein both preceding words vand following words varound each word vare captured by using a bi-directional language modelling and a feed-forward fashion, wherein position dependent forward hidden layers {right arrow over (h)}and backward hidden layersfor each word vare computed.

Growing community of inventors

Munich, Germany

Yatin Chaudhary