Generating dependency parses of text segments using neural networks

Abstract

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for generating dependency parses for input text segments, which may be provided as inputs to a natural language processing system. One of the systems includes a first neural network comprising: one or more initial neural network layers configured to, for each token in an input text sequence: receive features for the token; and collectively process the features to generate an alternative representation of the features for use in determining a part of speech of the token in the input text sequence; and a dependency parsing neural network configured to: process the alternative representations of the features for the tokens in the input text sequence generated by the one or more initial neural network layers to generate a dependency parse of the input text sequence.