Ancestry.com Operations Inc.

Gopalkrishna Balkrishna Veni

Yen-Yun Yu

Jack Reese

Masaki Stanley Fujimoto

Jinsol Lee

Azadeh Moghtaderi

Yingrui Yang

Randon Morford

Mostafa Karimi

Michael Benjamin Brodie

Raunak Dey

Simon Chu

Luca Lugini

Methods, systems, and computer-program products for image enhancement include receiving an image and optionally a user request, classify the image, crop image components of the image, restore cropped image components of the image, colorized restored image components, and reconstruct the image from the colorized, restored image components and other components. The other components may include text components that are restored in a separate treatment pipeline.

Image enhancement in a genealogy system

Systems and methods for importing documents are described. An input image is received and preprocessed. OCR and/or page segmentation and chapter detection are performed. Special-case processing is performed for lists, tables, free text, and other categories. Anaphora analysis, stemming, lemmatization, and relationship detection are performed. A genealogical tree is generated, augmented, or merged based on the extracted entities and relationships.

Machine-learning based automated document integration into genealogical trees

A simplified handwriting recognition approach includes a first network comprising convolutional neural network comprising one or more convolutional layers and one or more max-pooling layers. The first network receives an input image of handwriting and outputs an embedding based thereon. A second network comprises a network of cascaded convolutional layers including one or more subnetworks configured to receive an embedding of a handwriting image and output one or more character predictions. The subnetworks are configured to downsample and flatten the embedding to a feature map and then a vector before passing the vector to a dense neural network for character prediction. Certain subnetworks are configured to concatenate an input embedding with an upsampled version of the feature map.

Handwriting recognition

Systems and methods for handwriting recognition using language modeling facilitate improved results by using a trained language model to improve results from a handwriting recognition machine learning model. The language model may be a character-based language model trained on a dataset pertinent to field values on which the handwriting recognition model is to be used. A loss prediction module may be trained with the handwriting recognition model and/or the language model and used to determine whether a prediction from the handwriting recognition model should be refined by passing the prediction through the trained language model.

Handwriting recognition with language modeling

Described herein are systems, methods, and other techniques for training a generative adversarial network (GAN) to perform an image-to-image transformation for recognizing text. A pair of training images are provided to the GAN. The pair of training images include a training image containing a set of characters in handwritten form and a reference training image containing the set of characters in machine-recognizable form. The GAN includes a generator and a discriminator. The generated image is generated using the generator based on the training image. Update data is generated using the discriminator based on the generated image and the reference training image. The GAN is trained by modifying one or both of the generator and the discriminator using the update data.

Growing community of inventors

Lehi, UT, United States of America

Gopalkrishna Balkrishna Veni