Facebook, Inc.

New York University

Robert D Fergus

Lubomir Dimitrov Bourdev

Balamanohar Paluri

Du Le Hong Tran

Kevin Dechau Tang

Sumit Chopra

Yaniv Taigman

Dilip Krishnan

Ning Zhang

Arthur David Szlam

Sainbayar Sukhbaatar

Jason Edward Weston

Fei Yang

Adam Kal Lerer

Soumith Chintala

Yunchao Gong

Louis Dominic Brandy

Marcin Pawlowski

Ronan Alexandre Riochet

Emily Denton

Systems, methods, and non-transitory computer-readable media can obtain a first batch of content items to be clustered. A set of clusters can be generated by clustering respective binary hash codes for each content item in the first batch, wherein content items included in a cluster are visually similar to one another. A next batch of content items to be clustered can be obtained. One or more respective binary hash codes for the content items in the next batch can be assigned to a cluster in the set of clusters.

Systems and methods for online clustering of content items

Embodiments are disclosed for predicting a response (e.g., an answer responding to a question) using an end-to-end memory network model. A computing device according to some embodiments includes embedding matrices to convert knowledge entries and an inquiry into feature vectors including the input vector and memory vectors. The device further execute a hop operation to generate a probability vector based on an input vector and a first set of memory vectors using a continuous weighting function (e.g., softmax), and to generate an output vector as weighted combination of a second set of memory vectors using the elements of the probability vector as weights. The device can repeat the hop operation for multiple times, where the input vector for a hop operation depends on input and output vectors of previous hop operation(s). The device generates a predicted response based on at least the output of the last hop operation.

End-to-end memory networks

Systems, methods, and non-transitory computer-readable media can identify a set of regions corresponding to a geographical area. A collection of training images can be acquired. Each training image in the collection can be associated with one or more respective recognized objects and with a respective region in the set of regions. Histogram metrics for a plurality of object categories within each region in the set of regions can be determined based at least in part on the collection of training images. A neural network can be developed based at least in part on the histogram metrics for the plurality of object categories within each region in the set of regions and on the collection of training images.

Systems and methods for image object recognition based on location information and object categories

To differentiate physical and non-physical events, a discrimination system based on unsupervised machining learning is used to predict a plausibility of objects' behaviors between a starting and ending time point. The discrimination system receives a set of initial, or 'starting' content frames, each depicting a state of objects at a starting time point and an arrangement or 'behavior' of those objects at the starting time. To train the discrimination system, the first model uses the starting content frame to generate a subsequent content frame, while the second model generates a subsequent content frame without using the starting content frame. A discriminator model may thus be trained without supervision by treating the subsequent content frame generated from the first model as a possible behavior of the starting content frame, and the subsequent content frame generated from the second model as an impossible behavior of the starting content frame.

Differentiating physical and non-physical events

Various embodiments of the present disclosure include systems, methods, and non-transitory computer storage media configured to identify a set of training content items, each of the set of training content items comprising video content. A category may be assigned to each of the set of training content items. A plurality of variations may be provided to the each of the set of training content items. A first content recognition module may be trained in an unsupervised process to associate the plurality of variations of the each of the set of training content items with the category assigned to the each of the set of training content items. A classification layer may be generated based on the training the first content recognition module in the unsupervised process. A second content recognition module may be trained in a supervised process based on the classification layer.

Unsupervised training sets for content classification

In one embodiment, a method includes accessing a plurality of generative adversarial networks (GANs) that are each applied to a particular level k of a Laplacian pyramid. Each GAN may comprise a generative model Gand a discriminative model D. At each level k, the generative model Gmay take as input a noise vector zand may output a generated image {tilde over (h)}. At each level k, the discriminative model Dmay take as input either the generated image {tilde over (h)}or a real image h, and may output a probability that the input was the real image h. The method may further include generating a sample image &#x128;from the generated images {tilde over (h)}, wherein the sample image is based on the probabilities outputted by each of the discriminative models Dand the generated images {tilde over (h)}. The method may further include providing the sample image &#x128;for display.

Producing higher-quality samples of natural images

Systems, methods, and non-transitory computer-readable media can acquire video content for which video feature descriptors are to be determined. The video content can be processed based at least in part on a convolutional neural network including a set of two-dimensional convolutional layers and a set of three-dimensional convolutional layers. One or more outputs can be generated from the convolutional neural network. A plurality of video feature descriptors for the video content can be determined based at least in part on the one or more outputs from the convolutional neural network.

Systems and methods for determining video feature descriptors based on convolutional neural networks

Systems, methods, and non-transitory computer-readable media can obtain a set of video frames at a first resolution. Process the set of video frames using a convolutional neural network to output one or more signals, the convolutional neural network including (i) a set of two-dimensional convolutional layers and (ii) a set of three-dimensional convolutional layers, wherein the processing causes the set of video frames to be reduced to a second resolution. Process the one or more signals using a set of three-dimensional de-convolutional layers of the convolutional neural network. Obtain one or more outputs corresponding to the set of video frames from the convolutional neural network.

Systems and methods for processing content using convolutional neural networks

Systems, methods, and non-transitory computer-readable media can receive a first image including a representation of a first user. A second image including a representation of a second user can be received. A first set of poselets associated with the first user can be detected in the first image. A second set of poselets associated with the second user can be detected in the second image. The first image including the first set of poselets can be inputted into a first instance of a neural network to generate a first multi-dimensional vector. The second image including the second set of poselets can be inputted into a second instance of the neural network to generate a second multi-dimensional vector. A first distance metric between the first multi-dimensional vector and the second multi-dimensional vector can be determined.

Systems and methods for identifying users in media content based on poselets and neural networks

Exemplary embodiments of the present disclosure relate generally to methods, computer-accessible medium and systems for dark flash photography. For example, described herein is an exemplary embodiment of an apparatus for providing illumination and obtaining an image, which can include, e.g., a first arrangement configured to emit a flash of light including ultra-violet light and/or infra-red light to illuminate a scene and/or one or more subjects, and a second arrangement configured to obtain an image of the illuminated scene and/or one or more subject. A duration of time and/or an intensity level of the flash can be selected, e.g., so that wavelengths of the flash can be substantially invisible to a human eye. For example, the visibility of the flash perceived by the human eye can be, e.g., approximately 200 times less than the visibility of a standard flash of light having substantially the same amount of energy as the flash.

Growing community of inventors

New York, NY, United States of America

Robert D Fergus