Fuji Xerox Co., Ltd.

Fujifilm Business Innovation Corp.

Leia Spv LLC

Chelhwon Kim

Patrick Chiu

Laurent Denoue

Scott Carter

Donald G Kimber

Miteshkumar Patel

Qiong Liu

Anthony Dunnigan

Hideto Oda

Surendar Chandra

Michael Patrick Cutter

Yanxia Zhang

Hajime Ueno

Yulius Tjahjadi

Chidansh Amitkumar Bhatt

David A Fattal

Francine R Chen

Andreas Girgensohn

Jun Shingu

Maribeth Joy Back

Matthew L Lee

Jian Zhao

Nami Tokunaga

Hao Tang

Christine Marie Dierk

Doga Buse Cavdir

Bee-Yian Liew

Jingwei Song

Joseph Andrew Alkuino De La Pena

Joseph Andrew Alkuino De La Peña

Andrew Allan Port

Yiwen Hua

Systems and methods are directed to multiview format detection. A multiview image that comprises a plurality of tiled view images is accessed. A cross-correlation map from the multiview image may be generated by autocorrelating the multiview image with a shifted copy of the multiview image. The cross-correlation map may be sampled at a plurality of predefined locations of the cross-correlation map to identify a set of cross-correlation values. A multiview format of the multiview image may be detected by classifying a feature set of the multiview image that comprises the set of cross-correlation values. The multiview image may be configured to be rendered on a multiview display based on the multiview format.

System and method of detecting multiview file format

A computer-implemented method, comprising detecting a first audio output in a first room, and detecting a portion of the first audio output in a second room, determining whether the portion of the first audio output in the second room meets a trigger requirement, and for the determining that the portion meets the trigger requirement, providing an action to reduce the portion of the first audio input in the second room.

System and method for dynamically adjusting settings of audio output devices to reduce noise in adjacent spaces

A computerized system comprising a processing unit and a memory, the system operating in connection with a real-time video conference stream containing a video of a user, wherein the memory embodies a set of computer-executable instructions, which cause the computerized system to perform a method involving: receiving the real time video conference stream containing the video of the user; detecting and separating the background in the received real time video conference stream from the user; and replacing the separated background with a background received from a system of a second user or with a pre-recorded background.

Systems and methods for implementing personal camera that adapts to its surroundings, both co-located and remote

A computerized system comprising a processing unit and a memory, the system operating in connection with a real-time video conference stream containing a video of a user, wherein the memory embodies a set of computer-executable instructions, which cause the computerized system to perform a method involving: receiving the real time video conference stream containing the video of the user; detecting the background in the received real time video conference stream from the user; and matching the first background and a second background associated with the second user.

Example implementations described herein are directed to the transmission of hand information from a user hand or other object to a remote device via browser-to-browser connections, such that the hand or other object is oriented correctly on the remote device based on orientation measurements received from the remote device. Such example implementations can facilitate remote assistance in which the user of the remote device needs to view the hand or object movement as provided by an expert for guidance.

Web-based remote assistance system with context and content-aware 3D hand gesture visualization

A computer-implemented method, comprising applying training images of an environment divided into zones to a neural network, and performing classification to label a test image based on a closest zone of the zones; extracting a feature from retrieved training images and pose information of the test image that match the closest zone; performing bundle adjustment on the extracted feature by triangulating map points for the closest zone to generate a reprojection error, and minimizing the reprojection error to determine an optimal pose of the test image; and for the optimal pose, providing an output indicative of a location or probability of a location of the test image at the optimal pose within the environment.

Fusing deep learning and geometric constraint for image-based localization

Example implementations described herein are directed to systems and methods for skill assessment, such as hand washing compliance in hospitals, or assembling products in factories. Example implementations involve body part tracking (e.g., hands), skeleton tracking and deep neural networks to detect and recognize sub-tasks and to assess the skill on each sub-task. Furthermore, the order of the sub-tasks is checked for correctness. Beyond monitoring individual users, example implementations can be used for analyzing and improving workflow designs with multiple sub-tasks.

Methods for real-time skill assessment of multi-step tasks performed by hand movements using a video camera

A computer implemented method is provided that includes embedding a received signal in a first modality, re-embedding the embedded received signal of the first modality into a signal of a second modality, and generating an output in the second modality, and based on the output, rendering a signal in the second modality that is configured to be sensed, wherein the embedding, re-embedding and generating applies a model that is trained by performing an adversarial learning operation associated with discriminating actual examples of the target distribution from the generated output, and performing a metric learning operation associated with generating the output having perceptual distances.

Transmodal translation of feature vectors to audio for assistive devices

A real-time end-to-end system for capturing ink strokes written with ordinary pen and paper using a commodity video camera is described. Compare to traditional camera-based approaches, which typically separate out the pen tip localization and pen up/down motion detection, described is a unified approach that integrates these two steps using a deep neural network. Furthermore, the described system does not require manual initialization to locate the pen tip. A preliminary evaluation demonstrates the effectiveness of the described system on handwriting recognition for English and Japanese phrases.

Systems and methods for real-time end-to-end capturing of ink strokes from video

In example implementations described herein, there is a smart hat that is configured to receive gesture inputs through an accelerometer or through touch events on the hat, with light emitting diodes providing feedback to the wearer. The smart hat can be configured to be connected wirelessly to an external apparatus to control the apparatus by transmitting and receiving messages (e.g., commands) between the hat and the apparatus wirelessly. Further, a network of smart hats may be managed by an external device depending on the desired implementation.

Smart hat device for interacting with remote devices and displays

A computer-implemented method of localization for an indoor environment is provided, including receiving, in real-time, a dynamic query from a first source, and static inputs from a second source; extracting features of the static inputs by applying a metric learning convolutional neural network (CNN), and aggregating the extracted features of the static inputs to generate a feature transformation; and iteratively extracting features of the dynamic query on a deep CNN as an embedding network and fusing the feature transformation into the deep CNN, and applying a triplet loss function to optimize the embedding network and provide a localization result.

Indoor localization using real-time context fusion of visual information from static and dynamic cameras

A computer-implemented method is provided for coordinating sensed poses associated with real-time movement of a first object in a live video feed, and pre-recorded poses associated with movement of a second object in a video. The computer-implemented method comprises applying a matching function to determine a match between a point of one of the sensed poses and a corresponding point of the pre-recorded poses, and based on the match, determining a playtime and outputting at least one frame of the video associated with the second object for the playtime.

Method and system for real time synchronization of video playback with user motion

Systems and methods directed to utilizing a first camera system to capture first images of one or more people in proximity to a tabletop; utilizing a second camera system to capture second images of one or more documents in proximity to the tabletop; generating a query for a database derived from people recognition conducted on the first images and text extraction on the second images; determining a first ranked list of people and a second ranked list of documents based on results of the query, the results based on a calculated ranked list of two-mode networks; and providing an interface on a display to access information about one or more people from the first ranked list of people and one or more documents from the second ranked list of documents.

System for searching documents and people based on detecting documents and people around a table

Systems and methods for generating high resolution dewarped images for an image of a document captured by a 3D stereo digital camera system, or a mobile phone camera capturing a sequence of images, which may improve OCR performance. Example embodiments include a compact stereo camera with two sensors mounted at fixed locations, and a multi-resolution pipeline to process and to dewarp the images using a three dimensional surface model based on curve profiles of the computed depth map. Example embodiments also include a mobile phone including a camera which captures a sequence of images, and a processor which computes a disparity map using the captured sequence of image frames, computes a model of the at least one document page by generating a cylindrical three dimensional geometric surface using the computed disparity map, and renders a dewarped image from the computed model.

Growing community of inventors

Palo Alto, CA, United States of America

Chelhwon Kim