Mitsubishi Electric Research Laboratories, Inc.

Mitsubishi Electric Research Labs.

Mitsubishi Electric Information Technology Center America, Inc.

Mitsubishi Electric Information Technology Center America, Inc. (ita)

Anthony Vetro

Huifang Sun

Dong Tian

Shantanu Rane

Sehoon Yea

Robert Cohen

Hassan Mansour

Emin Martinian

Hao-Song Kong

Ajay Divakaran

Jun Xin

Yao Rong Wang

Sun-Yuan Kung

Jonathan S Yedidia

Tommy C Poon

Wei Sun

Bede Liu

Alexander Behrens

I-Jong Lin

Petros T Boufounos

Ximin Zhang

Zafer Sahinoglu

Yige Wang

Shan Liu

Peng Yin

Yao Nie

Feng Zou

Wojciech Matusik

Hanspeter Pfister

Dehong Liu

Mouhacine Benosman

Jay Bao

Matthias Zwicker

Yongzhe Wang

Ngai-Man Cheung

Siheng Chen

Caglayan Dicle

Wei-Ying Kung

Kwan-Jung Oh

Kwan-Jun Oh

Dongbo Min

Clifton L Forlines

Ronald N Perry

Yuichi Taguchi

Shih-Fu Chang

Jonathan Le Roux

Yun-Qing Shi

Tihao Chiang

Tim Marks

Ghulam Bhatti

Alan Sullivan

Richard Jeffrey Rzeszutek

Antonio Ortega

Woo-Shik Kim

Takaaki Hori

Ulugbek Kamilov

Andrei Kniazev

Bret Harsham

Chiori Hori

Anoop Cherian

Chen Feng

Yanting Ma

Fernando Masami Matsubara

Chung-Neng Wang

Stark Draper

Abhishek Nagar

Stark C Draper

Toshihiko Hata

Min Wu

Johnas I Cukier

Jian Lou

Ashish Khisti

Derek L Schwenke

Dung Trung Vo

Ling Guan

Peng Xu

Zemin Zhang

Stephen R Burgess

Jong Dae Oh

Serdar Ince

Beibei Wang

Sergey M Yekhanin

Kenneth Eugen Barner

Naoki Kuwahara

Jiun-Yu Kao

Yao-Chung Lin

Kazuo Sugimoto

Minghui Xia

Shunan Lin

Robert A Joyce

Guoxin Jin

Hau-San Wong

Paul DaGraca

Onur G Guleyruz

Xiaozhong Xu

Jewon Kang

Osman G Sezer

Eduardo Pavez

Samarjit Das

Yagiz Sutcu

A navigation system for providing driving instructions to a driver of a vehicle traveling on a route is provided. The driving instructions are generated by executing a multimodal fusion method that comprises extracting features from sensor measurements, annotating the features with directions for the vehicle to follow the route with respect to objects sensed by the sensors, and encoding the annotated features with a multimodal attention neural network to produce encodings. The encodings are transformed into a common latent space, and the transformed encodings are fused using an attention mechanism producing an encoded representation of the scene. The method further comprises decoding the encoded representation with a sentence generation neural network to generate a driving instruction and submitting the driving instruction to an output device.

Method and system for scene-aware interaction

A point cloud encoder including an input interface to accept a dynamic point cloud including a sequence of point cloud frames of a scene. A processor encodes blocks of a current point cloud frame to produce an encoded frame. Wherein, for encoding a current block of the current point cloud frame, a reference block is selected similar to the current block according to a similarity metric to serve as a reference to encode the current block. Pair each point in the current block to a point in the reference block based on values of the paired points. Encode the current block based on a combination of an identification of the reference block and residuals between the values of the paired points. Wherein the residuals are ordered according to an order of the values of the points in the reference block. A transmitter transmits the encoded frame over a communication channel.

System and method for inter-frame predictive compression for point clouds

Systems and methods for determining a pattern in time series data representing an operation of a machine. A memory to store and provide a set of training data examples generated by a sensor of the machine, wherein each training data example represents an operation of the machine for a period of time ending with a failure of the machine. A processor configured to iteratively partition each training data example into a normal region and an abnormal region, determine a predictive pattern absent from the normal regions and present in each abnormal region only once, and determine a length of the abnormal region. Outputting the predictive pattern via an output interface in communication with the processor or storing the predictive pattern in memory, wherein the predictive pattern is a predictive estimate of an impending failure and assists in management of the machine.

Methods and systems for fast resampling method and apparatus for point cloud data

A set of input images are acquired sequentially as image tensors. A low-tubal rank tensor and a sparse tensor are initialized using the image tensor, wherein the low-tubal rank tensor is a tensor product of a low-rank spanning tensor basis and corresponding tensor coefficients, and for each image, updating iteratively the image tensor, the tensor coefficients, and the sparse tensor using the image tensor and the low-rank spanning basis from a previous iteration. The spanning tensor basis is updated using the tensor coefficients, the sparse tensor, and the low rank tubal tensor, wherein the low rank tubal tensor represents a set of output images and the sparse tensor representing a set of sparse images.

System and method for processing images using online tensor robust principal component analysis

Systems and methods for image processing including a memory having stored multi-angled view images of a scene. Each multi-angled view image includes pixels, and at least one multi-angled view image includes a clouded area in the scene, resulting in missing pixels. A processor configured to align three multi-angled view images in the multi-angled view images to a target view angle of the scene, to form a set of aligned multi-angled view images representing a target point of view of the scene, at least one aligned multi-angled view image of the at least three multi-angled view images, has missing pixels due to the clouded area. Form a matrix using vectorized aligned multi-angled view images, wherein the matrix is incomplete due to the missing pixels. Complete the matrix using a matrix completion to combine the aligned multi-angled view images to produce a fused image of the scene without the clouded area.

Systems and methods of fusing multi-angle view HD images based on epipolar geometry and matrix completion

A method processes keypoint trajectories in a video, wherein the keypoint trajectories describe motion of a plurality of keypoints across pictures of the video over time, by first acquiring the video of a scene using a camera. Keypoints and associated feature descriptors are detected in each picture. The keypoints and associated features descriptors are matched between neighboring pictures to generate keypoint trajectories. Then, the keypoint trajectories are coded predictively into a bitstream, which is outputted.

Method and apparatus for keypoint trajectory coding on compact descriptor for video analysis

A method and system determines flows by first acquiring a video of the flows with a camera, wherein the flows are pedestrians in a scene, wherein the video includes a set of frames. Motion vectors are extracted from each frame in the set, and a data matrix is constructed from the motion vectors in the set of frames. A low rank Koopman operator is determined from the data matrix and a spectrum of the low rank Koopman operator is analyzed to determine a set of Koopman modes. Then, the frames are segmented into independent flows according to a clustering of the Koopman modes.

Method and system for segmenting pedestrian flows in videos

A method separates foreground from background in a sequence of images, by first acquiring the sequence of images and a depth map of a scene by a camera. Groups of pixels are determined based on the depth map. Then, the sequence of images is decomposed into a sparse foreground component, and a low rank background component, according to apparent motion in the sequence of images, and the groups.

Depth-weighted group-wise principal component analysis for video foreground/background separation

A method extracts a low-rank descriptor of a video acquired of a scene by first extracting a set of descriptors for each image in the video. The sets of descriptors for the video are aggregated to form a descriptor matrix. Iteratively, a low-rank descriptor matrix is determined from the descriptor matrix, as well as a selection matrix that associates each column in the descriptor matrix to a corresponding column in the low-rank descriptor matrix. The low-rank descriptor matrix is output upon convergence.

Method for extracting low-rank descriptors from images and videos for querying, classification, and object detection

A method processes a signal represented as a graph by first determining a graph spectral transform based on the graph. In a spectral domain, parameters of a graph filter are estimated using a training data set of unenhanced and corresponding enhanced signals. The graph filter is derived based on the graph spectral transform and the estimated graph filter parameters. Then, the signal is processed using the graph filter to produce an output signal. The processing can enhance signals such as images by denoising or interpolating missing samples.

Method for estimating parameters of a graph spectral filter using training data

A method processes a signal by first constructing a graph from the signal, and then determining a graph matrix from the graph and the signal. A Krylov-based subspace is determined based on the graph matrix and the signal. A filter for the Krylov subspace is determined. The filter transforms the signal to produce a filtered signal, which is output.

Method for graph based processing of signals

A method segments an image acquired by a sensor of a scene by first obtaining motion vectors corresponding to the image and generating a motion vanishing point image, wherein each pixel in the motion vanishing point image represents a number of intersections of pairs of motion vectors at the pixel. In the motion vanishing point image, a representation point for each motion vector is generated and distances between the motion vectors are determined based on the representation points. Then, a motion graph is constructed wherein each node represents a motion vector, and each edge represents a weight based on the distance between the nodes. Graph spectral clustering is performed on the motion graph to produce segments of the image.

Method and system for segmenting an image based on motion vanishing points

An input segment of an input video is encoded by first extracting and storing, for each segment of previously encoded videos, a set of reference features. The set of input features are matched with each set of the reference features to produce a set of scores. The reference segments having largest scores are selected to produce a first reduced set of reference segments. A rate-distortion cost for each reference segment in the first reduced set of reference segments is estimated. The reference segments in the first reduced set of reference segments is selected to produce a second reduced set of reference segments. Then, the input segment are encoded based on second reduced set of reference segments.

Method and system for encoding collections of images and videos

In a decoder, a desired image is estimated by first retrieving coding modes from an encoded side information image. For each bitplane in the encoded side information image, syndrome bits or parity bits are decoded to obtain an estimated bitplane of quantized transform coefficients of the desired image. A quantization and a transform are applied to a prediction residual obtained using the coding modes, wherein the decoding uses the quantized transform coefficients of the encoded side information image, and is based on previously decoded bitplanes in a causal neighborhood. The estimated bitplanes of quantized transform coefficients of the desired image are combined to produce combined bitplanes. Then, an inverse quantization, an inverse transform and a prediction based on the coding modes are applied to the combined bitplanes to recover the estimate of the desired image.

Method for improving compression efficiency of distributed source coding using intra-band information

Growing community of inventors

Arlington, MA, United States of America

Anthony Vetro