Vantrix Corporation

3649954 Canada Inc.

Jean Mayrand

Marc Courtemanche

Sebastien Cote

Sébastien Cöté

Methods and apparatus for filtering panoramic video signals using visual fixation are disclosed. A panoramic video signal organized into indexed frames is displayed and durations of visual fixations of a viewer of the display are measured by means of detecting the viewer's gaze positions and identifying clusters of adjacent gaze positions. For each visual fixation attaining a prescribed duration threshold, a segment of the panoramic video signal corresponding to a respective view region of prescribed shape and dimensions is extracted to form a filtered video signal. Contents of successive frames of the panoramic signal are cyclically supplied to a bank of content-filtering units operating concurrently to produce individual content-filtered frames which are concatenated for transmission to respective destinations.

Method and system for filtering a panoramic video signal using visual fixation

A panoramic multimedia streaming server communicatively coupled to numerous client devices of different types enables individual client devices to dynamically select view-regions of interest. A source video signal capturing a panoramic field of view is processed to generate a pure video signal faithfully representing the panoramic field of view. The pure video signal is content filtered to produce multiple view-region-specific video signals corresponding to predefined view regions within the panoramic field of view. Frame samples of the pure video signal are transmitted to a client device to enable selection of a view region of interest. Upon receiving, from the client device, an indication of a view region of interest, a controller selects a specific predefined view region according to proximity of each predefined view region to the indicated view region of interest. A view-region-specific video signal corresponding to the specific predefined view region is streamed to the client device.

Method and system for panoramic multimedia streaming enabling view-region selection

Gaze positions of an operator wearing a virtual-reality headset displaying a video stream define preferred view regions of the display. Starting with a reference gaze position, and for each subsequent distinctly different gaze position, the virtual-reality headset sends control data, including three spatial coordinates and a time coordinate expressed as a cyclical video-frame index, to a view adaptor receiving the video stream. The view adaptor stores contents of a number of most recent video frames of the video stream in a circular content-buffer and control data of a number of most recent gaze positions in a circular control-buffer. A content filter within the view adaptor determines a preferred view region surrounding a gaze position according to control data held in the circular control-buffer and extracts a partial content of a respective frame held in the circular content-buffer according to the preferred view region.

Method and system for filtering a panoramic video signal

Method and system for selective content processing based on a panoramic camera and a virtual-reality headset

A universal streaming server providing client-defined content at a permissible flow rate is disclosed. The server performs adaptive content filtering of panoramic multimedia signals based on clients' commands and regulates signal flow rate between the server and each of multiple client devices based on respective content specifications and performance measurements. The server sends a derivative of a panoramic signal capturing a panoramic view to a client device, receives content selection parameters, based on the derivative, from the client device, extracts a partial-coverage signal from the full-coverage signal according to the content selection parameters, and transmits the partial-coverage signal to the client device. The performance measurements include measurements pertinent to a client's receiver and measurement pertinent to a network path to the client's receiver. The server may employ multiple content filters and multiple encoders to serve a large number of clients concurrently.

Streaming network adapted to content selection

Methods and apparatus for panoramic multimedia streaming where viewers may control spatial coverage of panoramic video components of multimedia signals are disclosed. A novel flexible streaming server is devised to perform client-specific content filtering in addition to adapting multimedia signals to characteristics of individual client devices as well as to varying capacities of network paths to client devices. The server may distribute software modules to client devices to enable viewers to communicate preferred view regions of a panoramic scene. The server includes a learning module devised to retain viewing-preference data, correlate viewing preference to characteristics of client devices, and determine a default viewing preference for each client device. The server implements computationally efficient schemes of generating and distributing content-filtered multimedia signals to clients. The server may be implemented using hardware processing units and memory devices allocated within a shared cloud-computing network.

Method and system for panoramic multimedia streaming

A method and a system for selective-content processing of panoramic multimedia signals are disclosed. Features of panoramic cameras and low-latency virtual-reality headsets are exploited to create an advanced efficient system for covering events of diverse and fast-motion actions for the purpose of both broadcasting and data streaming. The disclosed system employs a virtual-reality headset to produce a display of a multimedia signal and generate geometric data defining a view region of the display. A content-filtered signal is extracted from the multimedia signal, according to the geometric data, for broadcasting and dissemination to client devices of a universal streaming server.

To improve the efficiency of media delivery over the Internet, a system and a method are provided for caching remote media files and retrieving cached media files, comprising hardware and software modules as well as steps for storing a remote media file into the cache and retrieving the cached media file based on a signature created by hashing only discrete parts of the media file. The signature is a key for finding the cached media files in the cache upon subsequent requests for the same media file, even if it is received from a different internet location. Media files may be adapted to the characteristics of different media clients, and adapted media files may be equally cached.

System and methods for efficient media delivery using cache

A universal streaming server distributing panoramic multimedia signals with client-controlled content selection and flow-rate adaptation to receiver and network conditions is disclosed. The universal streaming server performs adaptive content filtering based on clients' commands and regulates signal flow rate between the universal streaming server and each of multiple client devices based on performance measurements and content specifications. The performance measurements include measurements pertinent to a client's receiver and measurement pertinent to a network path to the client's receiver. The universal streaming server may employ multiple content filters and multiple encoders to concurrently serve a large number of clients concurrently.

Method and system for flow-rate regulation in a content-controlled streaming network

A wireless system for streaming media files includes a microburst gateway in which microbursts, comprising groups of buffered packets of the streamed media, are transmitted periodically to a user over a broadband channel over respective window periods, the bursts being transmitted at a higher than an average packet rate associated with the media file. At the start of each fairly long window period of 500 ms, for example, one microburst is sent over the broadband channel, leaving the remainder of the window period available for other users. The window period and a number of packets in the burst within the window period are defined so that the average packet rate is substantially maintained. A corresponding microburst gateway and a method for transmitting the media file are also provided.

Growing community of inventors

Chambly, Canada

Jean Mayrand