Other

Oran Gilad

Samuel Chenillo

Oren Steinfeld

Systems and methods for producing high-quality image segmentation masks by efficiently augmenting low-quality segmentation masks initially obtained by lightly trained neural networks are disclosed. Sequences of low-quality segmentation masks are transformed into high-quality segmentation masks by first identifying groups of pixels that are consistently segmented in at least three successive video frames. The pixels surrounding the consistently segmented pixels are then examined and assigned gradient alpha values, i.e., degrees of transparency. In one embodiment the alpha values are made proportional to the RGB distance of the pixel from the mean RGB value of the consistently segmented group of pixels.

Enhanced AI image segmentation

A system and method of organically generating a camera-pose map is disclosed. A target image is obtained of a location deemed suitable for augmenting with a virtual augmentation or graphic. An initial camera-pose map is created having a limited number of calibrated camera-pose images having calculated camera-pose locations and homographies to the target image. Then, during the event, the system automatically obtains current images of the event venue and determines homographies to the nearest calibration camera-pose image in the camera-pose map. The separation in camera-pose space between the current images and the camera-pose images are calculated. If this separation is less than a predetermined threshold, that current image is fully calibrated and added to the camera-pose map, thereby growing the map organically.

Organic camera-pose mapping

A system and method of obtaining an occlusion key using a background pixel map is disclosed. A target image containing a target location suitable for displaying a virtual augmentation is obtained. A stream of current images are transformed into a stationary stream having the camera pose of the target image. These are segmented using a trained neural network. The background pixel map is then the color values of background pixels found at each position within the target location. An occlusion key for a new current image is obtained by first transforming it to conform to the target image and then comparing each pixel in the target location with the color values of background pixels in the background pixel map. The occlusion key is then transformed back to conform to the current image and used for virtual augmentation of the current image.

Occlusion key generation

A system and method of video match moving using minimal calibration is disclosed. A camera obtains an initial set of calibration images and a location image. Homographies are then determined between all the images using direct linear transformation. Camera pose locations of the images are determined from the homography matrices. Match moving augmentation is accomplished by obtaining an homography between a live image and the location image, either directly, or by combining an homography to a calibration image with that calibration image's augmentation homography. A virtual augmentation is then placed in the live image. The system evaluates the quality of each live image homography. If of sufficiently high quality, that live image is added to the set of calibration images. When a live image is received, the search for an homography typically starts with the calibration image located closest in camera pose space to the preceding live image.

Video match moving system and method

Systems and methods for precision downstream synchronization of digital streaming content on an edge content processor in the absence of access to pixel-level data by a video player app operative on the edge content processor are disclosed. Encrypted video streams are synchronized to unencrypted video streams using acquired knowledge of the edge content processor's latency, i.e., the time elapsed between a command to render a video frame and that frame being displayed by the edge content processor. Once a predicted time of display of an encrypted video is obtained by a video player app operative on the edge content processor, a corresponding RGBA video frame is delayed by an amount of time equal to that predicted time minus the edge content processor's latency before a command to render it is issued by the video player app, thereby ensuring both frames are displayed simultaneously.

Systems and methods for precision downstream synchronization of content

A system and method for identifying media segments using audio augmented image cross-comparison is disclosed, in which a media segment identifying system analyses both audio and video content, producing a unique identifier to compare with previously identified media segments in a media segment database. The characteristic landmark-linked-image-comparisons are constructed by first identifying an audio landmark. The audio landmark is an audio peak that exceeds a predetermined threshold. Two digital images are then obtained, one associated directly with the audio landmark, and one obtained a predetermined landmark time removed from the first image. The two images are then used to provide a characteristic landmark-linked-image-comparison. The pair of images are reduced in pixel size and converted to gray scale. Corresponding pixels are compared to form a numeric comparison. One image is mirrored before comparison to reduce the possibility of null comparisons.

System and method for media segment identification

A system and method for remunerating a display of a cognate substitute image sequence is disclosed. Images sequences in received video content are examined for sequences that are cognate to known image sequences. When detected, such sequences are replaced with cognate substitute image sequences to create a modified video image stream that is displayed on a display screen. A reasonable remuneration for displaying the cognate substitute image is automatically calculated. This monetary charge reflects the nature of the image sequence, the time it was displayed for, the time at which was displayed and the number of electronic devices within viewing range of the display at the time of display. This remuneration is accumulated, and equivalent digital assets automatically transferred between client and provider accounts at an appropriate time.

System and method for remunerating a display of a cognate substitute video

A system and method of synchronizing auxiliary content to a video stream is disclosed that uses a block of bit-vectors linked to a target frame in a video steam. The block of bit-vectors consists of a multi-frame sequence of image bit-vectors. The video stream and block of bit-vectors are transmitted to an end user device that uses the bit-vector block to uniquely identify the target frame. The target frame is used to synchronize auxiliary content to the video stream.

System and method for synchronizing auxiliary content to a video stream

A system and method of identifying cognate image sequences is disclosed that examines significant frames of a stream of video images using an array of image indexes. The image index array includes image indexes obtained by at least two different image indexing methods. These are compared to a corresponding array of image indices of significant frames of known image sequences. An image quality indicator is used to determine which set of image index thresholds to use in making the comparison. These thresholds are more stringent for higher quality frames. Two image sequences are considered cognate when a string of sufficiently many sequential frame matches is established. In an alternate embodiment, image blurriness is also, or instead, used to determine the appropriate set of image index thresholds. The sets of image index thresholds are determined using machine learning on a curated set of representative images.

Growing community of inventors

Herzliya Pituach, Israel

Oran Gilad