Method and system for fusing video streams

Abstract

It is provided a method for converting video streams capturing a scene to video streams fitting a viewpoint configuration. The video streams are provided by video cameras, and the method includes receiving parameters associated with the viewpoint configuration, and converting video streams of the scene as captured by the video cameras to video streams fitting the viewpoint configuration. The viewpoint configuration may be a dynamic viewpoint configuration determined by a joystick module. The converting may be done using a three dimensional method, and includes separating objects of the scene from other portions of the scene. The method may includes integrating the scene into the video stream of a certain scene associated with the viewpoint configuration. Sometimes the viewpoint configuration includes a varying zoom and the converting is done using one of several methods, transition between adjacent video cameras having different zoom values, real zooming of a video camera having a motorized zoom, and digital zooming in of video streams. The converting may be done on video streams which have been captured the scene in advance before commencing the converting.