Mmhmm Inc.

Evernote Corporation

Leonid Kitainik

Phil Libin

Alexander Pashintsev

Boris Gorbatov

Christopher Winson Hinkle

Hemant Garg

Stephen James White

Mapping a source video stream to a screen of a target device includes extracting separate objects from the source video stream, identifying a subset of the objects that correspond to a presentation area, and creating a target video stream that is displayed on the target device by arranging the separate objects to enhance the presentation area on the screen of the target device based on a form factor, screen resolution, and/or aspect ratio of the target device. The presentation area may include a presenter and presentation materials. Creating the target video stream may include scaling different ones of the objects. Different scaling factors may be applied to different objects to enhance the presentation area on the screen of the target device. A separate video image corresponding to a linear mapping of the source video stream onto a target device may be provided in addition to the target video stream.

Optimal mapping of immersive video presentations between devices with different form factors

Providing a shared experience of a pre-recorded video content on video screens of devices of a plurality of participants includes presenting, on the video screens, video content corresponding to the pre-recorded video having superimposed thereon a live video feed, determining feedback of the participants to the video content, providing to the devices background noise that varies according to the feedback of the participants, and altering acoustic properties of sound for the video content provided to the devices based on acoustic properties of an emulated presentation space for the video content. Altering acoustic properties may include varying echo and reverberation levels and intensities of the sound. Altering acoustic properties may use secondary echo-generating audio reproduction sources for varying echo and emulators of reverberating surfaces for varying reverberation levels. A subset of the participants may be immersed in the emulated presentation space. The sound audio properties may be different for different participants.

Adaptive audio for enhancing individual and group consumption of immersive asynchronous audio-video content

Presenting a pre-recorded video presentation to an audience includes creating a plurality of pre-recorded alternative video portions that correspond to portions of the pre-recorded video presentation, each of the alternative video portions having a different level of granularity of subject level detail than any other alternative video portion, at least some of the portions including transition points to facilitate transitioning between alternative video portions of different granularity and measuring audience feedback while presenting the pre-recorded video presentation. In response to the audience feedback indicating at least one of: discomfort, confusion or questioning of content of a current portion of the pre-recorded video presentation by members of the audience, availability of at least one of the pre-recorded alternative video portions to replace the current portion of the pre-recorded video presentation is determined. The current portion of the pre-recorded video presentation may be stopped at a transition point.

Asynchronous video presentations with multi-variant pre-recording, alternative flows, and immersive features

A particular user selectively searches a video repository by measuring physiological parameters of a plurality of users of the video repository while the users watch at least some of the videos of the video repository, determining attraction values of the users to the at least some of the videos based, at least in part, on the physiological parameters, forming groups of the users by maximizing an aggregate of attraction values to a subset of videos of the video repository that have been watched by at least one member of each of the groups, and searching only the subset of videos of the video repository that have been watched by at least one member of a particular group that corresponds to the particular user. The physiological parameters may include heart rate, eye movement, gaze direction, and/or facial expressions. The heart rate may be measured using wearable technology.

Asynchronous video repositories with threaded discussions and affinity groups

Providing a video conference for multiple participants includes choosing between at least one physical conference space and at least one virtual conference space, a first one of the participants inviting a second one of the participants to the video conference, the second one of the participants joining the video conference, and conducting the video conference by showing the participants in a same conference space in real time. The conference space may be a physical location of one of the participants or may be a virtual conference space. The participants may switch between the at least one physical conference space and the at least one virtual conference space during the video conference. The first one of the participants may invite the second one of the participants by sending a link. At least one of the participants may see the first participant and the second participant interacting in the conference space.

Immersive and reflective video chat

Adapting an audio portion of a video conference includes a presenter providing content for the video conference by delivering live content, prerecorded content, or combining live content with prerecorded content, at least one additional co-presenter provides content for the video conference, and untangling overlapping audio streams of the presenter and the co-presenter by replaying individual audio streams from the presenter and/or the at least one co-presenter or separating the audio streams by diarization. Adapting an audio portion of a video conference may also include recording the presenter to provide a recorded audio stream, using speech-to-text conversion to convert the recorded audio stream to text, correlating the text to the recorded audio stream, retrieving a past portion of the recorded audio stream using a keyword search of the text, and replaying the past portion of the recorded audio stream. The keyword may be entered using a voice recognition system.

Adaptive audio for immersive individual conference spaces

Enhancing image quality of an initial full image of a document page includes obtaining the initial full image of a document page, determining that at least a subset of text in the initial full image does not meet a predefined readability criterion, identifying at least one of a plurality of page fragments in the initial full image of the document page for enhancement, and sending an instruction to a mobile device to provide a photograph of the at least one of the page fragments. The photograph provides a separate fragment image for the at least one of the page fragments. The separate fragment image is then obtained from the mobile device and merged into the initial full image to provide an enhanced full image.

Adaptive enhancement of scanned document pages

Enhancing image quality of an initial full image of a document includes subdividing the initial full image of the document into a number of segments, determining at least one of the segments for enhancement, directing a user to take photographs with a smartphone to provide a separate segment image for the at least one of the segments by presenting on a screen of the smartphone a view of the document having lines superimposed thereon corresponding to the segments, and merging the separate segment image to provide an enhanced full image. The number of segments may depend upon a size of text in the initial full image and a desired height of text in the enhanced full image. The view of the document having lines superimposed thereon corresponding to the segments may provide a target to the user for photographing the at least one of the segments.

Local enhancement of large scanned documents

Handling event data received by a mobile device includes filtering out at least a subset of event data based on pre-determined filtering rules, forming groups of event data by grouping at least some of the event data that has not been filtered out based on pre-determined grouping rules, and storing, based on pre-determined auto-filing rules, at least one of: groups of event data and non-filtered event data that is not included with any groups of event data. The event data may include photos, videos, recorded voice notes, phone calls, voice mails, user location data, messaging data, calendar entries, email messages, wireless data transmissions, and/or events scheduled from software applications and online services. The filtering rules may be based on a filtering criteria such as time, location, keyword match, semantic similarity, and/or relations to known events.

Assisted memorizing of event-based streams of mobile content

Enhancing image quality of an initial full image of a document includes subdividing the initial full image of the document into a number of segments, directing a user to take photographs with a smartphone to provide a separate segment image for each of the segments by presenting on a screen of the smartphone a view of the document having lines superimposed thereon corresponding to the segments, and merging the separate segment images to provide an enhanced full image. The number of segments may depend upon a size of text in the initial full image and a desired height of text in the enhanced full image. The initial full image may be provided by a photograph taken by the user with the smartphone. The view of the document having lines superimposed thereon corresponding to the segments may provide a target to the user for photographing the segments.

Growing community of inventors

San Jose, CA, United States of America

Leonid Kitainik