Evernote Corporation

Mmhmm Inc.

Corestreet, Ltd.

Assa Abloy Ab

All Turtles Corporation

3m Innovative Properties Company

Sunflower Labs Inc.

Bending Spoons S.p.a.

Daommo, Inc.

Phil Libin

Silvio Micali

David Engberg

Alex Pachikov

Andrew Sinkov

Phil Constantinou

Leonid Kitainik

Jakob Bignert

Dmitry Stavisky

Alex Sinelnikov

Pavel Skaldin

Zeesha Currimbhoy

Leo Reyzin

Brandon Volbright

James E Nash

Alexander S Pachikov

Mark Ayzenshtat

Keith Lang

Monina Dolan

Juan Carlos Jimenez

Michael Dolan

Richard M Warwick

Christopher Hinkle

Jeff Zwerner

Ken Ryall

Connie Chan

Matthew Armendariz

Alexander Pashintsev

Boris Gorbatov

Eugene Livshitz

Stephen F White

Jeffrey Zwerner

Christian Eheim

Christopher Winson Hinkle

Gabe Campodonico

Seth Hitchings

Dairien Marcus Boyd

Wentao Zheng

Chuhan Wang

Roelof F Botha

Dala Botha

Stephen James White

Matthew Tonkin

Handling unacceptable behavior by a user making a video recording includes detecting the unacceptable behavior by the user while the user is making the recording by applying machine learning to data about the user received from capturing devices. A predetermined list of bad habits is used and recognition accuracy is used for an episode of the unacceptable behavior. The episode is marked in the video recording and added to a list of bad habit episodes for the video recording if recognition accuracy of the episode is high. The user is prompted for confirmation of the episode if the recognition accuracy of the episode is low. The episode is marked in the video recording and added to the list of bad habit episodes if the recognition accuracy of the episode is low and the user confirms the episode. The machine learning may include an initial training phase.

Recognizing and mitigating displays of unacceptable and unhealthy behavior in immersive video recordings

Enhancing interactivity of a user with a portion of a web page includes providing visual codes for some items on the web page that are part of the portion of the web page. Each of the visual codes corresponds to temporal, geographical, content, activity, and/or behavior attributes of the at least some items. Enhancing interactivity also includes providing a user-actuatable mechanism on the web page to capture the portion of the web page and to create a visual code shortcut for each of the visual codes corresponding to the portion of the web page and storing the portion of the web page. The portion is stored in a repository that is indexed according to the visual code shortcuts. The portion of the web page is retrievable from the repository at a later time by accessing the visual code shortcuts. The portion of the web page may be a news page.

Dynamic visual coding of temporal, geography and activity driven user interfaces

Mapping a source video stream to a screen of a target device includes extracting separate objects from the source video stream, identifying a subset of the objects that correspond to a presentation area, and creating a target video stream that is displayed on the target device by arranging the separate objects to enhance the presentation area on the screen of the target device based on a form factor, screen resolution, and/or aspect ratio of the target device. The presentation area may include a presenter and presentation materials. Creating the target video stream may include scaling different ones of the objects. Different scaling factors may be applied to different objects to enhance the presentation area on the screen of the target device. A separate video image corresponding to a linear mapping of the source video stream onto a target device may be provided in addition to the target video stream.

Optimal mapping of immersive video presentations between devices with different form factors

Manipulating an image in a combined immersive video space for a replayed pre-recorded video being displayed to a plurality of participants includes associating an anchor to a background of the combined immersive video space, static interior objects in the combined immersive video space, and/or dynamic interior objects in the combined immersive video space, providing an image corresponding to an original presenter in the pre-recorded video, an object in the combined immersive video space, and/or one of the participants that is viewing pre-recorded video, and actuating an anchor activation control that causes the image to move to a position of the anchor while other ones of the participants are viewing the pre-recorded video. The image may move to the position of the anchor along a transitional route and may change appearance as the image moves. The position of the anchor may be preset before replaying the pre-recorded video.

Anchors and interactive forms for asynchronous video presentations with immersive viewers

Providing a shared experience of a pre-recorded video content on video screens of devices of a plurality of participants includes presenting, on the video screens, video content corresponding to the pre-recorded video having superimposed thereon a live video feed, determining feedback of the participants to the video content, providing to the devices background noise that varies according to the feedback of the participants, and altering acoustic properties of sound for the video content provided to the devices based on acoustic properties of an emulated presentation space for the video content. Altering acoustic properties may include varying echo and reverberation levels and intensities of the sound. Altering acoustic properties may use secondary echo-generating audio reproduction sources for varying echo and emulators of reverberating surfaces for varying reverberation levels. A subset of the participants may be immersed in the emulated presentation space. The sound audio properties may be different for different participants.

Adaptive audio for enhancing individual and group consumption of immersive asynchronous audio-video content

Presenting a pre-recorded video presentation to an audience includes creating a plurality of pre-recorded alternative video portions that correspond to portions of the pre-recorded video presentation, each of the alternative video portions having a different level of granularity of subject level detail than any other alternative video portion, at least some of the portions including transition points to facilitate transitioning between alternative video portions of different granularity and measuring audience feedback while presenting the pre-recorded video presentation. In response to the audience feedback indicating at least one of: discomfort, confusion or questioning of content of a current portion of the pre-recorded video presentation by members of the audience, availability of at least one of the pre-recorded alternative video portions to replace the current portion of the pre-recorded video presentation is determined. The current portion of the pre-recorded video presentation may be stopped at a transition point.

Asynchronous video presentations with multi-variant pre-recording, alternative flows, and immersive features

A particular user selectively searches a video repository by measuring physiological parameters of a plurality of users of the video repository while the users watch at least some of the videos of the video repository, determining attraction values of the users to the at least some of the videos based, at least in part, on the physiological parameters, forming groups of the users by maximizing an aggregate of attraction values to a subset of videos of the video repository that have been watched by at least one member of each of the groups, and searching only the subset of videos of the video repository that have been watched by at least one member of a particular group that corresponds to the particular user. The physiological parameters may include heart rate, eye movement, gaze direction, and/or facial expressions. The heart rate may be measured using wearable technology.

Asynchronous video repositories with threaded discussions and affinity groups

Viewing an object detected within a property perimeter includes using a fixed camera to view the object, adjusting optical zoom and/or digital zoom of the fixed camera in response to an initial image of the object from the fixed camera being of insufficient quality to fully assess the unknown object, using different zoom levels of the fixed camera to determine a satisfactory zoom level based on a relationship between zoom level, image quality, and security threat forecast, dispatching a multicopter with a camera to a location of the unknown object in response to the fixed camera being unable to reach the satisfactory zoom level, and providing an image of the unknown object from the camera of the multicopter. The multicopter may be dispatched following interpolating a forecast line to determine that the fixed camera is unable to reach the satisfactory zoom level. Dispatching the multicopter may include optimizing flight trajectory.

Enhancing zooming capabilities of a security camera by automatically employing a multicopter

Providing a video presentation includes preparing a plurality of different background environments that include a structured list of visual components and parameters therefor for different portions of the presentation prior to the video presentation, selecting a subset of the background environments, value ranges, and initial values for a subset of the parameters of the background environments prior to the presentation, selecting multiple alternative background environments for at least one of the portions prior to the video presentation, presenting to an audience at least one presenter superimposed on the different ones of the background environments during different portions of the video presentation, replacing a particular one of the background environments for the at least one of the portions during the presentation with one of the multiple alternative background environments, and modifying values selected for at least some of the subset of the parameters during the video presentation within the value ranges.

Parametric construction of hybrid environments for video presentation and conferencing

Enhancing a video conference that is provided by video conference software includes a subset of participants of the video conference using a particular add-on application that is compatible with the video conference software, the add-on application obtaining communication parameters from the video conference software, discovering the subset of the participants, and the add-on application using the communication parameters from the video conference software to provide at least some of the subset of the participants with private communication that is independent of communication capabilities provided by the video conference software and to provide at least one visual indication to each of the subset of participants. The add-on application may provide specific data to the video conference software. The video conference software may provide the specific data to particular participants of the video conference independently of whether any of the particular participants have the add-on application.

User grouping via immersive add-on applications for extended video conferencing experiences and feedback

Adapting an asynchronous audio-visual presentation includes storing custom backdrops prior to presenting the asynchronous audio-visual presentation, assessing a degree of engagement for at least some of the participants by monitoring participant reactions and feedback while presenting the asynchronous audio-visual presentation, and modifying the asynchronous audio-visual presentation based on the degree of engagement of at least some of the participants by replacing a backdrop of the asynchronous audio-visual presentation with one of the custom backdrops. The degree of engagement of each of the participants may be positive/productive, angry/over-reacting, or indifferent. The degree of engagement of each of the participants may be based, at least in part, on non-verbal cues. The non-verbal cues may include postures, gestures, gaze direction and facial expressions that are captured by cameras of the participants and/or physiological parameters of at least some of the participants. A single participant or multiple participants may view the asynchronous audio-visual presentation.

Adaptive audio-visual backdrops and virtual coach for immersive asynchronous video content

Augmenting a presentation includes a presenter wearing clothing having specific visual characteristics, obtaining an image of the presenter, detecting the specific visual characteristics in the image of the presenter, creating an augmented image of the presenter by adding to the image one or more virtual components that vary according to the specific visual characteristics, and presenting the augmented image to a plurality of participants of the presentation on computer screens that are viewed by the participants. The specific visual characteristics may include a special pattern, an emblem, a sticker, fashion style, and/or color. Adding one or more virtual components may include superimposing different clothing onto the image of the presenter. The different clothing may alter color, patterns, textures, fit, fashion, character type, and/or material properties of original clothing of the presenter. Adding virtual components may include adding one or more external components that are separate from the presenter.

Recognizable clothing with adaptive augmentation capabilities for enhancing user interface for asynchronous presentations and video conferencing

The various implementations described herein include methods, devices, and systems for preparing notes stored in a user repository. A method includes, at a user device having memory and one or more processors, generating based on content previously stored in a note, a note preview including note identifying information, and causing presentation, via the user device, of the note preview including the note identifying information. The method includes, responsive to user selection of the note preview, causing presentation, via the user device, of the note associated with the note preview. The method also includes while displaying the note associated with the note preview, receiving user input to include additional content in the note, and responsive to the user input to include additional content in the note, modifying the note and the note preview based on the additional content. The method further includes storing the note in the user repository.

Systems and methods for obtaining search results

Setting a replay speed of a pre-recorded video presentation includes determining a mood of a presenter of the pre-recorded video presentation, determining complexity of material that is presented in the pre-recorded video presentation, and setting a replay speed based on the mood of the presenter and the complexity of the material that is presented. Setting a replay speed of a pre-recorded video presentation may also include adjusting the replay speed based on determining a desired speech tempo for a listener. The desired speech tempo of the listener may be based on time of day, age of the listener, and/or comprehension level of the listener. Measuring the comprehension level of the listener may be based facial expressions of the listener, eye-tracking of the listener, and/or listener comprehension quizzes. Measuring the mood of the presenter may be based on facial recognition, sentiment recognition, and/or gesture recognition.

Speed adjustment of recorded audio and video to maximize desirable cognitive effects for the audience

Sharing content includes verifying occurrence of an event, determining participants of the event, gathering related content generated by the participants, where the related content corresponds to the event, and disseminating the related content to the participants. The event may be a business meeting. Verifying occurrence of an event may include determining scheduled participants, scheduled location, and scheduled time of the event using an electronic calendar of one of the scheduled participants. Participants may include the scheduled participants and other participants that are not listed in the electronic calendar where the other participants attend the event. Verifying occurrence of an event may also include confirming that at least an event organizer is at the scheduled location at the scheduled time and there is at least one other one of the participants. The content may include documents, photos, scanned images, audio clips, video clips, typed notes, and/or handwritten notes.

Content associations and sharing for scheduled events

Growing community of inventors

San Jose, CA, United States of America

Phil Libin