Adobe, Inc.

Microsoft Technology Licensing, LLC

Mrinal Kumar Sharma

Gourav Singhal

Sourabh Gupta

Jose Ignacio Echevarria Vallespi

Nirmal Kumawat

Saikat Chakrabarty

Shikhar Garg

Shailendra Singh Rathore

A method of and system for providing accessibility for digital ink is carried out by detecting digital ink input on a user interface (UI) screen, the digital ink input being received via a writing instrument used by a user within a given time period; capturing an image of the digital ink input; examining the image of the digital ink input to detect tremors in the user; assigning a level to the tremors based on discontinuities or irregularities in the digital ink input within the given time period; determining based on the level that the digital ink input requires correction; and applying a correction to the digital ink input to correct the digital ink input.

System and method of providing accessibility in use of digital ink

A computer readable medium for sizing a product includes instructions, that when executed by at least one processor, cause a computing device to: retrieve from a webpage information on a product including product dimensions; present on a display of a client device a graphical button that upon access by a user activates a camera for capturing an image of an object positioned at a focal distance from the camera, the object having a surface; prompt the user to enter boundary information of an imaginary housing to be placed on the surface; generate the imaginary housing dimensions in two dimensions (2D) based on the boundary information and the focal distance; and determine whether the product fits within the imaginary housing by comparing the product dimensions against the imaginary housing dimensions.

Assisting users in visualizing dimensions of a product

The present disclosure relates to systems, non-transitory computer-readable media, and methods for generating and providing pose guides that are tailored to a context of a camera viewfinder stream. In particular, in one or more embodiments, the disclosed systems determine a context of the camera viewfinder stream and provide sample pose images that correspond with the determined context. In response to a selection of a sample pose image, the disclosed systems generate and display a pose guide that is customized to the proportions of a subject depicted in the camera viewfinder stream. The disclosed systems further iteratively modify portions of the generated pose guide to indicate that the subject depicted in the camera viewfinder stream is coming into alignment with the generated pose guide. The disclosed systems automatically capture a digital image when the subject is in total alignment with the generated pose guide.

Providing contextual augmented reality photo pose recommendations

A method for content-aware type-on-path generation is implemented via a computing system including a processor. The method includes surfacing an image via a graphics GUI of a graphics application and detecting one or more salient objects within the image using a CNN model. The method also includes generating a contour map for each detected salient object and generating a path along the contours of each salient object by applying a defined offset to the corresponding contour map. The method further includes applying input text characters as type-on-path along the generated path based at least on user input received via the graphics GUI.

Content-aware type-on-path generation along object contours

A method for streaming videos with internally-variable frame quality is implemented via a computing system including a processor. The method includes accessing a video including and evenly sampling the video frames. The method includes, for each sampled video frame, analyzing the video frame using a CNN model to determine whether the video frame includes high-relevance region(s). The method also includes, for each sampled video frame including high-relevance region(s), extracting coordinates of the high-relevance region(s) using the CNN model, and for each sampled video frame including high-relevance region(s) and each intervening video frame between the sampled video frame and a next sampled video frame, setting a minimum frame quality for the extracted coordinates. The method further includes streaming the video with internally-variable frame quality by buffering the extracted coordinates within the video frames with the minimum frame quality, while buffering remaining coordinates within the video frames with a lower frame quality.

Streaming video with internally-variable frame quality based on intelligent identification of high-relevance regions

Techniques are provided herein for retrieving images that correspond to a target subject matter within a target context. Although useful in a number of applications, the techniques provided herein are particularly useful in contextual product association and visualization. A method is provided to apply product images to a neural network. The neural network is configured to classify the products in the images. The images are associated with a context representing the combination of classified products in the images. These techniques leverage both seller-provided images of products and user-generated content, which potentially includes hundreds or thousands of images of the same or similar products as the seller-provided images. A graphical user interface is configured to permit a user to select the context of interest in which to visualize the products.

Retrieving images that correspond to a target subject matter within a target context

Techniques are disclosed for identifying and presenting video content that demonstrates features of a target product. The video content can be accessed, for example, from a media database of user-generated videos that demonstrate one or more features of the target product so that a user can see and hear the product in operation via a product webpage before making a purchasing decision. The product functioning videos supplement any static images of the target product and the textual product description to provide the user with additional context for each of the product's features, depending on the textual product description. The user can quickly and easily interact with the product webpage to access and playback the product functioning video to see and/or hear the product in operation.

Integrating video content into online product listings to demonstrate product features

Review videos on product pages are enhanced with user interface elements that cause playback of the review videos at points at which particular topics are discussed. A review video is processed by converting speech to text and timestamping the text. Topics are identified in the text, and a time in the review video corresponding to each topic is identified from the timestamps for the text. In some configurations, sentiment is also determined for each topic. User interface elements corresponding to each identified topic are presented with the review video on the product page. When a user viewing the product page selects a user interface element, the review video is played at a time corresponding to the topic of the selected user interface element.

Enhancing review videos

A method for generating geolocation-specific subtitles for a video is implemented via a computing system including a processor. The method includes accessing, via the processor, a video including an embedded subtitle file, extracting the subtitle file from the video, extracting unit values from the subtitle file, and extracting a geolocation of a user executing a video streaming application. The method also includes converting the unit values within the subtitle file to geolocation-specific unit values using a unit conversion map, where the geolocation-specific unit values correspond to the extracted geolocation of the user. The method further includes streaming the video with subtitles from the subtitle file on a video GUI of the video streaming application and, simultaneously with the streaming of the video, surfacing the geolocation-specific unit values within a unit conversion GUI of the video streaming application that is surfaced on top of the video GUI.

Geolocation-specific subtitle generation

Methods, systems, and non-transitory computer readable media are disclosed for determining a sub-set of user-submitted images that are similar to a curated image and presenting the sub-set of user-submitted images in connection with the curated image. The disclosed system presents a curated image depicting a product via a graphical user interface (e.g., on an e-commerce platform). In one or more embodiments, the disclosed system extracts feature vectors from the curated image and a plurality of user-submitted images. The disclosed system compares the feature vectors from the curated image and the plurality of user-submitted images to determine a sub-set of user-submitted images that are similar to the curated image. The disclosed system presents the sub-set of user-submitted images based on a user selection of the curated image.

Automatic clustering and mapping of user generated content with curated content

Techniques are provided for providing a user with retrieved images of a specific article of clothing or accessory worn by models having a particular body type and pose as selected by the user. The images have been analyzed to identify both a body type and pose of the model wearing the article of clothing in each of the images. The images are labeled based on at least body type and pose of the model and clustered based on their labels, and are thus available for retrieval by subsequent requests by a user. In particular, a user that is interested in the article of clothing can input one or more requests for images of models having a selected body type and pose. Any of the images labeled with the selected body type and pose can then be provided to the user in any number ways.

Retrieving images that correspond to a target body type and pose

In implementations of image content snapping guidelines, a guidelines segmentation system includes modules, such as an image pre-processing module to reduce the image size of a digital image if the image size exceeds an image size threshold. An object segmentation module segments objects depicted in the digital image and identifies each object by a bounding border that delineates an object region boundary. An edge detection module receives a segmented object and determines object external edges and object feature edges from the segmented object, and identifies object corners of the object. A snapping guidelines module determines image content snapping guidelines of an object depicted in the digital image, the image content snapping guidelines for an object determined based on the bounding border of the object region boundary, the object external edges, the object feature edges, and projected snapping guidelines that extend from the object corners of the object.

Image content snapping guidelines

Providing contextual augmented reality photo pose guidance

The present disclosure relates to systems, non-transitory computer-readable media, and methods that generate customized color editing options tailored to a digital image. In particular, in one or more embodiments, the disclosed systems generate an interactive editing user interface that includes selectable color controls corresponding to dominant colors extracted from the digital image and ordered by dominance. In at least one embodiment, the disclosed systems utilizes clustering techniques associated with the dominant representative colors to generate contour paths in the digital image further enabling dynamic interactive image editing.

Growing community of inventors

Hazaribagh, India

Mrinal Kumar Sharma