Samsung Electronics Co., Ltd.

Bonkon Koo

Jaewoo Ko

Kyookeun Lee

Jongchul Choi

Wonwoo Lee

Doyoun Kim

Youngmo Jeong

Jeonggeun Yun

Sangho Yoon

Wonjun Lee

Myongjo Choi

Kyusub Kwak

Harry Edward Milton

Sunghwan Shin

Taehwa Hong

Dowan Kim

Jaeyeol Ryu

Jaeyun Jeong

Kimin Kim

Sanghyun Yi

Soonseob Han

A head mounted display (HMD) apparatus may include: a display; an optical lens adjacent to a first side of the display; at least one light source configured to emit light; and at least one eye-tracking sensor adjacent to a second side of the display and configured to obtain gaze information about a user by receiving reflected light that is the light emitted from the at least one light source and reflected off eyes of the user. The display may include a second display region corresponding to a position of the at least one eye-tracking sensor, and a first display region other than the second display region. A number of pixels per unit area of the first display region may be greater than a number of pixels per unit area of the second display region.

Head mounted display apparatus including eye-tracking sensor and operating method thereof

An augmented reality (AR) device for detecting a user's gaze and a method thereof are provided. The AR device includes a waveguide; a light reflector including a pattern; a support configured to fix the AR device to the user's face of the AR device; a light emitter and a light receiver installed on the support; and at least one processor, wherein the at least one processor is configured to control the light emitter to emit light toward the light reflector, identify the pattern based on the light received through the light receiver, and obtain gaze information of a user of the AR device based on the identified pattern.

Augmented reality device and method for detecting user's gaze

An augmented reality (AR) device including a variable focus lens of which a focal length may be changed by adjusting refractive power and adjusting the position of a focus adjustment region of the variable focus lens according to a direction of the user's view. The AR device may obtain an eye vector indicating a direction of the user's view using an eye tracker, adjust a refractive power of a first focus adjustment region of a first variable focus lens to change a focal length for displaying a virtual image, and complementarily adjust a refractive power of a second focus adjustment lens with respect to the adjusted refractive power of the first focus adjustment region.

Augmented reality device for adjusting focus region according to direction of user's view and operating method of the same

A head-mounted display device includes an eye tracking sensor configured to obtain eye information by tracking both eyes of a user, a depth sensor configured to obtain depth information about one or more objects, and a processor configured to obtain information about a gaze point based on the eye information, and determine a measurement parameter of the depth sensor based on the information about the gaze point.

Head-mounted display device and operating method of the same

Provided is a method of identifying a hand of a genuine user wearing a wearable device. According to an embodiment, the method includes using a sensor included in the wearable device to recognize a hand located in a detection area of the sensor; estimating a position of a shoulder connected to the recognized hand based on a positional relation between the orientation of the recognized hand and at least one body part connected to the recognized hand; and using information about a probability of a shoulder of the genuine user being present in the estimated position to determine whether the recognized hand is a hand of the genuine user.

Method for identifying user's real hand and wearable device therefor

Provided is an augmented reality device including a variable focus lens, an eye tracking sensor configured to emit light to eyes of a user, receive the light reflected by the eyes of the user, and detect a plurality of feature points based on the light reflected by the eyes of the user, and at least one processor configured to obtain information with respect to eye relief, which is a distance between the eyes of the user and the variable focus lens, based on position information of the plurality of feature points detected by the eye tracking sensor, obtain information with respect to a gaze point at which gaze directions of the eyes of the user converge, and an interpupillary distance of the eyes of the user, based on the plurality of feature points, and determine a position of a focal region of the variable focus lens based on the information with respect to the eye relief, the gaze point, and the interpupillary distance.

Augmented reality device including variable focus lenses and operating method thereof

Provided are a device and method for correcting the vision of a user and performing calibration. A method, performed by an augmented reality device, of performing gaze tracking sensor calibration based on a gaze of a user includes outputting at least one first character in a preset size through a waveguide of the augmented reality device, obtaining at least one first input for the at least one first character, obtaining at least one piece of first gaze information detected through a gaze tracking sensor of the augmented reality device at a time point at which the at least one first input is obtained, comparing the at least one first character with the at least one first input, and determining a first refractive power to be a refractive power of the varifocal lens of the augmented reality device, based on a result of the comparing.

Device and method for correcting user's vision and performing calibration

An augmented reality (AR) device for obtaining depth information of an object in a real world, includes: a gaze tracking sensor configured to obtain a gaze point by tracking a gaze direction of a user's eye; a depth sensor configured to obtain depth information of the object; a memory storing one or more instructions; and at least one processor configured to execute the one or more instructions to: determine a region of interest (ROI) confidence level indicating a degree to which at least one partial region within a field of view (FOV) of the AR device is predicted as an ROI, based on at least one of a moving speed, an acceleration, a fixation time, a fixation number, or a location of the gaze point; determine an ROI based on the ROI confidence level; and set a parameter for controlling an operation of the depth sensor to obtain depth information of the object within the ROI.

Augmented reality device for obtaining depth information of object and operating method thereof

Provided is an electronic device for detecting lost portions of a field of vision and distorted portions of a field of vision and storing these in a vision map. The lost portions and distorted portions are identified in cooperation with the user by means of virtual image superposition on a real scene, audible requests to the user, gesture inputs provided by the user and gaze tracking. The electronic device may detect an object and provide visual information to a user when the object is in a lost portion or distorted portion of the field of vision.

Electronic device and method of operating the same

A method, performed by an augmented reality (AR) device including a vision correction lens, of detecting a gaze of a user is provided. The method includes obtaining lens characteristic information about the vision correction lens arranged to overlap a light guide plate in a gaze direction of the user, emitting light for gaze tracking toward a light reflector through a light emitter, wherein the emitted light is reflected by the light reflector and then directed to an eye of the user, receiving a light reflected by the eye of the user through a light receiver, obtaining an eye image of the user based on the light received, adjusting the eye image of the user based on the lens characteristic information about the vision correction lens, and obtaining gaze information based on the adjusted eye image.

Augmented reality device and method for detecting gaze of user

An augmented reality (AR) device is provided. The AR device includes a display module configured to output light of a virtual image, a waveguide configured to transmit the output light of the virtual image to an eye of a user and to pass external light therethrough, a gaze tracking sensor configured to obtain information on the eye of the user, the information including a pupil size, a memory storing instructions, and a processor configured to execute the instructions to control the display module to adjust a brightness of the light of the virtual image based on the pupil size.

Augmented reality device and operating method thereof

A method, by an augmented reality device, of measuring a depth of an object includes determining, from a dot-pattern and a surface-pattern, a pattern of light to be emitted for measuring the depth of the object, identifying, from within an entire area of a pattern generator, a partial area of a light source unit corresponding to an area for the determined pattern, emitting light through the area for the determined pattern, by activating the identified partial area of the light source unit, receiving light reflected from the object; and measuring the depth of the object based on the emitted light and the received reflected light.

Growing community of inventors

Suwon-si, South Korea

Bonkon Koo