Last Thursday, the U.S. Patent and Trademark Office officially published another round of Vision Pro related patent applications covering visionOS, the Fit Dial, FaceTime and more.
Gestures for Selection Refinement in a 3D Environment (Vision Pro)
The Apple VisionOS related patent covers embodiments, a computer system facilitates user input for displaying a selection refinement user interface object in an object within a three-dimensional environment, wherein the selection refinement user interface object indicates a location in the object at which the computer system performs a selection operation in response to further user input.
In some embodiments, while displaying the object in the 3D environment, the computer system detects an air gesture provided by a hand of the user.
In some embodiments, if the air gesture satisfies a first set of criteria, the computer system displays the refinement user interface object in the object at a location that is based on attention of the user.
In some embodiments, the first set of criteria is satisfied if the air gesture includes a first portion of a selection input, followed by a confirmation gesture, and/or if the air gesture includes a first type of gesture while the hand is in a first pose.
In some embodiments, if the air gesture satisfies a second set of criteria, the computer system performs a selection operation at a location that is based on the attention of the user without displaying the refinement user interface object.
In some embodiments, the second set of criteria is satisfied if the air gesture includes a first portion of a selection input, followed by a second portion of the selection input, and/or if the air gesture includes a second type of gesture while the hand is in a second pose.
In some embodiments, a computer system facilitates user input for activating a selection refinement mode in a three-dimensional environment during which an interaction point for a selection operation is movable based on movement of a hand of the user of the computer system.
In some embodiments, while an object is displayed in the three-dimensional environment, the computer system detects an air gesture provided by the hand of the user. In some embodiments, in response to detecting the air gesture, the computer system activates the selection refinement mode, which includes displaying a refinement user interface object within the object at a location that is based on the attention of the user. In some embodiments, while the refinement user interface object is displayed in the object, the computer system moves the refinement user interface object in response to detecting movement of the hand of the user. In some embodiments, if the computer system detects an activation gesture provided by the hand of the user, the computer system performs a selection operation based on the location of the refinement user interface object in the object.
In Apple's patent FIG. 7C1 below, display generation component #120 includes one or more internal image sensors #314a oriented towards the face of the user (e.g., eye tracking cameras). In some embodiments, internal image sensors #314a are used for eye tracking (e.g., detecting a gaze of the user). Internal image sensors are optionally arranged on the left and right portions of display generation component to enable eye tracking of the user's left and right eyes. The display generation component also includes external image sensors #314b and #314c facing outwards from the user to detect and/or capture the physical environment and/or movements of the user's hands.
In FIG. 7C1, the display generation component is illustrated as displaying content that optionally corresponds to the content that is described as being displayed and/or visible via the display generation component.
In some embodiments, the display generation component includes two or more displays (e.g., left and right display panels for the left and right eyes of the user.
Translated from: patentlyapple
English 
Chinese