The Quest v64 update brought two undocumented major new features.

本月早些时候发布的版本 64正式为 Quest 3 带来了改进的直通质量、外部麦克风支持和躺着模式,并使摘下头显时投射不再结束。

But Quest power users have noticed v64 also brings two major features not mentioned in the changelog: furniture recognition on Quest 3 and simultaneous hand tracking and Touch Pro or Touch Plus controllers in the home space.

Furniture Recognition On Quest 3

Quest 3 generates a 3D mesh of your room during mixed reality setup, and could always infer the positions of your walls, floor, and ceiling from this 3D mesh. But until v64 the headset didn't know which shapes within this mesh represent more specific elements like doors, windows, furniture, and TVs. You could manually mark these out, but that manual requirement meant developers couldn't rely on users having done so.

With v64 though, at the end of mixed reality room scanning Quest 3 now creates a labeled rectangular cuboid bounding box

  • Doors
  • Windows
  • Beds
  • Tables
  • Sofas
  • Storage (cabinets, shelves, etc)
  • Screens (TVs and monitors)
来自Squashi9 的Quest 3 v64 家具识别片段。

Quest developers can access these bounding boxes using Meta's Scene API and use them to automatically place virtual content. For example, they could place a tabletop gameboard on the largest table in the room, replace your windows with portals, or depict your TV in a fully VR game so you don't punch it.

Apple Vision Pro already gives developers a series of crude 2D rectangles representing the surface of seats and tables, but doesn't yet provide a 3D bounding box. The RoomPlan API on iPhone Pro can do 3D bounds, but that API isn't available in visionOS.

Since last year Quest developers have been able to experiment with using hand tracking and Quest 3 or Quest Pro controllers simultaneously, and since two months ago they've been able to publish apps using this feature to the Quest Store and App Lab. Meta calls this feature Multimodal.

With v64 Multimodal has been added to the Quest home space, both in passthrough and in VR mode. Again though keep in mind it only works with Quest 3 or Quest Pro controllers, so you won't see this feature on Quest 2 unless you buy the Pro controllers for $300.

Multimodal enables an instantaneous transition between controller tracking and hand tracking, no more delay. It also enables using one controller while still tracking the other hand. That means you can pick up a single controller to navigate the Quest home space, without jank, as you might a TV remote. This could be appealing for web browsing, media watching, and changing settings, offering the precision and tactility of a tracked controller while keeping your other hand free.

Translate from:uploadvr
艾邦建有AR/VR产业链微信群,目前有HTC、PICO、OPPO、亮亮视野、光粒科技、影创、创维、佳视、歌尔、立讯精密、多哚(纳立多)、欣旺达、耐德佳,联创电子、至格科技、灵犀微光、舜宇光学、广景视睿、珑璟光电、京东方、海信视像、科煦智能、阿科玛、金发科技、思立可、新安天玉、四方超轻、大族激光、发那科、承熹机电等加入,也欢迎大家长按下方图片识别二维码加入微信群:
Document Download
Welcome to join by clicking hereAR/VR DirectoryCurrently, there are more than 3000 members, including companies such as GoerTek, HTC, OPPO, Skyworth, PICO, ByteDance, Black Shark, Lenovo, Nreal, Lynx, Luxon, Lingxi MicroLight, Luxshare Precision, Leading Ideal, OFILM, Huaqin, Wentai, Luxshare, Lumus, Sisvel, and Shunyu, among others. Click on the keywords below for filtering.
en_USEnglish