Apple Vision Pro users can now collaborate with spatial characters: report

Apple reportedly launched a new feature called “Spatial Personas” for its mixed reality headset Vision Pro on Tuesday. An expansion of the existing role functionality, where users can see 3D virtual representations of each other in windows, the new feature is said to allow users to enter a common virtual setting for a collaborative experience. Users can now play games, work together on a project, or watch a movie while being able to see all participants. The new feature was reportedly added via a VisionOS update for Apple Vision Pro.

according to a Report Through The Verge, Vision Pro users will be able to activate spatial characters via FaceTime by clicking the corresponding on-screen button. This will allow the user to move out of the window-like box and stand in a virtual sandbox. According to reports, only the face, the upper part of the torso and the hands are visible, which are rendered using various cameras on the headset and digital renderings on Apple devices. This feature was added in the VisionOS 1.1 update.

Personas, 3D avatars within a window, were introduced with the release of Apple Vision Pro. Space characters were demonstrated at WWDC 2023, but the feature is still in development. Now that it’s out of beta, users can now collaborate on SharePlay-enabled apps.

With this feature, users can now sit together and watch a movie on a screen in a virtual environment while still being able to see other participants in the room and their reactions. Raymond Wong of Inverse report He recounted his experience using the feature in Apple’s demo, stressing that the avatars now look more realistic than previous versions. Collaborative work through Apple’s Freeform app also allows participants to write on a whiteboard or add and rearrange notes. Wong emphasized that up to five participants can collaborate at a time.

When in the same virtual environment, another participant’s voice reportedly came from the same direction as their avatar. It also increases or decreases intensity depending on how far away they are. Likewise, Apple Vision Pro users see other participants the same way they would appear in real life, even if they don’t share the same physical space. The feature is reportedly still in beta and is expected to be publicly rolled out in the coming weeks.