Diploma in Apple Development 🍎👩🏻‍💻: Spatial 1: Lecture 8: Revised project thoughts, Timelines and Interactivity in Reality Composer Pro.
Back to slide index.
Hi!
First, don't forget to confirm your attendance using the Seats Mobile app!
Second, I'm going to start every lecture with a meditation from the fantastic Sitting Still Like a Frog book, all read by Myla Kabat-Zinn. If you don't want to participate that's completely fine.
Let's start by going over your App Design Workbook work in groups. Who wants to go first?
  1. Page 30 of the App Design Workbook: "Find Differentiators"
  2. Page 36 of the App Design Workbook: "Define Features"
  3. Page 42 of the App Design Workbook: "Prioritize (sic) Features"
  4. Page 43 of the App Design Workbook: "Describe Key Functions"
  5. Page 45 of the App Design Workbook: "Define an MVP"
Let's continue from last week's lecture, making sure that everyone has tried adding an Anchoring Component to a USDZ file that they've brought in from Polycam. What kind of anchors are selectable in Reality Composer Pro? Let's make sure everyone has tried this, including running on device.
Let's continue by watching a video from WWDC.
"Compose interactive 3D content in Reality Composer Pro" (35 mins)
"Discover how the Timeline view in Reality Composer Pro can bring your 3D content to life. Learn how to create an animated story in which characters and objects interact with each other and the world around them using inverse kinematics, blend shapes, and skeletal poses. We'll also show you how to use built-in and custom actions, sequence your actions, apply triggers, and implement natural movements."
If you'd like, you can download the content from the presentation, and work through it as homework, but for now, we are going to complete some basic interaction in class, together.
Let's try building our own timelines in Reality Composer Pro - I'm particularly interested in showing how to trigger timelines interactively in Reality Composer Pro. What component shall we use for that? This is how to add a component to an entity in Reality Composer Pro. Let's continue to the next slide for a step by step guide of what to do.
Here are the steps we need to go through:
  1. Create a new visionOS project using the App template in Xcode. The Initial Scene should be "Window", with "RealityKit" as the Immersive Space Renderer. The Immersive Space should be "Mixed". You don't need a testing system, and on the next window, you don't need to make a Git Repo.
  2. Open up "Package.realitycomposerpro" at the bottom of the newly created project, by clicking on it and selecting the "Open in Reality Composer Pro" button in the top right of the Xcode preview window.
  3. Create a new Timeline and add a "Transform To" Action on it, moving Sphere_Right by a certain amount, and then add another "Transform To" Action to take it back to it's original position. You can always preview the transformations by clicking and dragging along the timeline. The new Timeline a name like "MoveRightSphere" or something memorable.
  4. Select the Immersive Scene and select the "Sphere_Left" entity. Add a "Behaviors" component, select it and and an "OnTap" behavior, with the action being the name of the new Timeline you made in the previous step.
  5. Run the app and tap the left sphere (physically or with a gaze tap). Nothing happens! Why?
  6. See this article from stepinto.vision for an explanation of why. TLDR, we need to add a gesture to the ImmersiveView.swift's RealityView. We'll be learning more about gestures very soon. Add the code and test out your app!
  7. Experiment with different actions and different timelines!
What questions do you have for me?
Next week, we'll move on from the second third of Spatial 1 (Reality Composer Pro) into the final third (SwiftUI and RealityKit). Please review all of the content from today's lecture before then - if we have time, let's start working on the next parts of the App Design Workbook (to be presented in two lecture's time):
  1. Page 48 of the App Design Workbook: "Outline Screens"
  2. Page 55 of the App Design Workbook: "Group Screens"
  3. Page 63 of the App Design Workbook: "Link Screens"
  4. Page 67 of the App Design Workbook: "Create Tabs"
  5. Page 70 of the App Design Workbook: "Add Navigation"
  6. Page 72 of the App Design Workbook: "Create Modals"
  7. Page 74 of the App Design Workbook: "Add Interface Elements"
Thanks!
Back to slide index.