Diploma in Apple Development 🍎👩🏻‍💻: Spatial Two: Lecture 5: Photogrammetry, Image Tracking and Object Tracking.
Back to slide index.

Hi! 👻

First, don't forget to confirm your attendance using the Seats Mobile app!

Second, I'm going to start every lecture with a meditation from the fantastic Sitting Still Like a Frog book, all read by Myla Kabat-Zinn. If you don't want to participate that's completely fine.

What is Photogrammetry? Let's take a look at some projects that have used it:

• A history of Photogrammetry.
• From 1997: The Campanile Movie. Paul has done lots of other great work.
• Shining 360 by Claire Hentschker who also has done many other great projects.
• Golan Levin's lecture on Photogrammetry, including some great projects at the bottom.
• James George's lecture at Eyeo 2015 - the whole Eyeo playlist is great.

Let's start with Image tracking, starting on the image tracking section of the ARKit in visionOS page on developer.apple.com. "Tracking preregistered images in 3D space" looks useful. Shall we try to build a demo with Claude? What keyword should we search for on GitHub? We don't have time to build today, but this would be perfect to work on over the holidays.

Let's move onto Object tracking. Let's watch this video from WWDC24:Explore object tracking for visionOS. Let's follow up with the sample code for that session. Don't forget you can use poly.cam to easily generate .USDZ files to use as reference objects for trackings! We don't have time to build today, but this would be perfect to work on over the holidays.

Let's take a look at this great article: "Implementing object tracking in your visionOS app". Once you've done the steps in the article, you then have three options for how you integrate object tracking:

1. Use Reality Composer Pro
2. Use RealityKit
3. Use ARKit

Which do you think you should try first?

Watch this video from WWDC24: "Optimize(sic) your 3D assets for spatial computing" for good tips and useful sample code.

Let's divide into Anchor groups and spend some time in discussion - in the next lecture after the holidays, I'm expecting you to present your revised project thoughts, including your first working app, centred around your key moment.

Great! Let's spend up to the next break watching videos from the "UI" category of Masahiro Sakurai's YouTube channel.

Thanks! Please watch all of the content from today's lecture as homework and prepare to present your revised project thoughts after the Easter holidays, including your first working app, centred around your key moment. Take this opportunity to make big progress on your app!
Back to slide index.