Creative Computing

Joel Gethin Lewis

Unit 6 / Block 2: "Creative Practice: Computational Environments for the Web": Lecture 2: Tracking

What I'm going to talk about today:

0. What questions to do you have for me?
1. Review of oFBook image processing chapter.
2. A favourite technique: Optical Flow.
3. Point tracking.
4. Colour/contour tracking.
5. Marker tracking.
6. What questions to do you have for me?

0. What questions to do you have for me?

• What questions to do you have for me?
• What are your concerns? What are you worried about? What do you want to ask but you are embarrassed?
• All questions allowed!
• 5 minutes to message me on Slack in private.
• This idea came from Zach Lieberman. He does this exercise at the start of every session of School of Poetic Computation in New York.

1. Review of oFBook image processing chapter.

• Let's review the ofBook image processing chapter, from "A Complete Workflow: Background Subtraction" to the end.

2. A favourite technique: Optical Flow.

• One of my favourite techniques is Optical flow - finding the movement (or flow) within an image, with vectors for every pixel.
• What is a vector?
• Optical flow demo.
• What else could you use this example for?

3. Point tracking.

• Throughout these lectures we'll be drawing on Kyle McDonald's cv-examples.
• Brightest Point tracking.
• Point Tracking.
• What else could you use these examples for?

4. Colour/contour tracking.

• Colour tracking.
• Contour Detection via Tracking.js.
• Contour Detection (seems to be Chrome only) via opencv.js. More information and examples here and here. You should be able to do everything that you can do in openCV on openFrameworks with openCV.js.
• What else could you use these examples for?

5. Marker tracking.

• Marker Tracking.
• You can find more marker images here. What's special about these markers graphically?
• The JSARToolkit Github has links to a slideshow demo and a chalkboard demo. They seem to be Firefox only. Are they?
• JSARToolkit is a port of the original ARToolkit.
• What else could you use these examples for?

6. What questions to do you have for me?

• What questions to do you have for me?
• What are your concerns? What are you worried about? What do you want to ask but you are embarrassed?
• All questions allowed!

Thanks!

• More about me: @joelgethinlewis
• Get in contact via the CCI Slack!
• Website:
  https://jgl.github.io/CCIDiploma-Summer2020/
• Today's slides:
  https://jgl.github.io/CCIDiploma-Summer2020/environments_lecture_02.html