Design of AR Remote Support Application
In this project deep dive, we focus on the creation of a Mobile Augmented Reality app which provides solutions for the field industry. From fundamentals of MAR (Mobile Augmented Reality) and how to apply them to enterprise products, to prototyping for mobile AR using Adobe Aero and wiARframe. You will get familiar with important principles such as environmental design. You will learn the tools and techniques to carry on an enterprise project as an agile UX designer, from initiation through closing. Additionally, you will learn how to adapt into a comprehensive enterprise AR project.
June 1 – July 12
3 different time slots are available to accommodate for different time zones.
State of the Art Interaction Design Course
Are you working on the future of user interfaces and experiences?
In this course you will
- Design a Repair-Room to interact and dismantle a machine and its components using different interaction systems.
- Implement different controls using different ways to move and rotate components.
- You will learn how to show contextual information based on what you interact with.
- Discover the secrets how to build a responsive and interactive holographic user interface for your hands.
- You will build a fully controlled arm by understanding the secrets of inverse kinematics.
- You will also implement fully physics-based components like joysticks, levers and buttons with basic hand physics interaction to use them to control the robotic arm.
Curriculum & Course Structure
Learning objective: From Idea to an Enterprise Level Working Prototype of an AR Remote Support App
Admission is highly competitive and designed for intermediate-to-expert-level VR developers.
- Overall knowledge about UX
Remote. Students can be based anywhere globally.
- UX Pattern: Content, Affordances, Interactions, Spatial Design
- Creating 2D/3D assets, Mobile AR Prototyping
- Corporate Design, Breakpoints and Responsive Design
- Design hi-fid in PS/XD
- Importing assets, UI Canvas & Responsiveness
- Lean Localization, View Management and User Interaction
- Differences between handheld and HMD-based AR
- Overview of existing products with Handheld AR in Unity
- Creating/Finding 3D asset for annotations
- Change the color and occlusion mode of a 3D mode, Create color picker
- Ways to implement Memento pattern
Meet Your Instructors
Terry R. Schlusser
The guest speaker who is not only XR Bootcamp Advisor but also is the Senior Director of Spatial Computing at Deutsche Telekom.
Shiva is a UX designer with hands-on knowledge about Web VR and AR. Shiva has a degree in Digital Media from University of Bremen and works as HMI at T-Systems Multimedia Solutions GmbH.
Alexander has a background in Information Technology and works as Team Lead AR Assisted Maintenance at T-Systems Multimedia Solutions GmbH.
What others say
”Wow. The way these hand tracking experiments are going there soon won't be any need for hand controllers in VR/AR anymore...Excellent workMika Saastamoinen@MobiiliMika
”Dude, Your videos are the best! This is some inspiring work!Neon Engine@NeonEngine
Seriously. I daydream of this in our future.
”I have to try it! A dream came true for VR research!Vincent Goupil@FoxShiver
”You are a VR programming magician and I hope every developer in the future learns something from you.icsomic@icsomic
”Your hands' physics just rocks.Diego fernandez-bravo@cliv3twit
You do not need a headset, just an ARCore or ARKit capable smartphone. If you have an iPhone, you also need access to a MacOS computer and have basic knowledge of how to build and deploy apps to your iPhone.
ARCore capable devices: https://developers.google.com/ar/discover/supported-devices#android_play
ARKit capable devices:
- iPhone 6, SE or newer
- iPad (2017) or newer
- iPad Pro (all)
Yes, you will need some basic coding skills in C# and some beginner-level experience in Unity development. If you never tried it before and still want to join the course, that’s great news! Nevertheless, we strongly recommend that you take some time in advance to play with the beginner tutorials and try to build and deploy some sample projects to your iOS or Android device.
Yes, you will need the following software:
- Unity (Personal, Plus or Pro) 2019.2.21f with Android or iOS build support
- C# IDE (Visual Studio or Rider)
- Adobe XD
If you successfully completed all the assignments, you will have your own AR remote support prototype with industry standard UI and UX documentation, also capable of setting holographic annotations to real physical objects that you can use as a part of your portfolio for the future employers. The prototype is not meant to include real audio/video calling or any other network-related functionality.
Prerequisites to take this course are:
- Unity Engine experience
- Programming experience (C#)
- Basic understanding of PhysX (unity’s physics engine)
- Access to a headset with controllers (preferentially Oculus)
- Access to Oculus Quest for hand tracking optional exercise
This workshop is only for individual sign-up. Please don’t share your access with other people so that we can make sure to be able to give workshops again in the future. Please contact us under firstname.lastname@example.org for corporate workshops or group discounts.
As in all our online classes, you will get to know your classmates. We organize social breaks, team meetings and gettogethers for everyone to get to know each other and build a great new network!
Yes, we will build a robotics arm lab that you can use as a portfolio project to showcase to future employers and the community.
Yes, after every lecture, there is scheduled time for Q&A. You can submit your questions at any time before or during the course in the chat window. We will make sure to answer a maximum number of questions from participants as time allows. In the mentorship hours, you will get individual mentorship from technical experts to go over your implementation questions in detail.
Yes, you will need access to a headset with controllers (preferentially Oculus). Oculus Quest access is optional.