From Immersive Visualization Lab Wiki
Jump to: navigation, search


CSE165: 3D User Interaction


This course focuses on the design and evaluation of three-dimensional (3D) user interfaces, devices, and interaction techniques. The course consists primarily of lectures and hands-on programming. Students will be expected to implement several 3D interaction techniques as part of this course. The course is intended to lay the foundation for 3D user interaction as it can be applied to novel user interfaces for computer games and consumer electronics, as well as virtual and augmented reality applications.

An important aspect of the course are going to be programming assignments involving 3D interaction devices, which are going to be provided to the students for the duration of the projects. These devices will include the Microsoft Kinect, the Razer Hydra, the Leap Motion, the zSpace, and the Sony Move. We will use either Unity 3D or the C++ programming language and OpenGL, along with physics simulation libraries.

Kinect-for-windows.jpg Hydra.jpg Leap.jpg Zspace.jpg Move.jpg
Microsoft Kinect Razer Hydra Leap zSpace Sony Move

Course Schedule

Click here for the course schedule.

It lists lecture dates, homework due dates, and recommended reading.


  • Introduction to 3D interaction
  • Application domains
  • Output hardware
  • Input hardware
  • Selection and Manipulation
  • Navigation (Travel and Wayfinding)
  • System Control
  • Symbolic Input
  • 3D user interface design
  • Evaluation of 3D User Interfaces
  • Augmented Reality Interfaces


  • CSE167 (Introduction to Computer Graphics) or equivalent course or experience
  • Experience programming in C++ and with OpenGL, or experience with Unity 3D


  • Instructor: Dr. Jürgen Schulze
  • Instructor's office hour: Tuesdays 1:30-2:30pm, Atkinson Hall, Room 2125
  • Number of Units: 4
  • Section ID: 861006
  • Lectures: Tuesday and Thursday, 11:00am-12:20pm at WLH 2205
  • Homework Discussion: Every other Monday 6-6:50pm at WLH 2204 (starting January 11th)
  • First lecture: Tuesday, January 5th, 2016
  • Homework: programming assignments
  • Research paper presentation
  • Piazza page: TBD
  • Designated computer lab for this course: CSE 220
  • TA: Ching (Alex) Lee, office hours to be posted on Piazza
  • Tutors: David Nuernberger and Ruiqing Qiu, office hours to be posted on Piazza


Assignment 1 (group) 15%
Assignment 2 (group) 15%
Assignment 3 (group) 15%
Assignment 4 (group) 15%
Assignment 5 (group) 25%
Paper Presentation (individual) 10%
Pop Quizzes 5%

You will find your homework and other scores on Ted. Please verify a few days after after every due date that your score has been recorded correctly and inform your grader if it has not.

There will be no assignment or indication of letter grades corresponding to scores on the individual exams and homework projects. The final grade depends on a weighted average of all the scores. The following grading key will be used:

Final Score Letter Grade
100+ A+
95+ A
90+ A-
85+ B+
80+ B
75+ B-
70+ C+
65+ C
60+ C-

For undergraduate students with the P/NP option: A pass (P) grade will be given for an average score of 60 or higher.

For graduate students with the S/U option: A satisfactory (S) grade will be given for an average score of 75 or higher.

Homework Assignments


The textbook is recommended, but not mandatory as the lecture slides will be made available after each lecture and there will not be reading assignments. Occasionally the lecture slides will be available before the lecture, but you can always use last year's slides if they are not - this year's will differ but not dramatically.

3dui-textbook-200p.jpg Bowman, Kruijff, LaViola, Poupyrev
3D User Interfaces: Theory and Practice
Addison Wesley Longman Publishing Co., Inc. Redwood City, CA, USA 2004
ISBN: 0201758679

Students with Disabilities

If you have a documented disability, please bring your documentation to me as soon as possible so that I can make suitable accommodations for you. If you believe that you have a disability and desire accommodation, please register with the Office for Students with Disabilities.