ArtifactVis with Android Device

Project Overview

This project allow users to use the android device (as a client) to connect with CalVR (as a server) by the TCP protocol, then they can move any object and interact with it in the virtual world by using the android device. It allow users to move objects on the CalVR by using any kind of mode such as Move World, Scale, Drive and Fly, and then see the object movement changes on the android device. Also, they can use the android device (client side) to move the camera around the object to see the object from all sides. Finally, they can use the android device (client side) for picking objects to receive pictures about this object. They can use all these techniques with Artifact Archeology project to interact with the historical objects in the real world. Also they can use this plug-in with other projects.

Usage Instructions

• Server
  • This is the path to find the server code /home/saseeri/CVRPlugins/calit2/MagicLens
  • IP Address: Use this command line to find the IP address ifconfig
  • Use this PORT 28888
  • We can find objects on /home/saseeri/Development/OpenSceneGraph-Data folder

• Client
  • This is the path to find the client code /home/saseeri/CVRPlugins/calit2/MagicLens, the name of the folder OSGTest1-AndroidClient
  • IP Address: Use the same IP address on the server side and put it on the code
  • Use this PORT 28888
  • Use the same object that is used in server side and put the object on the android memory card and wrtie this path on the code /mnt/sdcard/create_any_file name/object_name

To compile and run the code do the following:

Start with the server

• Go to this path on the terminal /home/saseeri/CVRPlugins/calit2/MagicLens

Write on the terminal

  make
  ...  
  CalVR

After that, Copy the client code to the eclips workspase and do compile to the Android ndk (C++) by using the following:

• Go to this path on the terminal /home/saseeri/workspace/OSGTest1-AndroidClient

Write on the terminal

  ndk-build

Then go to the eclipse right click on the project then run it after you connect the android device

add pic

Software Tools and Equipment

Software Tools

On PC (Server):

• Linux Operating System
• OpenSceneGraph 3.1
• CalVR

On Phone Device (Client):

• Eclipse
• Linux-sdk
• Android-ndk
• OpenSceneGraph 3.1 Android

Equipment

• Android Device (I used Galaxy Phone Samsung)

Installing OSG for Android on Linux OS

This is the path to find installation of OSG for Android on Linux OS

/home/saseeri/CVRPlugins/calit2/MagicLens/Installing OSG for Android on Linux OS.pdf

Screen Shots

• add pic

What is done so far ...

• load model into Android Device and CalVR with osg
• Connect the Android Device and CalVR over wifi (by using TCP protocol)
• Move objects on the CalVR by using any kind of mode such as Move World, Scale, Drive and Fly, and then see the object movement changes on the android device

Future Work

• Move the camera around the object to see the object from all sides
• Picking objects to receive pictures about this object

Developers

Software Developer

• Sahar Aseeri

Project Advisor

• Jurgen schulze

TODO

• load excavation site model (VRML file) into tablet with osg:
  • osg::MatrixTransform * getObjectTransform () returns the position of the data set in room coordinates; send this to phone; on phone, put it in a MatrixTransform just above the node with the cow
  • Goal: when flying around data set in CalVR, the view on the phone should change accordingly
  • getHeadMat() returns the head position in room coordinates: this is constant at a desktop, but changes in the caves

- write function to set camera position in osg from head node: for testing, transfer 4x4 matrix of head position over wifi to tablet: this will effectively copy the view on the Calvr system to the tablet

- sense touch on artifact, then send touched artifact ID to Calvr computer, which will send associated photograph to tablet; display photograph on tablet. This will allow the user to view pictures associated with artifacts on the screen

- connect tracking system to tablet to allow moving tablet around starcave and view excavation site model from arbitrary perspectives on tablet screen.