MR Glasses App

This section is about the Aidar.Service app on MR glasses. Below you will find tips on getting the app up and running, basic gestures, and tools you can use in augmented reality.

Note

If it's your first time using HoloLens 2 we strongly recommend checking out the basic gesture tutorial on this page or launching the Tips app from the main menu.

Launching the app on HoloLens 2

runs on: ^HL2

How do I run the Aidar.Service application on HoloLens 2?

1. After the installation sign in on the HoloLens with your account. The main application menu will appear.

2. Make sure you are connected to the Internet.

3. Select the Aidar.Service icon. You will see the login screen.

4. Sign in. The application will be launched.

5. Raise your left hand and look at it. The pie menu of the Aidar.Service application will appear.

Note

If you do not see the Aidar.Service icon, it is probably not pinned to the main applications view. Go to All Apps on the right side menu, look for the Aidar.Service icon and touch it. If you want to pin the Aidar.Service shortcut to the main application view, please check this guide.

Navigation

This is a pie menu from which the operator can select tools useful in communicating with the technician.

• Sending 3D mesh Send lidar scan from the glasses. ^{HL2 N}

Warning

This is not working in the Web App but only in the Desktop App Therefor in connection with Web App this button is not active.

• Measure tool is used to measure any objects in your environment.

• With the drawing tool you can freely draw in the space around you.

• Contact list is used to display the contacts that the operator can call.

• With the 3D measure tool icon operator can load a 3D object in his environment.

• With the Academy icon the operator can start and edit the trainings available on the MR glasses.

• Sending 3D mesh on/off allows you to enable or disable this option. This is especially important when overlaying texture and downloading 3D mesh.

Calling

The Aidar.Service MR glasses app allows you to make and receive calls to an expert from the Aidar.Service web or desktop app.

How to call an expert?

1. Raise your left hand and look at it.

   You will see the pie menu and the video chat window.

2. Select an available expert from the list on the right and touch on the handset.

Note

If you do not see the video chat window, press the Docking chat icon located just above the pie menu. The video chat window will reappear in front of you.

Changing position of windows

How do I change the position of the window?

1. Use the Air tap gesture to grab the point for repositioning (to the left of the video chat window/training list).

1. Hold the point and move the window to any position in space.

2. Release the point and video chat window stay in place even if you change your position.

Note

If you want to re-pin the window to the start position click Docking chat icon located just above the pie menu.

Measure tool

Measure tool is used to measure any objects in your environment.

How to measure an object?

1. Lift your left hand and select the measure tool icon from the pie menu.

   A line with measurement value and spheres on both sides will appear in front of you. You can lower your left hand.

2. Using Air Tap gesture, grab a sphere and move it to the beginning of the measurement spot. Release. Grasp the second sphere and move it to the end of the object to be measured. Result is shown above the measurement line and is updated continuously.

3. To turn off the Measure tool raise your left hand. You will see the pie menu again. Click on the measure tool icon again. The measurement tool will disappear.

Drawing tool

With the drawing tool you can freely draw in the space around you.

How do I draw something in space?

1. Lift your left hand and select the drawing tool icon from the pie menu.

   Once you have selected the icon, you can lower your hand.

2. Use the Air tap gesture, hold and start drawing in space.

   The drawing will remain in place even if you change position.

3. To remove the drawing, raise your left hand and from the pie menu, deselect the drawing tool icon.

Note

Once you draw something there is no possibility to take a step back. You can only delete the entire drawing.

3D measure tool

The operator can simulate the size of the object using the 3D measure tool.

How to load a 3D measure tool?

1. Raise your left hand and select the 3D measure tool from the pie menu.

   You can lower your left hand. A cube will appear in front of you.

2. You can change the position and size of the cube. (For an overview of available gestures and object manipulation options click here)

Note

You can upload any 3D object from Web App . Check out: Adding resources and Sending resources to glasses.

Academy – training selection

Aidar.Service MR glasses App enables you to play and edit step by step tutorials. 

How to play tutorials?

1. Stand in front of the machine or any object for which the training was created.

2. Raise your left hand up and select the Academy icon from the pie menu.

   A list of trainings will appear on the right.

3. Select the training you want to start.

   Instructions and steps list will appear.

4. Perform calibration.

   For instructions on how to calibrate check out Academy – training calibration.

5. Use the navigation arrows to move to the next training steps.

Note

You can change the position of training lists. Check out: Changing the position of windows.

Academy – training calibration

After selecting the training (Check out: Academy – training selection ), you need to perform calibration with the real object on which the training will be perform.

How to calibrate?

When you select training, you will see a photo with two calibration points marked and the first calibration point in the shape of a pin.

1. Place the first pin on the real machine, at the point that is indicated in the picture.

2. Confirm the placement of the first pin with the checkmark, which is located above the pin.

   After approval, the second pin will be shown.

3. Place the second pin on the real machine, at the point, which is indicated in the photo.

4. Confirm the placement of the second pin with the checkmark, which is located above the pin.

   Training will begin.

Academy (edit) – create new calibration

After you create a new training draft in the Web App (Check out Adding a training), you can continue creating it in the MR App by: take a picture of the calibration points, set the instruction window in the right place, add or remove instruction steps.

How to create a new calibration?

1. Touch the calibration/recalibration icon twice. Calibration points will appear.

2. Place and confirm the calibration points (pins) at the locations you want to designate as calibration points (check out Academy – training calibration to learn how to place calibration points).

   A message will appear informing you that the photo mode has started.

3. Look at the calibration points you have set and wait for the photo to be taken.

Note

This photo will appear at the start of training and will show where the calibration points are.

Academy (edit)– set the instruction window

You can change the position of the instruction window:

• after creating a new calibration
• when editing a lesson (check out Academy - edit training )

How to change the position of the instruction window?

1. After you create a new calibration (Check Academy (edit) – create new calibration), an instruction window will appear in front of you.

2. Grab the indicator and move it to dedicated location.

3. Touch Save button which is located in step edit window.

   The placement point of the instruction window will be saved.

Academy - edit training

How to edit training?

1. Click on the step you want to edit.

   An edit box will appear on the right.

2. By selecting individual icons you have the option to:

   • Edit text

     ---

     

     Opens an editing window in the Aidar.Service Web App. (For more on this topic check Editing training content)

   • Remove

     ---

     

     Removes the step.

   • Switch pointer

     ---

     

     Change the indicator (arrow or rotation)

Note

You can also change the location of the instruction window. Check Changing position of windows.

Resources management (Operator)

You can use a set of tools to work with the loaded resource: change the position and size of an object, draw on it or place an arrow.

How to use object editing tools?

After loading resources, the operator will see a line leading to the object and an edit menu. The edit menu appears in the place the operator was when loading the object. Select the appropriate tool to start working on the object:

• Manage - contains options for restoring the object to its original size, locking the object's rotation on one axis and deleting the object.

• Draw - contains options for drawing in relation to the object. You can place an arrow, choose free drawing and change the color of the pencil.

• Toggle the bounding box - enable or disable the bounding box around the object, which allows resizing.