Loci for AR and VR

Loci works for AR and VR

Link In YOUR Mind – You Organize, Understand and Recall

Loci currently is provided as two variants; Loci Memory Palace in Virtual Reality on the PC and Loci AR Mind Map in Augmented Reality on the HoloLens.  Both have a free seven day trial period and can import mind maps.

Loci uses three core concepts to help you organize, understand and recall; mind maps lets you break a problem down into component parts to organize and do analysis, mixed reality interaction with mind maps lets you visualize in 3D to understand how they are related, and the method of loci persistent placement of mind map nodes lets you improve your recall of the mind map, even when you are not using the Loci software.  In this way you can organize your problem, understand it, and remember it later when you need to use that information for decisions.

Get Loci for PC/MR on Windows Store
PC/MR-HMD

Loci Memory Palace puts you in a 3D Memory Palace where you can make mind maps using the Windows Mixed Reality headset, and handheld controllers. You can use hand controllers to move, scale or rotate nodes or designate them for voice commands, or to select a place for moving nodes.

Get Loci for HoloLens on Windows Store
HoloLens

Loci AR Mind Map helps you put nodes and links in your own real settings using the HoloLens, such as your home, where you can place your notes and ideas with real items to help you remember and think about them.  You can use one or two hand gestures with your own hands to move, scale or rotate nodes.

Both versions of Loci support gaze and voice interaction combined, so that the use of hands or controllers is not required at all times.

Both versions of Loci share the same mind map graph format, *.loci, and both have initial import capability for MindManager, Freemind, and GraphML files.  This allows you to bring in your previous mind maps and graphs, as well as mind maps or graph data from other people.

Loci Voice and Gaze Commands

Loci Voice and Gaze Commands

You use Loci by saying commands and looking at nodes or locations in the scene.  Some commands are done only using your voice, and some include where you are looking, your center of gaze.

For Windows Mixed Reality, there are also a large set of useful commands here.  These include commands to operating system, like “select”, and commands to Cortona, like “Hey Cortona, take a picture”.  In this post we are focused on commands to the Loci application.

It is important to understand that you use your gaze to identify a node that you act on the node with your voice.    This is gaze-based selection combined with voice actions (commands).

Generally commands to change the graph are just voice, and commands to change nodes or links include you focusing your gaze onto a node, and seeing the donut cursor on that object.

Our demonstration video, six minutes long, provides examples of using voice and gaze commands: Demo Video

The image of Loci commands in this post is also included as the default image for every node created in Loci.  It appears when you start Loci as part of the default scene.

Basic movement of a node is done by looking at it to place the cursor, and saying “Select” which Windows HoloShell uses as a voice command like a left mouse button select, or using an air tap with your index finger.  Once you select a node, it locks onto your center of gaze and you can walk and move your head to place it.  If you have it where you want it, say select or tap again to place it.  It will be locked there for subsequent graph layout, since your chosen locations are very important for using Loci.

When starting  out, a very useful voice-only command is “Load Example” which will load an example mind map graph describing the Loci application.

The primary voice commands to use are:

“add node” creates a node at your center of gaze and allows you to use voice to name it and gaze to place it. If you look in mid air, it creates a new unattached node. If you look at an existing node, it adds a new node and conveniently also adds a link to it, and then Loci allows you to name and place the newly added node.

You can add links between nodes by focusing your gaze on a node and saying “Link This” then moving your gaze to another node and saying “To That” and then a link between them will appear.  You can delete a link by saying “Unlink This” while gazing at the first node, and then “From That” while gazing at the second node.

“delete node” deletes the node you are looking at (cursor follows gaze onto node).  This includes deleting links to that node.

“undo” allows you to undo a prior editing action, such as deleting a node

“select” is a Windows Mixed Reality standard voice command that is equivalent to a finger tap for selecting anything, in Loci it allows you to say “select” when gazing at a node and then place it with your gaze.  When you have the node in location, you say “select” again.

Say “name node” when you look at a node and Loci will ask you to provide a short name using your voice for dictation, and change the node name.

On the HoloLens version of Loci, saying “capture image” will use the camera to capture what you are looking at, create a node with your newly captured image shown below it, and allow you to place it.

A very useful set of commands are those for copy and paste.

You center your gaze on a node and say “Copy Node”.  This will take all the properties of a node and put them in the copy buffer in a text form.  Then you can look at a place in open space and say “Paste Node” and a copy will appear one meter in front of where you were looking.  You can also focus your gaze on an existing node, and say the same command “Paste Node” and it will update that node with the properties of the node you have previously copied (Color, scale, name, etc.).

Sometimes you only want to paste certain properties.  So you do the command “Copy Node” as usual, and then focus your gaze (cursor) on another node and say paste with a property name, such as “Paste Name” or “Paste Image” or “Paste Color”.

Also see our post on proper Windows 10 settings for voice commands here.

 

Loci Features Explained

This post describes important features of Loci, and compares Loci features with related work by others to give you a better idea of what Loci does.  It includes a table of features comparisons across related mind map software.

First, Loci supports mind map interaction on graphs.  So it is easy to add a node to the graph with a link to an existing node in augmented reality, but the mind map you are creating does not have to have a central node.  This is sometimes called a concept map, but Loci is broader than that, it supports general graphs.

In Loci, nodes have locations.   If you place a node somewhere in your room, it will show up there next time you view that graph.  This is not the same for the other mind map applications, they will load the same mind map, but it is not anchored to a place in the real world.

AWE 2017 Notes

From 31 May to 2 June the Augmented World Expo was held at the Santa Clara Convention center.  There were a lot of interesting things there, and we are providing some notes here.

Videos of AWE 2017 talks are available on the AWE page on Youtube.

Of course, we think one interesting thing was our booth 359 showing off our new product, Loci, available for HoloLens now in the windows store.   We showed visitors how their notes, ideas, and analysis can be placed in the real world, to increase understanding and recall as they solve their problems.

Congratulations to Microsoft HoloLens for winning the Best Headworn Device award, as selected by the IEEE Standards Association!

I liked the talk by Tony Parisi of Unity.  Tony worked in the early days of VR, on the VRML standard.  Two billion devices have unity player installed.  He gives a good survey of what is going on across companies in mixed reality.  Mentioned WebAR, with the world as your QR code.

https://youtu.be/NaPY_9l6JGs

There are some good ideas for interaction from Meta, which makes the Meta 2 headset

Stefano Baldassi on Meta interaction https://youtu.be/b2PgbMs2UVA

We will add more to this blog post as we assess the talks…

 

Using a keyboard with HoloLens

You can pair a bluetooth keyboard with the HoloLens computer.

This can be useful if you want to do copy and paste between applications in the HoloLens.

For instance, you can use a mouse on the keyboard to select a link in Microsoft Edge address area and then press the control key and C key together (^C) to copy them. Then once you are back in Loci (click on the Loci window or icon to get back) you can center your gaze and the cursor on a node, and press control and V key together (^V) to paste into the node.  If it starts with http it will paste as a link that you can then use by saying “Browse Node” on the same node.    You can also say the words “Paste Web Link” instead of control-V, and it will set the link to your copied url.

At the top of this post is a picture of the one I use, which is hand-sized, very light, has a built-in touchpad mouse, charges with micro-usb, and is fairly reliable. There are similar keyboards on Amazon used for controlling television apps for about $14 USD.

 

Loci Demo of Editing for ARBA (AWE Nite SF)

Loci Node Editing

On Tuesday April 25, 2017 we provided a demonstration of Loci to the Augmented Reality SF Bay Area (ARBA) (now AWE Nite SF) Meetup, which was held at the Runway Incubator in the Twitter building in San Francisco.

Here is the ARBA meetup page.

We gave a live demo wearing the HoloLens and showed how to edit mind map graphs live at the demo, adding nodes, changing their properties, using undo, and other typical operations, showing how easy it is to add nodes and links in a short time.

We also talked about the power of the ancient method of loci, as confirmed by a very recent study published March 8, 2017 in the journal Neuron entitled “Mnemonic Training Reshapes Brain Networks to Support Superior Memory” by scientists at the Max Planck Institute of Psychiatry, the Donders Institute, and Stanford University.  In the study the method of loci improved recall four months later by more than 20% over the active and passive control groups.

Loci Available on Windows Store for HoloLens

Buy Loci On Windows Store

On April 15, 2017 we published version 1.0 of the Loci universal windows application for HoloLens on the Windows Store.  Loci lets you create mind maps  in mixed reality where you place the mind map nodes in your home or office in locations that have meaning to you.   Using locations in this way, as a form of method of loci, where you associate your thoughts and ideas with locations, has been shown to increase your recall of them later.

Get Loci for HoloLens on Windows Store
HoloLens

Our Loci application allows you to create and edit mind maps in mixed reality. You save and load these using OneDrive.  The primary way to interact with Loci is using voice and gaze, and the current supported language is English. To understand how Loci works, it has a free one day trial.

Loci Demo of Analysis for ARBA (AWE Nite SF)

ARBA demo of Loci Analysis

On Tuesday October 25, 2016 we provided a demonstration of Loci to the Augmented Reality SF Bay Area (ARBA) Meetup (now AWE Nite SF), which was held at the Runway Incubator in the Twitter building in San Francisco.

Here is the link describing the ARBA meeting on medium.

We showed the use of Loci for mind map graph analysis of designing a home, starting with a central concept of home design, and expanding to attributes of the home, such as design family, location, features, permitting, materials, floorplan and other items.  We associated nodes with images from a shared drive, and placed nodes on real maps on the demonstration table, highlighting the use of Loci for ongoing analysis of your problems.

Loci Demo at Techcrunch Disrupt

Location has meaning

On Tuesday September 12, 2016 we provided a demonstration of Loci for TechCrunch Disrupt 2016, which was held at Pier 48 in San Francisco.

We had a small round high table, and a small booth area. We set up a projector and laptop to show slides describing our Loci method of loci mixed reality mind mapping application, and show what it is like to use it with the HoloLens.

As attendees came by, we had them put on the headset and use Loci on the HoloLens in the very busy, large and open area of the conference.  HoloLens worked very well in that setting.  It stores and updates spaces, and each day and each hour the spatial area around us changed, but HoloLens showed the nodes and links of our demonstration very well.

We showed a notional house model with links and nodes for the house design.  We also showed an example query of crunchbase data for startups generated with python, and loaded into Loci.