Fig. 03 · Datarealm · 2021 to 2023

HoloLens to Industrial Robot

A HoloLens that directs an ABB industrial robot, run live at Automate 2023 with zero defects.

Role: XR Software Developer & R&D Lead, Datarealm
When: 2021 to 2023; live demo at Automate 2023, Detroit
Built in: Unity and C#: HoloLens 2 (MRTK), ported to Quest Pro (Oculus SDK)
Team: Three people: I built the mixed-reality experience and led the team

The story · five parts

01Constraint

A live tradeshow demo with no second takes, then a second headset whose SDK shares nothing with the first.

02Intervention

I led a three-person team and built the mixed-reality experience myself on HoloLens (MRTK), then ported it to Quest Pro on the Oculus SDK, keeping passthrough quality high. I trained the teammate who wrote the game logic in C#.

03Measured

Defects during the live demo.

04Result

Zero defects at Automate 2023 in Detroit.

05What it proves

I stay hands-on where the technical risk is highest.

Evidence

Fig. 03.1 · Silent loop, 10 s, two parts · captured on the headsets

The demo in 10 seconds

One experience, two headsets with nothing in common under the hood.

1/2HoloLens 2. The player picks a square on a holographic grid and the real ABB arm makes the move.
2/2Quest Pro. The same experience ported to a second headset, with a digital twin of the robot.

Other R&D at Datarealm

Digital twinA direct digital twin of an assembly-line test rig we built for testing. The virtual robot arm sits on the real hardware, aligned to it.AR · 6 s

HoloportationA point-cloud scan of the company building's basement, turned into a textured replica in Unity that a person can move through as an avatar.Unity · 6 s

Navigation agentThe world mesh refreshed about once per second. The agent rerouted only when the new mesh collided with its current path, and target selection had no perceptible delay.HoloLens · 6 s

Fig. 03.2 · Separate projects from the same role, 2021 to 2023 · silent clips, play on hover or tap