Large-scale VR Application Case: the Holodeck Control Center

The AUDI Holodeck

LPVR interaction

Our large-scale VR solution allows any SteamVR-based (e.g. Unity, Unreal, VRED) Virtual Reality software to seamlessly use the HTC VIVE headset together with most large-room tracking systems available on the market (OptiTrack, Vicon, ART). It enables easy configuration and fits into the SteamVR framework, minimizing the effort needed to port applications to large rooms.

One of our first users, Lightshape, have recently released a video showing what they built with our technology.  They call it the Holodeck Control Center, an application which creates multi-user collaborative VR spaces. In it users can communicate and see the same scene whether they are the same real room or in different locations. The installation showcased in the video is used by German car maker Audi to study cars that haven’t been built yet.

Our technology is essential in order to get the best VR experience possible on the 15m × 15m of the main VR surface, combining optical tracking data and IMU measurements to provide precise and responsive positioning of the headsets.  Please have a look at Lightshape’s video below.

Ready for the HTC Vive Pro

In the near future, this installation will be updated to the HTC Vive Pro which our software already supports. The increased pixel density of this successor of the HTC Vive will make the scenes look even more realistic. The resolution is high enough to actually read the various panels once you are in the drivers seat! Besides that, we are also busy studying applications of the front-facing cameras of the Vive Pro in order to improve multi-user interaction.

LPMS-CU in ETH Zuerich Formula Student Race Car Flüela

Formula Student Electric Race Car Flüela

Flüela is the fourth four-wheel-driven Formula Student electric race car from the academic motorsports club Zurich. Four self-developed wheel-hub motors with a peak power of 37 kW while weighing only 3.25 kg enable an acceleration from 0-100 km/h in only 1.9s. A lithium polymer accumulator with a capacity of 6.46kWh supplies the car with the needed energy. The self-built carbon fibre monocoque enables a total weight of only 173 kg. Furthermore, the car uses adaptive dampers, which are unique in Formula Student, to adjust the damping forces dynamically to the driving situation. Miscellaneous control algorithms like torque vectoring and traction control ensure the car to deliver its maximum performance at every time of the race.

With Flüela the academic motorsports club Zurich was able to finish two out of four events overall on first place, as well as a second place in Formula Student Germany. The AMZ was able to defend its first place on the world ranking of the Formula Student Electric, and to finish the third year in a row as world champion.

Figure 1 – Flüela in Skidpad at Formula Student Spain.

Implementation of LPMS-CU in Flüela

The IMU was implemented in the back of the car. The major decision point of the placement was to set it near to the centre of the gravity of the whole car, including a driver. It was placed under the driver’s seat, next to the accumulator box. Tests were done to see if the high currents next to the accumulator box had any influence on the signal quality coming from the IMU. There were no electromagnetic influences detected. But we were not able to see if the high currents at full torque on the motors or while full recuperation (~200A) and their induced magnetic fields had any negative influence on the measured signals from the IMU. The problem there was that while driving at high speeds, there are further disturbances coming from vibrations of the car.

Figure 2 – Installation of LPMS-CU.

Applications of Sensor Data
Vehicle Dynamics Control

The three for our application most important signals coming from the LPMS-CU IMU were the accelerations in x (longitudinal, direction of travel) and y (lateral, direction of the front and rear axle) direction, as well as the rotation rate around the z-axis (vertical direction), further called the yaw rate of the car.

These signals were important inputs for our vehicle dynamics control system. The signal from the IMU has important influences in both, torque vectoring and traction control, as well as several smaller control algorithms used to maximise the performance of the race car.

Furthermore, some points are described, where the signals from the IMU were used in the vehicle dynamics control system:

1. Weight transfer calculation: One important thing to know for calculating the maximum torque which can be used by the tire is the force in z direction at every tire. To calculate this value, we use the accelerations in x and y direction to determine the chassis movement, and to calculate the forces on every single tire.

2. Mu estimator: We are able to adjust the used friction coefficient to calculate the possible deliverable forces of the tires. Depending on the track and the outer conditions, the friction coefficient (mu) is increased or decreased. For this calculations we need the absolute force which is acting on the car in x-direction, which can be calculated by the longitudinal acceleration and the mass of the car.

3. Torque vectoring: The yaw rate is the most important value for our torque vectoring system. By using a simplified vehicle model, we calculate the optimal yaw rate for every corner at every time. This calculated value is then compared to the actual measured value by the IMU, and an occurring error is corrected by an adjusted torque distribution on every wheel.

Data Analysis

Furthermore, the data coming from the IMU was very important for data analysis. One example of the usage of the signals is the G-G-Plot, a classical way to look at the performance of the system car and driver.

Figure 3 – G-G-Plot of the Autocross event in Austria.

We also used the data from the IMU and the Absolute Speed Sensor (optical measurement of the speed of the car) to approximate the course of the track. These track plots were used to display at which point of the track the accelerations on the car were at a maximum.

In Figure 4 we are able to see at which parts of the track the potential of the car is used, and where higher total accelerations would be possible. In the red parts, the cars potential is used at a maximum, in the blue parts the car-driver system could have performed better.

Figure 4 – Track plot Autocross Austria.

Thank you to Formula Student Team Zurich for the detailed report. For further information on the team, please have a look at their website.

Collaboration with Omni Instruments Ltd.

We are happy to announce that we are starting a collaboration with Omni Instruments Ltd. in the UK. Omni Instruments Ltd. is developer and distributor of high definition measurement and logging systems. We have started the collaboration with offering two versions of the LPMS sensor system under the Omni Instruments brand. Please see the below links for further information:

LPMS-CU 9-Axis IMU AHRS Motion Sensor with CANbus and USB Connectivity
LPMS-B 9-Axis IMU AHRS Motion Sensor with Bluetooth Connectivity

LPMS-B and LPMS-CU OEM Versions

We also offer a so-called OEM version of our sensors. That means a bare bone version of the sensor without case and (in the case of LPMS-B) battery. We recommend buying a full development kit for testing of the sensor for first-time customers. However if you intend to integrate the sensor into your special design, the reduced space requirements of the OEM version might be very attractive.

Additionally to connectivity provided by the daughterboard, the LPMS-CU and LPMS-B mainboard can communicate by RS-232 (TTL levels). The RS-232 levels can be accessed through the SMD connector (as shown below) between sensor mainboard and communication daughterboard. Please contact us, if you need further information about this connector.

LPMS-CU Rugged

So far we have offered our customers only one packing option for the LPMS-CU, our standard blue plastic casing. The plastic case is small, very light and fairly robust. However, in harsh environments or in places that engineers regularly access with larger tools, we thought that a more rugged case for the LPMS-CU might be desireable. Therefore we have designed a new Aluminium casing option for LPMS-CU: the LPMS-CU-Rugged. Customers can from now on order this casing as an option when purchasing the LPMS-CU. The case is slightly larger and heavier than the plastic case, but made from 2mm Aluminium, it is almost indestructable.