The Latvian Academy of Sciences (LAS) has recognized the Institute of Electronics and Computer Science (EDI) as one of the leading innovators of 2024. In collaboration with the Institute of Mathematics and Computer Science at the University of Latvia (LU MII) and Professor Guntis Bārzdiņš, EDI has developed a groundbreaking technology that opens new opportunities in robotics and artificial intelligence.

This innovative technology enables robots to perceive their surroundings, interpret them, and execute commands given in natural language. For example, a robot can follow instructions such as, “Pick up the green apple from the table and place it on the tray.” This is achieved through a semantic map that integrates data from depth cameras, LIDAR, and artificial intelligence algorithms. The map allows the robot to comprehend its environment in a three-dimensional format and accurately identify objects for interaction.

This technology’s primary goal is to promote intelligent robots’ use in industrial digitization, especially in dynamic and complex environments where intuitive, natural language-based collaboration between humans and robots is essential. A mobile sensor system has been developed for the robot’s perception and language interaction, combining RGB cameras, LIDAR, GPS, and inertial sensors.

Additionally, researchers have created an innovative measurement method that enables robots to operate in GPS-denied environments by using visual markers and surveying equipment. A unique, publicly available dataset has also been developed, featuring trajectories in diverse environments such as urban areas, fields, and forests. This resource is invaluable for researchers and industry professionals worldwide.

Industry leaders, including the ABB Latvia and NATRIX teams, have already praised the technology, which they recognize as having the potential to drive innovation and make robot deployment more efficient and effective.

This achievement highlights the collaboration between EDI and LU MII, showcasing their ability to deliver innovative solutions that advance Latvian science and ensure global competitiveness.