PROJECT COOPERAMOS – SUBPROJECT VI-SMART

COOPERAMOS - COOPErative Resident robots for Autonomous ManipulatiOn Subsea -- Vi-SMART Visual Sensing for Multi-iAUV opeRaTions.

Project type: Collaborative Project, Projects

Period: 2021 - 2024

COOPERAMOS is a coordinated project whose consortium includes 3 Spanish Universities: University Jaume I of Castellón (UJI), University of Girona (UdG) and the University of the Balearic Islands (UIB). The coordinator is Prof. Pedro Sanz from the University Jaume I. The project aims at using of at least 3 I-AUVs, cooperating for enabling complex underwater intervention tasks, such as bulky load transport and cooperative complex structure assembly, in a priori unknown area, including obstacles. This intervention will be done with high autonomy never demonstrated before. The project objectives include the design of multimodal user interfaces, advanced control strategies, multi-vehicle localization and mapping, target detection and tracking, underwater wireless communication and cooperative mobile manipulation of 3 I-AUVs. The complexity of the proposed system requires a multidisciplinary team including mechanical, electronics and computer engineers as well as experts in artificial intelligence, mathematics and telecommunications. COOPERAMOS project proposes the use of an scalable team of resident single/dual arm I-AUVs for complex structure assembly. To implement the resident I-AUV concept a new cage-type docking station will be designed and developed which, together with new homing and docking algorithms will enable the long term deployment of the robot. Assembling 2 objects requires solving the peg-into-hole problem with an accuracy hard to achieve underwater. The use of a dual-arm system will alleviate this problem since achieving high accuracy between both end-effectors is feasible through a good calibration process. The assembly of complex structures requires the cooperation of several robots. Planning the mission with several robots to obtain the sequence of operations required for assembling complex structures is also one of the challenges included in the project.

The main effors of the SRV Group framed in the VI-SMART Subproject, will be mostly focused on a twofold objective: to supply and analyse visual information, subsequently used by several tasks of the global procedure and to provide vision-based multi agent localization and mapping tools to the vehicles. More specifically: a) a new design of a stereo rig will be developed to improve the vision systems available; critical specifications to improve it include resolution, frame-rate, dynamic range and overlapping area at short distances, b) mapping the a priori unknown operation scenes and developing multi-robot visual localization for all the targets that participate in the mission; the cooperation architecture will take into account the communication constraints, due to signal attenuation underwater, to guarantee the data exchange between the vehicles for multi agent localization, c) the research will be centred on innovating and adapting AI techniques (CNNs) for 3D object recognition underwater and grasping guidance, c) the SRV is also involved in the experimental activity at local and at consortium level.

Grant PID2020-115332RB funded by MCIN/AEI/10.13039/501100011033.

Related Publications