Duration | 2012 - 2014
Project leader | Gabriel Oliver Codina
Collaborators | Alberto Ortiz Rodriguez | Yolanda González Cid | Javier Antich Tobaruela | José Guerrero Sastre | Antoni Burguera Burguera | Francisco Bonnín Pascual | Emilio García Fidalgo | Miquel Massot Campos | Pep Lluis Negre Carrasco | Stephan Wirth
Global ObjectivesThe TRITON project proposes two scenarios as a proof of concept to demonstrate the developed capabilities: (1) the search and recovery of an object of interest (e.g. a black box) and (2) the intervention of an underwater panel in a permanent observatory. The first mission scenario will be divided in several sub-tasks. First, the mission will begin with the deployment of the AUV and the intervention I-AUV, which should then adopt and maintain a safe formation that enables acoustic communication and absolute positioning of both vehicles. Then, a sonar survey will be carried out by the AUV to detect the signal emitted by a pinger in the black box. The detection of such signal will be followed by a second survey, whose objective is to create a photomosaic of the area, making possible to visually identify the object. Finally, the AUV will be sent back to perform the intervention task to recover the object. The second mission scenario will also begin with the deployment and formation of both marine robots in order to establish communications and absolute positioning. Then, the AUV will use acoustics to interrogate a transponder mounted in the observatory with the objective to guide the vehicle transit to the panel. When visual contact with the objective is established, the AUV will approach the panel using visual servoing. The final part of the docking operation will involve a mechanism to rigidly attach the vehicle to the panel. After this, the manipulation will take place. Two demonstrative applications are foreseen: Opening/closing a valve, and connecting/disconnecting a cable.
Need for coordination and added value of the coordinationThe TRITON coordinated research project aims the use of autonomous vehicles to execute complex underwater intervention tasks. The project focuses on the coordinated operation of multiple vehicles executing a cooperative mission, on increasing the dexterity of the hand-arm system available in the I-AUV, and on the improvement of the sensorial capabilities needed in all stages of the missions. Accordingly, TRITON has been broken down into 3 subprojects: COMAROB, responsible for the cooperation of two marine robots; VISUAL2, in charge of the visual mapping and the optical object identification; and GRASPER, responsible for the multisensory based autonomous manipulation.
Specific Objectives of Each SubprojectThe “COMAROB” subproject (UdG) has three main goals: 1) to consolidate the systems developed so far, to safely bridge the gap between water tank experiments and open sea trials; 2) to extend the system’s architecture, currently being used for the NGC (navigation, guidance and control), obstacle avoidance, path planning and mission control of each vehicle, to enable cooperation among themselves; and 3) to carry out SLAM-based acoustic mapping while simultaneously using cooperative navigation for ground truth. The main goals assumed by the “GRASPER” subproject (UJI) will cover the main aspects related to the mission specification by the user and the process of robotic manipulation: (1) development of the user interface and simulation capabilities needed for the complete project, improving the initial interface developed through the previous project; (2) design and integration of a more capable hand-arm system than the previously developed within the RAUVI project. For this project, we aim to build a more advanced gripper that can be used for different tasks, and to improve the grasping/manipulation functionalities by means of a better multisensory integration; (3) development and application of new methods for underwater manipulation that go beyond the current state of the art. This task will be in charge of planning the intervention mission details and to perform them in realistic conditions. For that, a new grasp planner will be developed making use of range and visual information provided by the I-AUV sensors. The VISUAL2 subproject (UIB) will focus on: (1) enhancing the vehicle self-localization performance using SLAM-based strategies fed with stereo images and acoustic information, taking into account the special features of the underwater scenarios and the intended missions of TRITON; (2) development of 3D safe path planning algorithms and obstacle avoidance strategies; (3) development of a laser and video fusion framework to extract enhanced structural information of the scenes of interest and the objects to be manipulated.
N. Palomeras, A. Peñalver, M. Massot, P. L. Negre, J. Javier, P. Ridao, P. J. Sanz, G. Oliver. I-AUV Docking and Panel Intervention at Sea. In Sensors, Basel (Switzerland), MDPI, vol. 16, no. 1673, October, 2016.
M. Solbach, F. Bonin-Font, A. Burguera, G. Oliver. Robust WorldCentric Stereo EKF Localization with Active Loop Closing for AUVs. In Pattern Recognition and Image Analysis, Rusia, Pleiades Publishing - SPRINGER, Yuri I. Zhuravlev, vol. 26, no. 1, pp. 205-215, 2016.
L. Lopez-Fuentes, G. Oliver, S. Massanet. Revisiting Image Vignetting Correction by Constrained Minimization of Log-Intensity Entropy. In Advances in Computational Intelligence, Springer, Ignacio Rojas, Gonzalo Joya, Andreu Català, vol. II, no. LNCS 9095, pp. 450-463, 2015.
M. Massot, G. Oliver, H. Kemal, Y. Petillot, F. Bonin-Font. Structured light and stereo vision for underwater 3D reconstruction. In MTS/IEEE Oceans, Genova, Italy, 2015.
F. Bonin-Font, P. L. Negre, , G. Oliver. Stereo SLAM for Robust Dense 3D Reconstruction of Underwater Environments. In MTS/IEEE Oceans, Genoa, 2015.
, F. Bonin-Font, A. Burguera. 6DOF EKF SLAM in Underwater Environments. University of the Balearic Islands, 2014.
D. Moreno, A. Burguera, G. Oliver. Side Scan Sonar images based SLAM. Universitat de les Illes Balears, 2014.
P. Ridao, M. Carreras, D. Ribas, P. J. Sanz, G. Oliver. Intervention AUVs: The Next Challenge. In International Federation of Automatic Control World Congress (IFAC-WC), Cape Town, South Africa, pp. 12146-12159, 2014.
A. Burguera, F. Bonin-Font, G. Oliver. Trajectory-Based Visual Localization in Underwater Surveying Missions. In Sensors, MDPI, vol. 15, no. 1, pp. 1708-1735, 2015 .
F. Bonin-Font, M. Massot, P. L. Negre, G. Oliver, J. P. Beltran. Inertial Sensor Self-Calibration in a Visually-Aided Navigation Approach for a Micro-AUV. In Sensors, MDPI, vol. 15, no. 1, pp. 1825-1860, 2015.
F. Bonin-Font, G. Oliver, S. Wirth, M. Massot, P. L. Negre, J. P. Beltran. Visual Sensing for Autonomous Underwater Exploration and Intervention Tasks. In Ocean Engineering,, vol. 93, pp. 25-44, January, 2015.
, F. Bonin-Font, A. Burguera, G. Oliver, D. Paulus. Stereo EKF Pose-based SLAM for AUVs. In Open German-Russian Workshop on PATTERN RECOGNITION and IMAGE UNDERSTANDING, Koblenz, 2014.
M. Prats, J. García, S. Wirth, D. Ribas, P. J. Sanz, P. Ridao, N. Gracias, G. Oliver. Multipurpose Autonomous Underwater Intervention: A System Integration Perspective. In 20th Mediterranean Conference on Control & Automation (MED), Barcelona, 2012.
M. Massot, G. Oliver. Underwater laser-based structured light system for one-shot 3D reconstruction. In IEEE Sensors , Valencia, 2014.
D. Moreno, A. Burguera, G. Oliver. SSS-SLAM: An Object Oriented Matlab Framework for Underwater SLAM using Side Scan Sonar. In XXXV Jornadas de Automática, Valencia, 2014.
A. Burguera, G. Oliver. Intensity Correction of Side-Scan Sonar Images. In Proceedings of the 19th IEEE International Conference on Emerging Technologies and Factory Automation (ETFA 2014), Barcelona, 2014.
N. Palomeras, A. Peñalver, M. Massot, G. Vallicrosa, P. L. Negre, J. Javier, P. Ridao, P. J. Sanz, G. Oliver, A. Palomer. I-AUV Docking and intervention in a subsea panel. In IEEE/RSJ International Conference on Intelligent Robots and Systems , Chicago, Illinois, USA, 2014.
F. Bonin-Font, P. L. Negre, A. Burguera, G. Oliver. LSH for Loop Closing Detection in Underwater Visual SLAM. In Proceedings of IEEE International Conference on Emerging Technologies and Factory Automation, Barcelona, 2014.
A. Burguera, F. Bonin-Font, G. Oliver. Reducing the computational cost of underwater visual SLAM using dynamic adjustment of overlap detection. In Proceedings of IEEE International Conference on Emerging Technologies and Factory Automation, Barcelona, 2014.
M. Massot, G. Oliver. One-shot underwater 3D reconstruction. In Proceedings of the 19th IEEE International Conference on Emerging Technologies and Factory Automation (ETFA 2014), Barcelona, Spain, 2014.
P. L. Negre, F. Bonin-Font, G. Oliver. Stereo Graph-SLAM for Autonomous Underwater Vehicles. In Intelligent Autonomous Systems 13 (Proceedings of the 13th International Conference on Intelligent Autonomous Systems IAS13), Padova/Venice, pp. 351-360, 2014 .
A. Burguera, F. Bonin-Font, G. Oliver. Towards Robust Image Registration for Underwater Visual SLAM. In Proceedings of the International Conference on Computer Vision, Theory and Applications (VISSAP), Lisbon, pp. 539-544, 2014.
F. Bonin-Font, A. Burguera, G. Oliver. Underwater Visual SLAM using a Bottom-Looking Camera. March, 2014.
F. Bonin-Font, J. Antich, A. Ortiz, G. Oliver. Vision-based Mobile Robot Motion Control Combining T2 and ND Approaches. In Robotica, Cambridge University Press, vol. 32, no. 4, pp. 591–609, July, 2014.
P. L. Negre, G. Oliver. Visual Odometry Parameters Optimization for Autonomous Underwater Vehicles. In Fifth International Workshop on Marine Technology, Girona, Spain, 2013.
M. Massot, G. Oliver. Evaluation of a laser based structured light system for 3D reconstruction of underwater environments. In Martech 2013 5th International Workshop on Marine Technology, Girona, Spain, 2013 .
S. Wirth, P. L. Negre, G. Oliver. Visual Odometry for Autonomous Underwater Vehicles. In Proceedings of the IEEE/MTS Oceans Conference, Bergen, Norway, 2013.
F. Bonin-Font, J. P. Beltran, G. Oliver. Multisensor Aided Inertial Navigation in 6DOF AUVs using a Multiplicative Error State Kalman Filter. In Proceedings of the IEEE/MTS Oceans Conference, Bergen, Norway, 2013.
A. Burguera, Y. González, G. Oliver. The UspIC: Performing Scan Matching Localization Using an Imaging Sonar. In Sensors, MDPI, vol. 12, no. 6, pp. 7855-7885, 2012.