{"id":359,"date":"2024-09-09T23:51:05","date_gmt":"2024-09-09T23:51:05","guid":{"rendered":"https:\/\/blogs.oregonstate.edu\/marineautonomy\/?page_id=359"},"modified":"2024-12-05T18:21:28","modified_gmt":"2024-12-05T18:21:28","slug":"advancing-subsea-manipulation-with-an-rov-mounted-robotic-arm","status":"publish","type":"page","link":"https:\/\/blogs.oregonstate.edu\/marineautonomy\/advancing-subsea-manipulation-with-an-rov-mounted-robotic-arm\/","title":{"rendered":"Advancing Subsea Manipulation with an ROV-Mounted Robotic Arm"},"content":{"rendered":"\n<p>Sponsor: Office of Naval Research<br>ONR Award Number: N00014-21-1-2052<br>Project Leads: Geoff Hollinger (OSU), Aaron Marburg (UW)<br>Project Dates: December 2020-December 2025<\/p>\n\n\n\n<p>This project is developing new technologies in perception, control\/optimization, operator interfaces, and soft materials to enable dextrous, robust, and flexible robotic manipulation in underwater environments. The team envisions a semi-autonomous remotely operated vehicle (ROV) capable of performing complex manipulation tasks (e.g. hull cleaning, pier maintenance, and environmental sampling) in highly energetic conditions. An operator provides high-level commands to the vehicle through an interface that provides advanced decision support, and the commands are interpreted and executed using advanced robotic perception and trajectory optimization\/control algorithms. The vehicle uses a soft gripper attached to a high-degree-of-freedom arm with onboard touch sensing to feel its way around the environment and provide a robust grasp. Such a system has the potential to improve the efficiency of subsea manipulation tasks, reduce ROV operator\u2019s training requirements, and enable the completion of tasks in environments where dexterous manipulation is not currently possible. This project is a collaboration between Oregon State University and the University of Washington Applied Physics Laboratory and includes laboratory testing in the O. H. Hinsdale Wave Laboratory at Oregon State University using a robotic arm mounted on a test stand.<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter\"><img decoding=\"async\" src=\"https:\/\/osu-wams-blogs-uploads.s3.amazonaws.com\/blogs.dir\/4109\/files\/2024\/08\/UnderwaterManipulationTestbed.jpg\" alt=\"This image has an empty alt attribute; its file name is UnderwaterManipulationTestbed.jpg\" \/><figcaption class=\"wp-element-caption\">Photo of the underwater manipulation testbed operating in the O.H. Hinsdale Wave Research Laboratory at Oregon State University. (Image Credit: OSU)<\/figcaption><\/figure>\n<\/div>\n\n\n<h2 class=\"wp-block-heading\">Publications &amp; Presentations<\/h2>\n\n\n\n<h3 class=\"wp-block-heading\">2024<\/h3>\n\n\n\n<p>R. Challa, H. Brown, C. Jain, Z. Speiser and H. Knight, \u201c<a href=\"https:\/\/drive.google.com\/file\/d\/1cfGr68Lj7aPF_gywGr-dsU9Y8aO7qZsI\/view\">Scrape That Barnacle\u2019: Commanding Underwater Robot In-Contact Manipulation Tasks with Intuitive Spatial-Temporal-Force Features<\/a>,\u201d 2024 IEEE International Conference of Robot and Human Communication (Ro-Man) @Inter-AI workshop.<\/p>\n\n\n\n<p>S. Chow, \u201c<a href=\"https:\/\/ir.library.oregonstate.edu\/concern\/graduate_thesis_or_dissertations\/1z40m246h\">Learning-based Techniques for Fast and Robust Motion Planning<\/a>,\u201d PhD thesis, Oregon State University, Corvallis, OR, March 2024.<\/p>\n\n\n\n<p>J. Cook, \u201c<a href=\"https:\/\/ir.library.oregonstate.edu\/concern\/graduate_thesis_or_dissertations\/r494vt68f\">Multiagent Learning of Robust Teaming<\/a>\u201d, PhD thesis, Oregon State University, Corvallis, OR, June 2024.<\/p>\n\n\n\n<p>I. Good, \u201cRobots with a Twist: Torque Responsive Metamaterials Enable Efficient Energy and Force Transduction,\u201d PhD Thesis, University of Washington, Seattle, WA, July 2024.<\/p>\n\n\n\n<p>I. Good, S. Balaji and J. I. Lipton, &#8220;<a href=\"http:\/\/doi.org\/10.1109\/RoboSoft60065.2024.10521982\">Enhancing the Performance of Pneu-Net Actuators Using a Torsion Resistant Strain Limiting Layer<\/a>,&#8221; <em>2024 IEEE 7th International Conference on Soft Robotics (RoboSoft)<\/em>, San Diego, CA, USA, 2024, pp. 235-242.<\/p>\n\n\n\n<p>N. Guimond and A. Marburg and H. Chizeck, \u201c<a href=\"https:\/\/proceedings-halifax24.oceanstechnical.org\/session.cfm?sid=59\">FindingPlastic: Underwater Plastic Bag Detection and Retrieval<\/a>,\u201d MTS\/IEEE Oceans 2024 Halifax.<\/p>\n\n\n\n<p>M. Jiang, S Khorram, F.Li. <a href=\"https:\/\/ieeexplore.ieee.org\/document\/10656069\">Comparing the Decision-Making Among Transformers and CNNs with Explanation Methods<\/a>. IEEE\/CVF International Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, 2024. Best Student Paper Runner-Up.<\/p>\n\n\n\n<p>S. Khorram, M. Jiang, M. Shahbazi, M.H. Danesh, F. Li. <a href=\"https:\/\/arxiv.org\/abs\/2402.17065\">Taming the Tail in Class-Conditional GANs: Knowledge Sharing via Unconditional Training at Lower Resolutions<\/a>. CVPR, 2024.<\/p>\n\n\n\n<p>A. Marburg, L. Lindzey, M. Micatka, T. Player, and A. Sekar, \u201c<a href=\"https:\/\/proceedings-halifax24.oceanstechnical.org\/session.cfm?sid=69\">An Open-Source Pipeline for Automated Subsea Object Grasping<\/a>,\u201d MTS\/IEEE Oceans 2024 Halifax Online Proceedings.<\/p>\n\n\n\n<p>M. Micatka and A. Marburg, \u201c<a href=\"https:\/\/proceedings-halifax24.oceanstechnical.org\/session.cfm?sid=69\">Clustered Grasp Volumes for Improved Grasp Selection<\/a>.\u00a0 MTS\/IEEE Oceans 2024 Halifax Online Proceedings.<\/p>\n\n\n\n<p>M. Rosette, H. Kolano, C. Holm, G. Hollinger, A. Marburg, M. Pickett, and J.R. Davidson, \u201c<a href=\"https:\/\/ieeexplore.ieee.org\/document\/10611358\">WAVE: An open-source underWater arm-vehicle emulator<\/a>,\u201d In Proc. IEEE Int\u2019l Conf. on Robotics and Automation (ICRA), Yokohama, Japan, May 2024, pp. 1505-1511.<\/p>\n\n\n\n<p>R. Singh and G. Hollinger, &#8220;<a href=\"https:\/\/research.engr.oregonstate.edu\/rdml\/sites\/research.engr.oregonstate.edu.rdml\/files\/dynamicgrasping_oceans2024.pdf\">Motion-aware underwater robotic grasping<\/a>,&#8221; in Proc. IEEE OCEANS Conference, Halifax, Canada, September 2024.<\/p>\n\n\n\n<p>D. Smerkous, Q. Bai, Li Fuxin. Minimizing Hyperspherical Energy for Diverse Deep Ensembling. Accepted to NeuRIPS 2024.<\/p>\n\n\n\n<p>A. Ullah, T. Yan and L. Fuxin, &#8220;<a href=\"http:\/\/dx.doi.org\/10.1109\/ICRA57147.2024.10611160\">CVAE-SM: A Conditional Variational Autoencoder with Style Modulation for Efficient Uncertainty Quantification<\/a>,&#8221; 2024 IEEE International Conference on Robotics and Automation (ICRA), Yokohama, Japan, 2024, pp. 10786-10792.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">2023<\/h3>\n\n\n\n<p>P. Baskaran, PhD Thesis, &#8220;<a href=\"https:\/\/ir.library.oregonstate.edu\/concern\/graduate_thesis_or_dissertations\/rx913z78w\">Multi-Dimensional Task Recognition for Human-Robot Teaming<\/a>,&#8221; Oregon State University, December 2023.<\/p>\n\n\n\n<p>S. Chow, D. Chang, and G. Hollinger, \u201c<a href=\"https:\/\/ieeexplore.ieee.org\/document\/10052750\">Parallelized control-aware motion planning with learned controller proxies<\/a>,\u201d IEEE Robotics and Automation Letters, vol. 8, no. 4. pp. 2237-2244, April 2023.\u00a0<\/p>\n\n\n\n<p>M. Jiang, S. Khorram, Li, F.\u00a0 \u201c<a href=\"https:\/\/proceedings.bmvc2023.org\/188\/\">Diverse Explanations for Object Detectors with Nesterov-Accelerated iGOS++ <\/a>&#8220;,\u201d\u00a0 in Proc.\u00a0 British Machine Vision Conference (BMVC), Aberdeen, UK, 2023.\u00a0<\/p>\n\n\n\n<p>W. Khademi, F. Li.\u00a0 \u201c<a href=\"https:\/\/proceedings.bmvc2023.org\/188\/\">Diverse Shape Completion via Style-Modulated Generative Adversarial Networks<\/a>,\u201d\u00a0 In Proc.\u00a0 Neural Information Processing Systems (NeuRIPS), New Orleans, LA, USA, 2023.\u00a0<\/p>\n\n\n\n<p>T.\u00a0 Player, D.\u00a0 Chang, F. Li, and G.\u00a0 Hollinger, &#8220;<a href=\"https:\/\/ieeexplore.ieee.org\/document\/10161529\">Real-time generative grasping with spatio-temporal sparse convolution<\/a>,&#8221; in Proceedings of the IEEE International Conference on Robotics and Automation, London, UK, May 2023.\u00a0<\/p>\n\n\n\n<p>N. G. Pusalkar, M.-R. Giolando, J. A. Adams, \u201c<a href=\"https:\/\/doi.org\/10.1145\/3568294.3580210\">Autonomous Underwater Robot Grasping Decision Support System<\/a>,\u201d HRI &#8217;23: Companion of the 2023 ACM\/IEEE International Conference on Human-Robot Interaction, pp. 887-888, 2023.<\/p>\n\n\n\n<p>N. G. Pusalkar, M.-R. Giolando, J. A. Adams, \u201c<a href=\"https:\/\/doi.org\/10.1145\/3568294.358007\">Decision Support System for Autonomous Underwater Robot Grasping<\/a>,\u201d HRI &#8217;23: Companion of the 2023 ACM\/IEEE International Conference on Human-Robot Interaction, pp. 198-202, 2023.<\/p>\n\n\n\n<p>K. Sullivan, \u201c<a href=\"http:\/\/hdl.handle.net\/1773\/49894\">Using an off-the-shelf rigid gripper to grasp objects of different strengths and compliances<\/a>,\u201d MS Thesis, University of Washington, 2023.<\/p>\n\n\n\n<p>A. Shaevitz, M. L. Johnston and J. R. Davidson, &#8220;<a href=\"https:\/\/doi.org\/10.1109\/RoboSoft55895.2023.10121983\">Design, Characterization, and Modeling of Barometric Tactile Sensors for Underwater Applications<\/a>,&#8221; 2023 IEEE International Conference on Soft Robotics (RoboSoft), Singapore, Singapore, 2023, pp. 1-6<a href=\"https:\/\/doi.org\/10.1109\/RoboSoft55895.2023.10121983\">.<\/a><\/p>\n\n\n\n<h3 class=\"wp-block-heading\">2022<\/h3>\n\n\n\n<p>A. Garg, I. Good, D. Revier, K. Airis and J. Lipton, &#8220;<a href=\"https:\/\/doi.org\/10.1109\/RoboSoft54090.2022.9762141\">Kinematic Modeling of Handed Shearing Auxetics via Piecewise Constant Curvature<\/a>,&#8221; <em>2022 IEEE 5th International Conference on Soft Robotics (RoboSoft)<\/em>, Edinburgh, United Kingdom, 2022, pp. 423-430.<\/p>\n\n\n\n<p>I. Good, T. Brown-Moore, A. Patil, D. Revier and J. I. Lipton, &#8220;<a href=\"https:\/\/doi.org\/10.1109\/ICRA46639.2022.9812156\">Expanding the Design Space for Electrically-Driven Soft Robots Through Handed Shearing Auxetics<\/a>,&#8221; <em>2022 International Conference on Robotics and Automation (ICRA)<\/em>, Philadelphia, PA, USA, 2022, pp. 10951-10957.<\/p>\n\n\n\n<p>K. Puente, S. Walker, J. Davidson, and G. Hollinger, &#8220;Design and grasp planning for a reconfigurable variable stiffness underwater robotic hand,&#8221; in Proc. IEEE International Conference on Robotics and Automation Workshop on Compliant Manipulation (ICRA), Philadelphia, PA, May 2022.<\/p>\n\n\n\n<p>Y. K. Senewiratne, \u201cDecentralized multi-robot exploration with sparse communication through deep imitation learning,\u201d MS Thesis, Oregon State University, 2022.<\/p>\n\n\n\n<p>J. Yuan, J. Patravali, H. Nguyen, C. Kim, F. Li. &#8220;<a href=\"https:\/\/doi.org\/10.48550\/arXiv.2301.12352\">Maximal Cliques on Multi-Frame Proposal Graph for Unsupervised Video Object Segmentation<\/a>,&#8221; European Conference on Computer Vision 2022. <em>arXiv:2301.12352<\/em>.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">2021<\/h3>\n\n\n\n<p>D. Chang, S. Chow, T. Player, and G. Hollinger, &#8220;Adaptive and informative planning for an underwater vehicle-manipulator system,&#8221; in Proc. <em>IEEE International Conference on Robotics and Automation 1st Advanced Marine Robotics Technical Committee Workshop on Active Perception (ICRA)<\/em>, virtual, May, 2021.<\/p>\n\n\n\n<p><\/p>\n\n\n\n<p><a href=\"https:\/\/blogs.oregonstate.edu\/marineautonomy\/projects\/\" data-type=\"page\" data-id=\"472\">Return to projects page<\/a>&#8230;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Sponsor: Office of Naval ResearchONR Award Number: N00014-21-1-2052Project Leads: Geoff Hollinger (OSU), Aaron Marburg (UW)Project Dates: December 2020-December 2025 This project is developing new technologies in perception, control\/optimization, operator interfaces, and soft materials to enable dextrous, robust, and flexible robotic manipulation in underwater environments. The team envisions a semi-autonomous remotely operated vehicle (ROV) capable of &hellip; <\/p>\n<p class=\"link-more\"><a href=\"https:\/\/blogs.oregonstate.edu\/marineautonomy\/advancing-subsea-manipulation-with-an-rov-mounted-robotic-arm\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;Advancing Subsea Manipulation with an ROV-Mounted Robotic Arm&#8221;<\/span><\/a><\/p>\n","protected":false},"author":199,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-359","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/blogs.oregonstate.edu\/marineautonomy\/wp-json\/wp\/v2\/pages\/359","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.oregonstate.edu\/marineautonomy\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/blogs.oregonstate.edu\/marineautonomy\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.oregonstate.edu\/marineautonomy\/wp-json\/wp\/v2\/users\/199"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.oregonstate.edu\/marineautonomy\/wp-json\/wp\/v2\/comments?post=359"}],"version-history":[{"count":14,"href":"https:\/\/blogs.oregonstate.edu\/marineautonomy\/wp-json\/wp\/v2\/pages\/359\/revisions"}],"predecessor-version":[{"id":553,"href":"https:\/\/blogs.oregonstate.edu\/marineautonomy\/wp-json\/wp\/v2\/pages\/359\/revisions\/553"}],"wp:attachment":[{"href":"https:\/\/blogs.oregonstate.edu\/marineautonomy\/wp-json\/wp\/v2\/media?parent=359"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}