{"id":24972,"date":"2021-06-10T23:16:54","date_gmt":"2021-06-10T15:16:54","guid":{"rendered":"https:\/\/wp-productionenv-bjg9h2g2bgg5b8aa.southeastasia-01.azurewebsites.net\/news\/canadarm3-collision-avoidance-ai-solutions-sought-as-operational-needs-solidify\/"},"modified":"2021-06-10T23:16:54","modified_gmt":"2021-06-10T15:16:54","slug":"canadarm3-collision-avoidance-ai-solutions-sought-as-operational-needs-solidify","status":"publish","type":"post","link":"https:\/\/starpath.global\/news\/canadarm3-collision-avoidance-ai-solutions-sought-as-operational-needs-solidify\/","title":{"rendered":"Canadarm3 collision avoidance AI solutions sought as operational needs solidify"},"content":{"rendered":"<p>With launch just five years away, the Gateway Exploration Robotics System \u2014 better known as Canadarm3 \u2014 has arrived at a critical point where its artificial intelligence system must be properly calibrated to meet the rigorous autonomous demands the Lunar Gateway project will impose upon it.<\/p>\n<p>The AI solutions sought for Canadarm3\u2019s vision by MDA and the Canadian Space Agency (CSA) largely relate to obstacle avoidance to prevent the arm from bumping into other structures on the lunar outpost and how to work with issues like prolonged communications blackouts and less-than-optimal lighting conditions \u2014 both of which must be overcome for the Gateway.<\/p>\n<\/p>\n<p>Speaking at a recent industry day event, Chris Langley, AI Lead at MDA for Canadarm3, related some of the challenges posed to the project by the Gateway operations plan, including only one month per year of crewed occupation initially and as little as only 8 hours of communication each week.<\/p>\n<p>Additionally, the Gateway will also, as of now, seek to demonstrate an autonomy goal of 21 days without human intervention \u2014 during which Canadarm3 would have to operate and perform tasks.<\/p>\n<p>\u201cThe idea is to really push for a Mars forward type philosophy.&nbsp; So we would have as little as one, eight hour communication window per week.&nbsp; And during the rest of that, the robotics is on its own; the station is on its own.&nbsp; And it all has to keep functioning,\u201d said Langley.<\/p>\n<p>Representatives from both MDA and CSA also discussed how the solutions needed for Canadarm3 differ from those in use on the International Space Station\u2019s Canadarm2, Mobile Remote Servicer Base System, and Special Purpose Dexterous Manipulator (aka, Dextre).<\/p>\n<p><iframe id=\"twitter-widget-1\" scrolling=\"no\" frameborder=\"0\" allowtransparency=\"true\" allowfullscreen=\"true\" class=\"\" style=\"position: static; visibility: visible; width: 0px; height: 0px; display: block; flex-grow: 1;\" title=\"X Post\" src=\"https:\/\/platform.twitter.com\/embed\/Tweet.html?creatorScreenName=NASASpaceflight&amp;dnt=true&amp;embedId=twitter-widget-1&amp;features=eyJ0ZndfdGltZWxpbmVfbGlzdCI6eyJidWNrZXQiOltdLCJ2ZXJzaW9uIjpudWxsfSwidGZ3X2ZvbGxvd2VyX2NvdW50X3N1bnNldCI6eyJidWNrZXQiOnRydWUsInZlcnNpb24iOm51bGx9LCJ0ZndfdHdlZXRfZWRpdF9iYWNrZW5kIjp7ImJ1Y2tldCI6Im9uIiwidmVyc2lvbiI6bnVsbH0sInRmd19yZWZzcmNfc2Vzc2lvbiI6eyJidWNrZXQiOiJvbiIsInZlcnNpb24iOm51bGx9LCJ0ZndfZm9zbnJfc29mdF9pbnRlcnZlbnRpb25zX2VuYWJsZWQiOnsiYnVja2V0Ijoib24iLCJ2ZXJzaW9uIjpudWxsfSwidGZ3X21peGVkX21lZGlhXzE1ODk3Ijp7ImJ1Y2tldCI6InRyZWF0bWVudCIsInZlcnNpb24iOm51bGx9LCJ0ZndfZXhwZXJpbWVudHNfY29va2llX2V4cGlyYXRpb24iOnsiYnVja2V0IjoxMjA5NjAwLCJ2ZXJzaW9uIjpudWxsfSwidGZ3X3Nob3dfYmlyZHdhdGNoX3Bpdm90c19lbmFibGVkIjp7ImJ1Y2tldCI6Im9uIiwidmVyc2lvbiI6bnVsbH0sInRmd19kdXBsaWNhdGVfc2NyaWJlc190b19zZXR0aW5ncyI6eyJidWNrZXQiOiJvbiIsInZlcnNpb24iOm51bGx9LCJ0ZndfdXNlX3Byb2ZpbGVfaW1hZ2Vfc2hhcGVfZW5hYmxlZCI6eyJidWNrZXQiOiJvbiIsInZlcnNpb24iOm51bGx9LCJ0ZndfdmlkZW9faGxzX2R5bmFtaWNfbWFuaWZlc3RzXzE1MDgyIjp7ImJ1Y2tldCI6InRydWVfYml0cmF0ZSIsInZlcnNpb24iOm51bGx9LCJ0ZndfbGVnYWN5X3RpbWVsaW5lX3N1bnNldCI6eyJidWNrZXQiOnRydWUsInZlcnNpb24iOm51bGx9LCJ0ZndfdHdlZXRfZWRpdF9mcm9udGVuZCI6eyJidWNrZXQiOiJvbiIsInZlcnNpb24iOm51bGx9fQ%3D%3D&amp;frame=false&amp;hideCard=false&amp;hideThread=false&amp;id=1399463943433768961&amp;lang=en&amp;origin=https%3A%2F%2Fwww.nasaspaceflight.com%2F2021%2F06%2Fcanadarm3-ai-sought%2F&amp;sessionId=819ab35dac434db25d7cb1f9225268d6d13b0e60&amp;siteScreenName=NASASpaceflight&amp;theme=light&amp;widgetsVersion=6a3ad42b224df%3A1778106238597&amp;width=550px\" data-gtm-yt-inspected-14=\"true\" data-gtm-yt-inspected-21=\"true\" data-tweet-id=\"1399463943433768961\"><\/iframe><\/p>\n<blockquote class=\"twitter-tweet\" data-width=\"550\" data-dnt=\"true\" data-twitter-extracted-i1783497154590881957=\"true\">\n<p lang=\"en\" dir=\"ltr\">Data collected by @MDA_space\u2019s TRAIL prepares AI researchers to engage on challenges such as tasks related to collision avoidance in an on-orbit system. Download the dataset and view the webinar here: https:\/\/t.co\/evbXIlOV6a #AI #SpaceTech #CDNSpace<\/p>\n<p>\u2014 Amii (@AmiiThinks) May 31, 2021<\/p>\n<\/blockquote>\n<p>Space Shuttle<path d=\"M7.59009 18.59L9.00009 20L17.0001 12L9.00009 4L7.59009 5.41L14.1701 12\" style=\"animation: initial !important; background: initial !important; border: 0px !important; box-shadow: none !important; color: inherit !important; cursor: inherit !important; direction: inherit !important; display: inline !important; fill: currentcolor !important; filter: initial !important; float: none !important; margin: 0px !important; opacity: initial !important; outline: 0px !important; overflow: initial !important; padding: 0px !important; stroke: initial !important; transform: initial !important; vertical-align: initial !important; visibility: inherit !important;\"><\/path>Spaceflight history books<path d=\"M7.59009 18.59L9.00009 20L17.0001 12L9.00009 4L7.59009 5.41L14.1701 12\" style=\"animation: initial !important; background: initial !important; border: 0px !important; box-shadow: none !important; color: inherit !important; cursor: inherit !important; direction: inherit !important; display: inline !important; fill: currentcolor !important; filter: initial !important; float: none !important; margin: 0px !important; opacity: initial !important; outline: 0px !important; overflow: initial !important; padding: 0px !important; stroke: initial !important; transform: initial !important; vertical-align: initial !important; visibility: inherit !important;\"><\/path>SpaceX<path d=\"M7.59009 18.59L9.00009 20L17.0001 12L9.00009 4L7.59009 5.41L14.1701 12\" style=\"animation: initial !important; background: initial !important; border: 0px !important; box-shadow: none !important; color: inherit !important; cursor: inherit !important; direction: inherit !important; display: inline !important; fill: currentcolor !important; filter: initial !important; float: none !important; margin: 0px !important; opacity: initial !important; outline: 0px !important; overflow: initial !important; padding: 0px !important; stroke: initial !important; transform: initial !important; vertical-align: initial !important; visibility: inherit !important;\"><\/path>\n<p>     (adsbygoogle = window.adsbygoogle || []).push({});<\/p>\n<p>ISS robotics are just now beginning to introduce forms of human-supervised automation that will pale in comparison to what is needed for Canadarm3.<\/p>\n<p>\u201cThis leads to a lot of interesting areas where AI can be applied,\u201d noted Langley.&nbsp; \u201cFirst, because we\u2019re operating during loss of signal, we need to have that autonomous execution capability and the ability to recover from any faults that happen as we\u2019re doing our execution.&nbsp; We also need to have systems to close the loop on board.\u201d<\/p>\n<p>\u201cOne of those\u2026 so as the Gateway flexes and changes with the thermal and pressure environments, where the robotic interfaces [that Canadarm3 will grab onto and use to move around the complex] are will move slightly, so we need to close all those loops and we need it to be able to self-diagnose and work to fix issues [without human input].\u201d<\/p>\n<p>However, an equally critical element for Canadarm3\u2019s ability to autonomously perform operations while out of communication with Earth relates to its ability to sense \u2014 or see \u2014 its environment and avoid obstacles that may be present, such as mounting brackets, experiment platforms, visiting vehicle components, handrails for astronaut EVAs (extravehicular activities, or spacewalks), etc.<\/p>\n<p>To try and define these potential issues and set up platforms for obstacle avoidance AI solutions testing, MDA used their Training AI Laboratory (TRAIL) and a 6 degree of freedom robot based on Dextre to capture data on a series of maneuvers (under both nominal and off-nominal conditions) that Canadarm3 will likely be called upon to perform.<\/p>\n<p>\u201cWhat we\u2019re trying to do is tease out different problems that may arise or technology gaps that may arise with Canadarm3 and how we can address them and if the right fit is AI.&nbsp; And we\u2019re not limited to just using a robot and cameras.&nbsp; We\u2019re looking at this across-the-board in terms of other elements such as the ground segment and planning of robotic motions as well.\u201d<\/p>\n<\/p>\n<p><iframe title=\"Animation of Canadarm3, Canada's contribution to the Lunar Gateway\" src=\"https:\/\/www.youtube.com\/embed\/sRSNeGXTj6Q?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture\" allowfullscreen=\"\" name=\"fitvid0\" data-gtm-yt-inspected-14=\"true\" data-gtm-yt-inspected-21=\"true\"><\/iframe><\/p>\n<p>\u201cBasically all the different sectors for Canadarm3, we\u2019re looking to see if there are ways \u2014 if AI is the best solution \u2014 that we can progress the technology.\u201d&nbsp;<\/p>\n<p>For this specific obstacle avoidance test series, TRAIL utilized multiple cameras to capture video of the Dextre-derived robot in motion while either no obstacle (nominal) or an obstacle (off-nominal) was placed near or along its optimal path.<\/p>\n<p>The robot came into contact with an obstacle (defined by MDA&nbsp; as either a direct collision or a \u201cmarked as collision\u201d event because it came too close to the obstacle) 112 times across 330 test runs.<\/p>\n<p>Alberta Machine Intelligence Institute<\/p>\n<p>\u201cAs we\u2019ve been going to the program, we\u2019ve come to realize that we have lots of data on these things, but all the data is not perhaps in a format that\u2019s readily available to AI researchers,\u201d said Dickinson.&nbsp; \u201cSo we\u2019ve been working with our partners at Amii to make the data as AI-enabled as possible so that researchers can then immediately take it, deploy it, and start working on different algorithms for how we can approach this problem.\u201d<\/p>\n<p>The Gateway and Canadarm3\u2019s vision systems will have to contend with any and all possible lighting conditions, as unlike the ISS\u2019s robotic systems that can simply wait for more favorable lighting and shadow conditions, the Gateway\u2019s arm will not have that luxury \u2014 nor will it have the ability to wait for a human to tell it that the \u201cobstacle\u201d in front of it is just a shadow.<\/p>\n<p>\u201cThe Gateway will see some lighting changes that will play a role in how some of the systems are developed,\u201d said Dickinson.&nbsp; \u201cWe have tried to include in the TRAIL data set a variety of lighting conditions to mimic that somewhat.\u201d<\/p>\n<p>Langley added: \u201cOn Gateway, everything is quasi-static.&nbsp; So if you find yourself in a good lighting condition on the day of your operation, that\u2019s great.&nbsp; If not, you\u2019re stuck.&nbsp; You still have to do that [operation] no matter what conditions you see at the time.\u201d<\/p>\n<p><iframe id=\"twitter-widget-2\" scrolling=\"no\" frameborder=\"0\" allowtransparency=\"true\" allowfullscreen=\"true\" class=\"\" style=\"position: static; visibility: visible; width: 0px; height: 0px; display: block; flex-grow: 1;\" title=\"X Post\" src=\"https:\/\/platform.twitter.com\/embed\/Tweet.html?creatorScreenName=NASASpaceflight&amp;dnt=true&amp;embedId=twitter-widget-2&amp;features=eyJ0ZndfdGltZWxpbmVfbGlzdCI6eyJidWNrZXQiOltdLCJ2ZXJzaW9uIjpudWxsfSwidGZ3X2ZvbGxvd2VyX2NvdW50X3N1bnNldCI6eyJidWNrZXQiOnRydWUsInZlcnNpb24iOm51bGx9LCJ0ZndfdHdlZXRfZWRpdF9iYWNrZW5kIjp7ImJ1Y2tldCI6Im9uIiwidmVyc2lvbiI6bnVsbH0sInRmd19yZWZzcmNfc2Vzc2lvbiI6eyJidWNrZXQiOiJvbiIsInZlcnNpb24iOm51bGx9LCJ0ZndfZm9zbnJfc29mdF9pbnRlcnZlbnRpb25zX2VuYWJsZWQiOnsiYnVja2V0Ijoib24iLCJ2ZXJzaW9uIjpudWxsfSwidGZ3X21peGVkX21lZGlhXzE1ODk3Ijp7ImJ1Y2tldCI6InRyZWF0bWVudCIsInZlcnNpb24iOm51bGx9LCJ0ZndfZXhwZXJpbWVudHNfY29va2llX2V4cGlyYXRpb24iOnsiYnVja2V0IjoxMjA5NjAwLCJ2ZXJzaW9uIjpudWxsfSwidGZ3X3Nob3dfYmlyZHdhdGNoX3Bpdm90c19lbmFibGVkIjp7ImJ1Y2tldCI6Im9uIiwidmVyc2lvbiI6bnVsbH0sInRmd19kdXBsaWNhdGVfc2NyaWJlc190b19zZXR0aW5ncyI6eyJidWNrZXQiOiJvbiIsInZlcnNpb24iOm51bGx9LCJ0ZndfdXNlX3Byb2ZpbGVfaW1hZ2Vfc2hhcGVfZW5hYmxlZCI6eyJidWNrZXQiOiJvbiIsInZlcnNpb24iOm51bGx9LCJ0ZndfdmlkZW9faGxzX2R5bmFtaWNfbWFuaWZlc3RzXzE1MDgyIjp7ImJ1Y2tldCI6InRydWVfYml0cmF0ZSIsInZlcnNpb24iOm51bGx9LCJ0ZndfbGVnYWN5X3RpbWVsaW5lX3N1bnNldCI6eyJidWNrZXQiOnRydWUsInZlcnNpb24iOm51bGx9LCJ0ZndfdHdlZXRfZWRpdF9mcm9udGVuZCI6eyJidWNrZXQiOiJvbiIsInZlcnNpb24iOm51bGx9fQ%3D%3D&amp;frame=false&amp;hideCard=false&amp;hideThread=false&amp;id=1399714869071560707&amp;lang=en&amp;origin=https%3A%2F%2Fwww.nasaspaceflight.com%2F2021%2F06%2Fcanadarm3-ai-sought%2F&amp;sessionId=819ab35dac434db25d7cb1f9225268d6d13b0e60&amp;siteScreenName=NASASpaceflight&amp;theme=light&amp;widgetsVersion=6a3ad42b224df%3A1778106238597&amp;width=550px\" data-gtm-yt-inspected-14=\"true\" data-gtm-yt-inspected-21=\"true\" data-tweet-id=\"1399714869071560707\"><\/iframe><\/p>\n<blockquote class=\"twitter-tweet\" data-width=\"550\" data-dnt=\"true\" data-twitter-extracted-i1783497154590881957=\"true\">\n<p lang=\"en\" dir=\"ltr\">A Canadian #rover will land on the #Moon within the next 5 years to demonstrate key technologies and accomplish meaningful science. We are looking for companies to develop concepts for the rover and its science instrument(s): https:\/\/t.co\/A76N8wB3Ky. pic.twitter.com\/0e0lMIB2z6<\/p>\n<p>\u2014 Canadian Space Agency (@csa_asc) June 1, 2021<\/p>\n<\/blockquote>\n<p>Moreover, it\u2019s not just a simple matter of just \u201cturning on a light\u201d at the end of the End Effector \u2014 or hand \u2014 of Canadarm3 to \u201csee better.\u201d<\/p>\n<p>\u201cWe are planning to have illuminators on the End Effectors so we can turn on another source of light,\u201d noted Langley.&nbsp; \u201cBut it\u2019s a real challenge.&nbsp; It\u2019s a power draw and heat dissipation issue.&nbsp; Every time you have the lights on, you generate a lot of waste heat that has to be dissipated from the arm somehow.&nbsp; So we need to be sort of parsimonious with how we add lights.\u201d<\/p>\n<p>While five years is a somewhat compressed timeline to arrive at a solution, it is well within MDA\u2019s and CSA\u2019s experience bases \u2014 and well suited to the Canadian AI and robotics industry.<\/p>\n<p>Furthermore, some elements of the design that are will in flux, like the exact location of cameras outside Gateway that will be critical for autonomous arm operations, location for grapple fixture points, clearance between modules\/external equipment, will become known as the architecture of the Gateway solidifies \u2014 something that will aid Canadarm3\u2019s AI design.<\/p>\n<p>The first elements of the Gateway, the combined Power &amp; Propulsion Element (PPE) and Habitation and Logistics (HALO) modules are set to launch no earlier than May 2024 on a Falcon Heavy rocket from LC-39A at the Kennedy Space Center.<\/p>\n<p>Canadarm3 is currently set to launch in the third quarter of 2026 during the Phase 2 expansion of the Gateway to include the International Partner elements; however, numerous components of its robotic interfaces will be mounted to and launched with the PPE and HALO \u201cand potentially other aspects of the HLS in Phase 1,\u201d noted CSA during the industry day presentation.<\/p>\n<p>The Canadian Space Agency awarded MDA the contract to design, build, and deliver those interfaces earlier this month.<\/p>\n<p>The overall  Gateway Exploration Robotics System is part of Canada\u2019s larger commitment to NASA\u2019s Artemis program and lunar exploration overall. &nbsp;On 26 May, CSA announced Canada\u2019s first robotic rover to the Moon, in cooperation with NASA, that is planned to launch by 2026.<\/p>\n<p><em>(Lead image: Artist\u2019s impression of Canadarm3. Credit: CSA)<\/em><\/p>\n","protected":false},"excerpt":{"rendered":"<p>With launch just five years away, the Gateway Exploration Robotics System \u2014 better known as Canadarm3 \u2014 has arrived at a critical point where its artificial intelligence system must be properly calibrated to meet the rigorous autonomous demands the Lunar Gateway project will impose upon it. The AI solutions sought for Canadarm3\u2019s vision by MDA [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"inline_featured_image":false,"footnotes":"","_links_to":"","_links_to_target":""},"categories":[2],"tags":[293,1948,421,419,194],"class_list":["post-24972","post","type-post","status-publish","format-standard","hentry","category-news","tag-ai","tag-canadarm3","tag-csa","tag-gateway","tag-mda"],"acf":[],"_links":{"self":[{"href":"https:\/\/starpath.global\/blog\/wp-json\/wp\/v2\/posts\/24972"}],"collection":[{"href":"https:\/\/starpath.global\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/starpath.global\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/starpath.global\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/starpath.global\/blog\/wp-json\/wp\/v2\/comments?post=24972"}],"version-history":[{"count":0,"href":"https:\/\/starpath.global\/blog\/wp-json\/wp\/v2\/posts\/24972\/revisions"}],"wp:attachment":[{"href":"https:\/\/starpath.global\/blog\/wp-json\/wp\/v2\/media?parent=24972"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/starpath.global\/blog\/wp-json\/wp\/v2\/categories?post=24972"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/starpath.global\/blog\/wp-json\/wp\/v2\/tags?post=24972"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}