{"id":41686,"date":"2007-06-17T18:22:24","date_gmt":"2007-06-17T10:22:24","guid":{"rendered":"https:\/\/wp-productionenv-bjg9h2g2bgg5b8aa.southeastasia-01.azurewebsites.net\/news\/teamwork-expertise-and-confidence-solving-the-iss-troubles\/"},"modified":"2007-06-17T18:22:24","modified_gmt":"2007-06-17T10:22:24","slug":"teamwork-expertise-and-confidence-solving-the-iss-troubles","status":"publish","type":"post","link":"https:\/\/starpath.global\/news\/teamwork-expertise-and-confidence-solving-the-iss-troubles\/","title":{"rendered":"Teamwork, Expertise and Confidence \u2013 solving the ISS\u2019 troubles"},"content":{"rendered":"<p>With all of the Russian computers now working again on the International Space Station (ISS), the final element of testing the systems will involve an attitude test during Sunday and Monday mornings.\n<\/p>\n<p>  The lengths US and Russian engineers went to, in order to solve the problem \u2013 and build contingencies in case they were unsuccessful \u2013 were extensive, as seen in a series of memos and reports which portrayed the excellence that is required for working within the space program.\n<\/p>\n<p><em><img loading=\"lazy\" decoding=\"async\" height=\"129\" alt=\"\" hspace=\"5\" src=\"http:\/\/forum.nasaspaceflight.com\/forums\/get-attachment.asp?action=view&amp;attachmentid=13910\" width=\"600\" align=\"left\" vspace=\"5\" border=\"0\/\"><\/em><\/p>\n<p><em>**The most comprehensive collection&nbsp;of STS-117 onwards&nbsp;related presentions and mission documentation, plus expansive daily processing documentation and updates&nbsp;are&nbsp;<\/em><font color=\"#0000ff\"><em>available to download&nbsp;on L2<\/em><\/font><font color=\"#0000ff\"><em>&nbsp;**<\/em><\/font><\/p>\n<p><em><font color=\"#ff0000\">L2 Members&nbsp;can follow live evaluations with memos and presentations as they are produced via our special STS-117 Special Section. Live as-it-happens NASA information.<\/font><\/em><\/p>\n<p><em><font color=\"#0000ff\">STS-117 LIVE: LAUNCH DAY AND FLIGHT DAY 1<\/font><\/em> \u2013<em> <font color=\"#0000ff\">FLIGHT DAY 2 \u2013 LIVE<\/font>&nbsp;\u2013 <\/em><em><font color=\"#0000ff\">FLIGHT DAY 3 \u2013 LIVE<\/font><\/em>&nbsp;\u2013 <em><font color=\"#0000ff\">FLIGHT DAY 4&nbsp;\u2013&nbsp;LIVE<\/font><\/em>&nbsp;\u2013 <em><font color=\"#0000ff\">FLIGHT DAY 5 \u2013 LIVE<\/font>&nbsp;\u2013 <font color=\"#0000ff\">FLIGHT DAY 6 \u2013 LIVE<\/font>&nbsp;\u2013 <font color=\"#0000ff\">FLIGHT DAY 7 \u2013 LIVE<\/font> \u2013 <font color=\"#0000ff\">FLIGHT DAY 8 \u2013 LIVE<\/font>&nbsp;\u2013 <font color=\"#0000ff\">FLIGHT DAY 9 \u2013 LIVE<\/font> \u2013 <font color=\"#3300ff\">FLIGHT DAY 10 \u2013 LIVE<\/font><\/em><\/p>\n<p><em><u>Article: <\/u><font color=\"#ff0000\">(All the quotes in this article were snippets from previous published quotes in the <font color=\"#3300ff\">L2 sections of this site<\/font>.)<\/font><\/em><\/p>\n<p>Following the success in rebooting the German made computers, after Expedition 15 commander Fyodor Yurchikhin and flight engineer Oleg Kotov installed bypass jumpers on the secondary power supply switches, a successful attitude test is one of the last remaining hurdles to be negotiated, in order to allow Atlantis a nominal undocking.<\/p>\n<p>Atlantis\u2019 undocking is likely to take place on Tuesday, now that it appears that she won\u2019t be required to stay the extra day to assist ISS attitude control via her RCS (Reaction Control System) thrusters. Atlantis has also officially been cleared for returning to Earth, after the successful OMS Pod blanket repair during Friday\u2019s EVA-3.<\/p>\n<p><em><u>Troubleshooting:<\/u><\/em> <\/p>\n<p>The successful repair to the computers started to show promise by Friday evening, as Russian ground teams&nbsp;managed&nbsp;to&nbsp;restart two lanes (subsets) each of the SM Terminal Computer (TVM) and Central Computer (TsVM), after Yurchikhin and Kotov isolated a faulty secondary power supply switch behind SM panels as cause of the computer shutdowns, by bypassing the switch with a jumper cable. The computers later were shut down and then restarted in self-test mode as planned. <\/p>\n<p>\u2018Telemetry data was collected for additional analysis Saturday morning during RGS (Russian Ground Station) passes,\u2019 added a weekend On Orbit status report, which proved to be successful<\/p>\n<p>\u2018TVM (Terminal) and TsVM (Central) computers (specifically on subsets TVM1 &amp; TVM3 and TsVM2 &amp; TsVM3), allowed restart of the computers on these subsets, this morning (Saturday) the two computers and the U.S. GN&amp;C (Guidance, Navigation &amp; Control) MDM computers established communication between each other and are back in Ops mode, after running overnight in Test mode,\u2019 updated a memo on Saturday night. \u2018Normal systems conditions are slowly coming back.\u2019<\/p>\n<p>Plans to return the two computers \u2013&nbsp;that finally became active on Saturday&nbsp;\u2013 via Atlantis have now been cancelled, although NASA noted the Russians may still work towards an advanced launch date \u2013 in late July \u2013 of their next Progress resupply ship, which will carry spares and replacement computers.<\/p>\n<p>These computers have identical hardware and service software, and each one is comprised of three identical FCRs (Fault Containment Regions), or \u2018lanes\u2019, that are separate ORUs (Orbital Replaceable Units). They were developed by the German company DASA (today Astrium) for ESA and RSC-Energia under contract. <\/p>\n<p>\u2018The TsVM, acting as C&amp;C (Command &amp; Control) computer, performs integral control tasks for the RS (Russian segment), controlling data streams, communicating with U.S. C&amp;DH (Command &amp; Data Handling), doing autonomous control tasks, etc,\u2019 added documentation surrounding the issues with the ISS computers.<\/p>\n<p>\u2018The TVM, acting as navigation computer, performs GN&amp;C (Guidance, Navigation &amp; Control) functions, communicating with the U.S. GN&amp;C MDM and the SUDN (Motion Control &amp; Navigation System) of other RS vehicles, and controls a host of other onboard systems.<\/p>\n<p><em><u>Finding causes, using contingencies:<\/u><\/em> <\/p>\n<p>The troubleshooting process started with the power feed from the new S4 solar arrays to the RS via SNT (voltage\/current stabilizers) #23 &amp; #24 being removed in the Node, but leaving the ground path through P-12 connected. The installation of the S3\/S4 truss segment, following deliver by Atlantis, was initially thought to be the cause of the problem.<\/p>\n<p>Friday night saw the crew used a current scopemeter (oscilloscope) in the Node endcone to check on the quality of the current on three wire harnesses that feed power to the RS, in order to determine if EMI (electromagnetic interference) was travelling down one of the lines as noise which could upset a noise-sensitive power supply card. <\/p>\n<p><img loading=\"lazy\" decoding=\"async\" height=\"160\" alt=\"\" hspace=\"5\" src=\"http:\/\/forum.nasaspaceflight.com\/forums\/get-attachment.asp?action=view&amp;attachmentid=24153\" width=\"213\" align=\"left\" vspace=\"5\" border=\"0\/\">\u2018Results were evaluated on the ground, and the S4 power was found clean of any noise and was exonerated,\u2019 it was noted, clearing the truss from the fault tree. However, the installation of the new addition to the station may ultimately have started the chain of events with the Russian computers.<\/p>\n<p>\u2018Root cause analysis is underway. One speculation under consideration is that changes in the ground state, i.e. the difference between the vehicle\u2019s electrical potential and the surrounding plasma \u2018vacuum\u2019, caused sensitive protective secondary power circuitry to turn off the primary power supply on sensing an overvoltage,\u2019 added NASA information. The jumpers bypass either the sensitive logic or the entire overvoltage protection.\u2019<\/p>\n<p>\u2018A grounding change could have been caused by the addition of the 36,000-lbs S3\/S4 truss and a change in the plasma environment or a change in ground path caused by the rewiring and circuit changes. More analyses are required to confirm or change this hypothesis. The ISS is the largest structure ever erected in space, and this situation cannot be tested on the ground. But the experience will help teach us how to build the large space structures of the future.\u2019 <\/p>\n<p>Contingency procedures were worked through,&nbsp;from the moment the computers initially went down, although it\u2019s still uncertain as to exactly when this happened \u2013 only that they were up at the time Atlantis docked last week.<\/p>\n<p>A short return to operation on two of the computers allowed Russian controllers to take a level of action, which bought them some time during the initial phase of troubleshooting. At no time were the crew in any danger. <\/p>\n<p>\u2018When the SM computers came up on one lane each for a short time early this morning, it sufficed for recycling the FGB MDM (Multiplexer\/ Demultiplexer) computer to connect it to the SM and to activate one ARCU (American-to-Russian Converter Unit) to feed power to the FGB systems.\u2019 information on Friday stated. \u2018As a result, U.S. power flow to the FGB and Soyuz TMA-10\/14S was restored. <\/p>\n<p>\u2018The Soyuz spacecraft has its main battery recharged (the entry battery was never touched). Supplying U.S. power via dragthrough cable is being studied as a potential future option.<\/p>\n<p>\u2018The brief activation of two SNTs and one ARCU allowed Russian specialists to operate one of the SM external thermal loops and improve maintenance of internal temperatures in the SM (stabilizing at ~4 degC above nominal). <\/p>\n<p>\u2018Elektron (O2 generation) and Vozdukh (CO2 removal) were down, but Vozdukh can operate without the TVM, and there is plenty of O2 on board, to be supplied from Progress tanks as required. Also, the new U.S. OGS (Oxygen Generation System) is scheduled to become operational later during the 13A Stage. <\/p>\n<p>\u2018The SKV air conditioners remained off during the day, but humidity control is adequately served by the U.S. CCAA (Common Cabin Air Assembly), and specialists are looking at new procedures for using SKV without TVM. The BMP Harmful Impurities Removal System remained active, as did all other RS systems.\u2019 <\/p>\n<p><font face=\"Arial\" size=\"2\"><img loading=\"lazy\" decoding=\"async\" height=\"130\" alt=\"\" hspace=\"5\" src=\"http:\/\/forum.nasaspaceflight.com\/forums\/get-attachment.asp?action=view&amp;attachmentid=13815\" width=\"200\" align=\"left\" vspace=\"5\" border=\"0\/\"><\/font><font face=\"Arial\" color=\"#0000ff\" size=\"2\">**Ride home through the fire and plasma of re-entry with Atlantis on STS-115 \u2013&nbsp;And&nbsp;now also with&nbsp;Discovery on STS-116&nbsp;\u2013 TWO Stunning high quality&nbsp;2hr, 355mb videos \u2013 from deorbit burn to post landing**<\/font><\/p>\n<p>The main issue \u2013 which also related to Atlantis \u2013 was attitude control for the ISS, required for nominal undocking from the station. This also \u2013 during the time of troubleshooting \u2013 had contingencies in place. <\/p>\n<p>\u2018The ISS has been in gravity-gradient stabilized attitude to minimize use of the CMG MM (Control Moment Gyroscope\/Momentum Management) system,\u2019 noted On Orbit status report information on Friday evening. \u2018Russian reaction control jets (thrusters) are not required until the ISS needs to maneuver, e.g., for Shuttle undocking attitude, to desaturate the CMGs, or for debris avoidance. <\/p>\n<p>\u2018Russian thrusters are available for desaturation as needed as attitude control mode is back on CMG TA (Control Moment Gyroscope with Thruster Assist).\u2019<\/p>\n<p><em><u>Teamwork:<\/u><\/em> <\/p>\n<p>Another impressive joint US\/Russian effort involved \u2018study teams\u2019 from both countries carrying out an on-going effort to add \u2018lessons learned\u2019 from the recent events, should they occur again.<\/p>\n<p>\u2018Joint US\/Russian Study Teams: Alternative approaches to station attitude control, including off-nominal Shuttle undocking, are being studied by a special team of U.S. and Russian experts,\u2019 one report stated. <\/p>\n<p>\u2018Other joint teams are investigating the root cause of the computer failures, approaches to optimizing ISS configuration without Russian computer control, including critical systems and resources, and the updating \u2013 where necessary \u2013 previously developed and filed de-crewing criteria, including timeline, Soyuz safe departure, and optimum station systems configuration to facilitate subsequent re-crewing.\u2019<\/p>\n<p>During the height of the computer failures, NASA called on their experts to be on standby to support efforts for off nominal attitude problems. <\/p>\n<p>\u2018Steve Poulos (Orbiter Project manager) has asked all MER (Mission Evaluation Room) subsystem teams to be ready to support any request coming from organizations working the ISS attitude control problems,\u2019 noted one memo, which was soon followed by a call for multiple teams to be set up, with the ability of 24\/7 support. <\/p>\n<p>\u2018Multiple teams formed that encompasses a lot of different personnel: 1. Root Cause \/ System Recovery Team. 2. Alternate Attitude Control Team. 3. Crewed Operations Team. \u2018How can the crew stay long as possible without Russian assets?\u2019 4. De-Crewing Team. \u2018How to set up the ISS if it were evacuated.\u2019 5. Alternate Orbiter Entry Team.\u2019<\/p>\n<p>Other NASA departments \u2013 not normally directly related to Shuttle or ISS \u2013 even offered their support, should it have been required. That offer came from Constellation Program Manager Jeff Hanley.<\/p>\n<p>\u2018Constellation program support to ISS \u2013 Explorers, I fully support Jeff\u2019s offer of folks working Cx (Constellation) to support ISS as they recover attitude control,\u2019 noted an e-mail sent by Mission Operations Project Office and former ISS manager Dennis Webb, which concluded with a rallying call \u2013 quoting from the&nbsp;\u2018Foundations of Mission Control\u2019 \u2013 to the troops, one that epitomized how NASA work, despite rarely being portrayed as such&nbsp;in the media.<\/p>\n<p>\u2018These things go without saying it but I will say them anyway: Foundations of Mission Operations: To instil within ourselves these qualities essential to professional excellence. Discipline\u2026Being able to follow as well as to lead, knowing that we must master ourselves before we can master our task. Competence\u2026There being no substitute for total preparation and complete dedication, for space will not tolerate the careless or indifferent. <\/p>\n<p>\u2018Confidence\u2026Believing in ourselves as well as others, knowing that we must master fear and hesitation before we can succeed. Responsibility\u2026Realizing that it cannot be shifted to others, for it belongs to each of us; we must answer for what we do, or fail to do. Toughness\u2026Taking a stand when we must; to try again, and again, even if it means following a more difficult path. <\/p>\n<p>\u2018Teamwork\u2026Respecting and utilizing the abilities of others, realizing that we work toward a common goal, for success depends upon the efforts of all. Vigilance\u2026 Always attentive to the dangers of spaceflight; Never accepting success as a substitute for rigor in everything we do. <\/p>\n<p>\u2018To always be aware that suddenly and unexpectedly we may find ourselves in a role where our performance has ultimate consequences. To recognize that the greatest error is not to have tried and failed, but that in the trying we do not give it our best effort. Ad astra per aspera, Dennis.\u2019<\/p>\n<p><em><u>EVA-4:<\/u><\/em><\/p>\n<p>Flight Day 9 was mainly uneventful, as the crews conducted media events and preparations for the fourth and final spacewalk of STS-117, which will be conducted by Pat Forrester and Steven Swanson. <\/p>\n<p>Objectives of the spacewalk, scheduled to begin just after midday EDT, include verification of DLA-2 installation, suspected of being mislabelled for DLA-1, removing the remaining SARJ (Solar Alpha Rotary Joint) launch restraints.<\/p>\n<p>Also involved will be the stowing of the S3 drag link\/keel pin, relocating an APFR (Articulated Portable Foot Restraint) and installing MMOD (Micrometeoroid\/Orbital Debris) shields bolts, preparing the MT Mobile Transporter) translation path, removing GPS-4 antenna, removing SASA (S-band Antenna Support Assembly) gimbal locks, and more.<\/p>\n<p>The EVA was completed on Sunday in just over six hours.<\/p>\n<p><em><font face=\"Arial\" size=\"2\">Follow Atlantis\u2019 mission with live updates on our <\/font><font face=\"Arial\" color=\"#0000ff\" size=\"2\">Flight Day specific interactive live event pages<\/font><font face=\"Arial\" size=\"2\"> \u2013 open to all. <\/font><\/em><\/p>\n<p><em><font face=\"Arial\" size=\"2\"><br \/>\n<\/font><\/em><\/p>\n<p><em><font face=\"Arial\" size=\"2\">For <font color=\"#0000ff\">L2 members<\/font>, follow NASA\u2019s evaluations on the L2 Flight Day specific pages (which contain 100s and&nbsp;same day documentation and presentations \u2013&nbsp;uploaded live during each Flight Day \u2013 60 presentations on Flight Day 7 and 8 alone).<\/font><\/em><\/p>\n<p><font face=\"Arial\" size=\"2\"><img loading=\"lazy\" decoding=\"async\" height=\"60\" alt=\"\" hspace=\"5\" src=\"http:\/\/forum.nasaspaceflight.com\/forums\/get-attachment.asp?action=view&amp;attachmentid=12993\" width=\"468\" align=\"left\" vspace=\"5\" border=\"0\/\"><\/font><\/p>\n<p><em><font face=\"Arial\" size=\"2\">**INFINITY: 10 minute&nbsp;STS MUSIC&nbsp;VIDEO**<\/font><\/em><font face=\"Arial\"><\/font><font size=\"2\"><em>&nbsp;\u2013 COMING SOON: Atlantis\/Starlight.<br \/><\/em><\/font><font size=\"1\">(<em>Video section is FREE, but you need to sign up as a member of the forum to enter the video section of the site. We only use your e-mail to send you your password. It will not be used for spam etc.)<\/em><\/font><em><\/em><\/p>\n<p><em><br \/>\n<\/em><\/p>\n<p><em><font face=\"Arial\" size=\"2\"><em>**NASASpaceflight.com Job Opportunities**<\/em><\/font><\/em><em><font face=\"Arial\" size=\"2\">&nbsp;<\/font><\/em><\/p>\n<p><em><font face=\"Arial\" size=\"2\"><br \/>\n<\/font><\/em><\/p>\n<p><em><font face=\"Arial\" size=\"2\"><\/font><\/em><\/p>\n","protected":false},"excerpt":{"rendered":"<p>With all of the Russian computers now working again on the International Space Station (ISS), the final element of testing the systems will involve an attitude test during Sunday and Monday mornings. The lengths US and Russian engineers went to, in order to solve the problem \u2013 and build contingencies in case they were unsuccessful [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"inline_featured_image":false,"footnotes":"","_links_to":"","_links_to_target":""},"categories":[2],"tags":[],"class_list":["post-41686","post","type-post","status-publish","format-standard","hentry","category-news"],"acf":[],"_links":{"self":[{"href":"https:\/\/starpath.global\/blog\/wp-json\/wp\/v2\/posts\/41686"}],"collection":[{"href":"https:\/\/starpath.global\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/starpath.global\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/starpath.global\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/starpath.global\/blog\/wp-json\/wp\/v2\/comments?post=41686"}],"version-history":[{"count":0,"href":"https:\/\/starpath.global\/blog\/wp-json\/wp\/v2\/posts\/41686\/revisions"}],"wp:attachment":[{"href":"https:\/\/starpath.global\/blog\/wp-json\/wp\/v2\/media?parent=41686"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/starpath.global\/blog\/wp-json\/wp\/v2\/categories?post=41686"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/starpath.global\/blog\/wp-json\/wp\/v2\/tags?post=41686"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}