Communication Loss Decision Tree for the Mountain Assistant OSA

What to do in case of communication loss and other emergencies between mountain and the remote-OSA in Tucson

What if the OSA in Tucson is no longer present/conscious?

If you've lost communication with the OSA in Tucson for more than 15 minutes, or if he/she appears unconscious:

  • Call the cell phone of the OSA in Tucson.
  • Call the phone in room N507 (520-626-4335).
  • Call the observer if they are in a different room at Steward.
  • Call for emergency medical assistance as required. ( UAPD Dispatch = 520-621-8273 )
    • We assume you have already been in communication and have allowed suffcient time for bio-breaks.
  • Call John Hill's cell or other alternative OSA for observing support.

  • The Mountain Assistant OSA should immediately close the shutter doors (link to Josh's new procedure) if any of the following conditions occur:
    • The weather becomes at all marginal (approaching 90% of the normal closing limits).
    • It is within 1 hour of sunrise.
    • The telescope is tracking down and is below Elevation 32 degrees.
    • You have not had communication with the Tucson OSA or an alternate for an hour.

What if the Mountain Assistant OSA is no longer present/conscious?

If you've lost communication with the Mountain Assist OSA for more than 15 minutes, or if he/she appears unconscious:

  • Call the cell phone of the Mountain Assistant OSA.
  • Call the normal mountain telephone (520-626-1466)
  • Wake the Summit Manager by calling the phone in his/her mountain bedroom room (per M004s00310).
    • We assume you have already been in communication and have allowed suffcient time for bio-breaks.
    • Do enough rooms have the phone line in the Covid rotation of bedrooms? No (as of 20200601).
  • Call for emergency medical assistance as required. (911 or Graham County Dispatch)

  • If the weather becomes at all marginal, the OSA in Tucson should cease observing and close the shutter doors.

What if the network connection to room N507 in Tucson goes down?

  • Observing may continue (at least for a while), as observing doesn't depend directly on Tucson computers.
  • OSA in Tucson should establish cell or Zoom contact with mountain as soon as possible in order to monitor what is going on.
  • Figure out if the network loss is local to N507 or to the 5th floor or to Steward or the whole University. Is there a working connection via UAWiFi?
    • Note that UAWiFi has historically not been good in N507, so it is normally better to use the LBTO wifi (see back of door).
  • Call Stephen Hooper to help pin down where the outage is. One of you should report the outage to the UArizona CCIT 24/7 Support Center.
  • Note that the mountain VPN is still functional when the Steward Observatory network is down (verified 20200718).

  • In the absence of communication the Mountain Assistant OSA should immediately close the shutter doors (link to Josh's new procedure) if any of the following conditions occur:
    • The weather becomes at all marginal (approaching 90% of the normal closing limits).
    • It is within 1 hour of sunrise.
    • The telescope is tracking down and is below Elevation 32 degrees.
    • You have not had communication with the Tucson OSA or an alternate for an hour.

What if the power goes off in Steward Observatory in Tucson?

  • Observing may continue (at least for a while), as observing doesn't depend directly on Tucson computers.
  • Establish cell or Zoom contact with mountain as soon as possible in order to monitor what is going on.
  • Note that the mountain VPN is still functional when the Steward Observatory power is off (verified 20200718).

  • The Mountain Assistant OSA should immediately close the shutter doors (link to Josh's new procedure) if any of the following conditions occur:
    • The weather becomes at all marginal (approaching 90% of the normal closing limits).
    • It is within 1 hour of sunrise.
    • The telescope is tracking down and is below Elevation 32 degrees.
    • You have not had communication with the Tucson OSA or an alternate for an hour.

What if the power goes off on the mountain?

  • Observing will stop immediately as the power outage shuts off telescope drives, HBS, air compressors, etc.
  • Establish cell or Zoom contact with the OSA in Tucson to keep him/her informed of what is happening.
  • Call for assistance if the backup generator does not come on within 4 minutes (per normal operating procedure).
  • Without commercial or backup power, start preparations to close shutter doors with backup power from the Level 4 propane generator (T300s00002).
  • Once power is restored coordinate with the OSA in Tucson about the various systems that need to be reset.

What if there is a fire alarm in Tucson?

  • Observing may continue (at least for a while), as observing doesn't depend on the Tucson computers.
  • The OSA in Tucson should exit the building promptly (following normal fire alarm procedure), and move to the East side of Cherry Ave. Be sure to take cell phone, laptop and coat with you.
  • Establish cell or Zoom contact with mountain as soon as possible in order to monitor what is going on.
  • Establish cell or Zoom contact with the observer if they aren't standing on the sidewalk beside you.
  • Attempt to make laptop / VPN / X2GO connection to the mountain - there is sufficient UAWiFi signal while sitting on the NOIRLab front steps.
    • We can make a mini-session for X2GO in advance that fits on a laptop screen, or multiple sessions that run in different laptop virtual workspaces.
  • Call John Hill or other OSA who can establish an alternate connection.
  • Call John Hill or S. Bucki if you need to establish contact on the MGIO radio system.
  • Wait for "All Clear" from UAPD before re-entering the building.

What if there is a fire alarm on the mountain?

  • Observing will stop immediately as the fire alarm shuts off HBS, air compressors, etc.
  • The Remote Assistant OSA on the mountain should exit the enclosure immediately (following normal fire alarm procedure).
  • Establish cell or Zoom contact with Tucson once the other mountain personnel are confirmed safe.
  • Call John Hill or S. Bucki if you need to establish contact on the MGIO radio system.
  • The OSA in Tucson should immediately close both shutter doors and vent doors and Level 4 louvers.
  • Observing may resume once mountain personnel have cleared the fire alarm.

Routine Nightly Tasks for the Mountain Assistant OSA

  • Keep a wary eye/ear/nose for unusual events (leaks, noises, burning smells).
  • Press the permissive button for the OSA to authorize shutter and vent door opening.
  • Keep a live eye on the weather (especially for smoke and/or ash fall from wildfires).
  • Assist in resolving E-stops (very rare), alarms and other things requiring manual intervention such as resetting the MCR relay.
  • Deal with the various possible power and communication emergencies described above.

-- JohnHill - 28 May 2020
Topic revision: r10 - 21 Jul 2020, JohnHill
This site is powered by FoswikiCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding Foswiki? Send feedback