20200706 First Half: OSCO, Full AO, NSO, ESM

Startup

02:00 WFS
  • w_stop, w_start
  • Operate
  • OCAM is good. Chill
  • PresetAO from AOS Command GUI Sucessful

Andrew's night log

Open

02:35 Open chamber

02:48 Josh set Pointing

03:05 OCSO
  • AcqiureRef Failed
  • OCAM go to Not live
  • Guido says that voltage information from one crate was lost. Housekeeper disabled coils. Seen this before. Happens right after loop closes.
AdSecArbitrator_58750|INF|     10508|2020-07-07 03:09:59.290360|     ALERTHANDLER > Received from masterdiagnostic.L a DumpSaved alert with filename /local/aolog/2020/07/07/ADAPTIVE-SECONDARY_00001594091399_20200707_030959.bin
AdSecArbitrator_58750|INF|     10509|2020-07-07 03:09:59.290412|     ALERTHANDLER > Processdump is skipped
AdSecArbitrator_58750|ERR|     10510|2020-07-07 03:10:00.343237|     ALERTHANDLER > Received an ERROR alert! Forcing Failure state.
AdSecArbitrator_58750|ERR|     10511|2020-07-07 03:10:00.343297|     ALERTHANDLER > Alert message: COILS DISABLED from housekeeper.L
AdSecArbitrator_58750|INF|     10512|2020-07-07 03:10:50.210708|             MAIN > Received cmd: StopAo(1)
AdSecArbitrator_58750|INF|     10513|2020-07-07 03:10:50.210789|   COMMANDHANDLER > FSM (status: Failure) has received command 2015 (Stop Ao)
AdSecArbitrator_58750|ERR|     10514|2020-07-07 03:10:50.210804|   COMMANDHANDLER > adsecarb: Fsm is discarding command 2015 (Stop Ao)...
AdSecArbitrator_58750|WAR|     10515|2020-07-07 03:10:50.210984|             MAIN > StopAo: WARNING - adsecarb:Illegal command for state Failure (Stop Ao)
AdSecArbitrator_58750|INF|     10516|2020-07-07 03:11:24.097408|             MAIN > Received cmd: RecoverFailure()
AdSecArbitrator_58750|INF|     10517|2020-07-07 03:11:24.097497|   COMMANDHANDLER > FSM (status: Failure) has received command 2002 (Recover failure)
AdSecArbitrator_58750|WAR|     10518|2020-07-07 03:11:56.346723|             MAIN > AlertNotifier for adseccontrol5.L is already installed!
idl_58661          |INF|      6425|2020-07-07 03:11:33.414572|             MAIN > Ok. All Crate Bcus are ready
  • Recover Fail OK
  • Set Shell
  • FLAO GUI is froozen
  • Stopped and started the AdSec Arbitrator process, but FLAO is still frozen

03:20 OSCO SCRIPT
  • set intervention mode
  • everything started properly
  • GOPT on
  • on GOPT GUI the NCPA Trigger is Dark and says Disable
  • script collects data properly
  • TN 034340, 034417
  • LUCI 2-21

03:45 NCPA Turned on
  • NCPA Trigger now Green, Enabled
  • TN 034755, 034826, 034843
  • LUCI 23-42

03:50 Preset to M92
  • Full AO
  • Set to Auto Mode. Success through Optimize Gain
  • GOPT Fail
WfsArbitrator_148693|DEB|       787|2020-07-07 04:01:21.899841|             MAIN > getSetupFits(): fits header created
WfsArbitrator_148693|DEB|       788|2020-07-07 04:01:21.927300|             MAIN > arbFunc optimizeGainInternal done.
WfsArbitrator_148693|DEB|       789|2020-07-07 04:01:21.928534|             MAIN > arbFunc startGoptInternal (, 'FLAOWFS', 'LUCIFER')
WfsArbitrator_148693|ERR|       790|2020-07-07 04:01:43.819251|             MAIN > RETRY: Gopt did not stabilize within 5 iterations (-5001) TIMEOUT_ERROR

04:00 FLAO GUI it stuck
  • Xianyu sees that the AO Arbitrator still has Closed loop.
  • I had sent a StopAO from the AOS command GUI, but the Loop remained closed.
  • I then clicked Open on the WFS Control GUI
  • The SetFlatAO did not finish because act 164 had high forces
  • Stop/Start the AO Arbitrator, it gets the correct state and FLAO GUI comes to life

04:20 Loop Closed on M92
  • Offset is failing on AGw#1
  • Causes ResumeAO to not be sent

06:20 Collimation Preset to Anik

06:50 ACE_Track preset to Anik (then cancel preset on FLAO GUI)
  • Bayside stages at -69.55, -47.578
  • LUCI in endless mode
  • Watch ccd47
  • Josh use IE, CA to get Anik on CCD47

07:10 ACE_Track preset sucessful
  • Offsets work

07:25 Handover to Arcetri

-- DougMiller - 07 Jul 2020
Topic revision: r2 - 07 Jul 2020, DougMiller
This site is powered by FoswikiCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding Foswiki? Send feedback