-+++ 20220408 SX DEC Night

07:38 David started processes on the WFS and presses Operate
  • error
WfsArbitrator_144867|INF|       160|2022-04-08 07:38:23.387385|             MAIN > Waiting for network connection (left box)
WfsArbitrator_144867|INF|       161|2022-04-08 07:38:23.387907|             MAIN > Turning off RESET_BCU_47
WfsArbitrator_144867|INF|       162|2022-04-08 07:38:53.388880|             MAIN > Cannot turn off Bcu47 RESET-Active Low. Reason: Timeout waiting for powerboard.L.RESET_BCU_47.CUR - TIMEOUT_ERROR - GENERIC_SYS_ERROR
WfsArbitrator_144867|ERR|       163|2022-04-08 07:38:53.388992|             MAIN > Exception: Cannot turn off Bcu47 RESET-Active Low. Reason: Timeout waiting for powerboard.L.RESET_BCU_47.CUR - TIMEOUT_ERROR
WfsArbitrator_144867|ERR|       164|2022-04-08 07:38:53.389062|             MAIN > Cannot turn off Bcu47 RESET-Active Low. Reason: Timeout waiting for powerboard.L.RESET_BCU_47.CUR - TIMEOUT_ERROR (-1000) GENERIC_SYS_ERROR
  • click Operate again and does not get this error
  • failed on turning on cube rotator
WfsArbitrator_144867|INF|       229|2022-04-08 07:50:36.353048|             MAIN > Turning on cubestage
WfsArbitrator_144867|INF|       230|2022-04-08 07:51:06.353920|             MAIN > Cannot turn on Cube stage. Reason: Timeout waiting for picctrl.L.cubestage.CUR - TIMEOUT_ERROR - GENERIC_SYS_ERROR
WfsArbitrator_144867|ERR|       231|2022-04-08 07:51:06.354013|             MAIN > Exception: Cannot turn on Cube stage. Reason: Timeout waiting for picctrl.L.cubestage.CUR - TIMEOUT_ERROR
WfsArbitrator_144867|ERR|       232|2022-04-08 07:51:06.354078|             MAIN > Cannot turn on Cube stage. Reason: Timeout waiting for picctrl.L.cubestage.CUR - TIMEOUT_ERROR (-1000) GENERIC_SYS_ERROR
WfsArbitrator_144867|DEB|       233|2022-04-08 07:51:06.354411|             MAIN > arbFunc updateModulationInternal (, 'FLAOWFS', '', 2000)
  • Operate button again
  • same error on cube rotator
  • manually turned on cube rotator on HW GUI
  • Manually power everything off

08:00 w_stop_all
  • w_start_all: Failed to start housekeeper
  • w_stop_all
  • w_start_all: OK

08:05 Operate button
  • Master diagnostic process is down
  • restart
  • in log get many errors
MasterDiagnostic_48191|WAR|     19876|2022-04-08 08:17:16.286350|           BCU39 > FramesDownloader BCU39: UNEXPECTED BCU FRAME SIZE: 2988. instad of 2860
MasterDiagnostic_48191|WAR|     19877|2022-04-08 08:17:16.286402|           BCU39 > FramesDownloader BCU39: frame % successfully discarded !
MasterDiagnostic_48191|WAR|     19877|2022-04-08 08:17:16.286402|           BCU39 >  . 
MasterDiagnostic_48191|WAR|     19878|2022-04-08 08:17:16.286432|           BCU39 > FramesDownloader BCU39: UNEXPECTED BCU FRAME SIZE: 2988. instad of 2860
MasterDiagnostic_48191|WAR|     19879|2022-04-08 08:17:16.286455|           BCU39 > FramesDownloader BCU39: frame % successfully discarded !
MasterDiagnostic_48191|WAR|     19879|2022-04-08 08:17:16.286455|           BCU39 >  . 
MasterDiagnostic_48191|WAR|     19880|2022-04-08 08:17:16.286483|           BCU39 > FramesDownloader BCU39: UNEXPECTED BCU FRAME SIZE: 2988. instad of 2860
MasterDiagnostic_48191|WAR|     19881|2022-04-08 08:17:16.286502|           BCU3
  • Master diagnostic process is down

08:15 w_stop_all
  • w_start_all: Failed twice to start housekeeper
  • third_start_all is successful
  • OCAM display

WfsArbitrator_61659|INF|        29|2022-04-08 08:26:10.408832|             MAIN > Loaded devices: ['power', 'flowerpot', 'lamp', 'fw1']
WfsArbitrator_61659|INF|        30|2022-04-08 08:26:21.628279|             MAIN > ccd.equalize_quadrants(): nothing to do for ocam2
WfsArbitrator_61659|ERR|        31|2022-04-08 08:26:25.747553|             MAIN > Reading shared buffer masterdiagnostic.L:OPTLOOPBUF (-5001) TIMEOUT_ERROR
WfsArbitrator_61659|DEB|        32|2022-04-08 08:26:25.748253|             MAIN > arbFunc updateModulationInternal (, 'FLAOWFS', '', 2000)
WfsArbitrator_61659|INF|        33|2022-04-08 08:26:25.748653|             MAIN > Tip-tilt frequency is not synced, skipping update
WfsArbitrator_61659|DEB|        34|2022-04-08 08:26:25.748707|             MAIN > arbFunc updateModulationInternal done.
WfsArbitrator_61659|DEB|        35|2022-04-08 08:26:25.749515|             MAIN > arbFunc updateModulationInternal (, 'FLAOWFS'

MasterDiagnostic_61557|WAR|       911|2022-04-08 08:28:51.897362|           BCU39 > FramesDownloader BCU39: frame % successfully discarded !
MasterDiagnostic_61557|WAR|       911|2022-04-08 08:28:51.897362|           BCU39 >  . 
MasterDiagnostic_61557|INF|       912|2022-04-08 08:29:09.802176|            MAIN > Changing mode for BCU39 to 3 level...

  • still

AGW power interface loaded
ocam2 interface loaded
ccd47 interface loaded
WARNING: MasterDiagnostic is not working properly. Impossible to notify it if frame size changes !
ttctrl interface loaded
Lamp interface loaded
Camera lens interface loaded
Calling setHObinningOrCcdMode with mode=2
  • power off on WFS Control GUI
WfsArbitrator_116110|INF|        33|2022-04-08 08:44:23.493155|             MAIN > Loaded devices: ['sc']
WfsArbitrator_116110|DEB|        34|2022-04-08 08:44:23.912977|             MAIN > ('set framerate: 1000.000000 Hz',)
WfsArbitrator_116110|ERR|        35|2022-04-08 08:44:24.116197|             MAIN > thAOApp instance has no attribute 'fw1'
  • w_stop_all
  • w_start_all
  • Check OCAM and it is Live

08:51 Alex send OSCO preset:

  • 10 minutes with no skip frames
  • Then seeing went for ~0.9" to 1.5 and variable
  • TN with many skip frames: 090427,090457, 090648
  • Loop Opened. Seeing up to 1.8"
  • re-close loop
    • Optimize gain
    • GOPT
  • Seeing ~1.4"
  • Maybe see a bit of a bite on the Mirror GUI at 9:00

09:14 Turn on NCPA to see if has an affect
  • Seeing now ~1.0"
  • See a bit of a bite, but no worse that with NCPA off

09:18 AdSec Arbitrator died. IIF report ICE refused
  • a minute later the IIF error was no connection to the adsec
09:21 Restarted via the process GUI * AdSec still set 09:24 PresetAO oK
  • Closing
  • Center star OK
  • No light on OCAM for center pupil. See star on ccd47
  • Interrupt
  • Center star again.
  • OCAM was not cooled.
  • Cooled and could now see light
  • Seeing blew up to 2..5". Switch to MODS

-- DougMiller - 08 Apr 2022
Topic revision: r2 - 08 Apr 2022, DougMiller
This site is powered by FoswikiCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding Foswiki? Send feedback