6 Sept. 2016 DX Wakeup with CentOS 5

02:38 Power on WFS

03:01 Send first ACE preset

03:08 AcquireRef failed during 10 mode closed loop

03:11 StarAO failed at low gain full modes.
  • Forces out of safe range ID 115
  • Recon 20160302_201626.fits

03:14 Ace Preset
  • 03:14:55 Timeout waiting for slopecomctrl.R.MASTERD.DECIMATION.CUR (-5001)

03:16 Send PresetAO from AOS GUI. Success

03:19 ACE Preset. Success

03:20 RunAO. Failed
  • 03:21:54 Safe Skip Activated
  • Forces out of range ID 55

03:25 Preset AO. Success

03:25 RunAO
  • Set "Force Bad Seeing" on AOS GUI
  • 20150128_012342.fits KL_v16
  • 03:28:53 Closed loop for ~ 1 minute

03:29:52 Open Loop
  • RIP
  • Recover fail failed 3 times
  • Panic state
  • from IDL terminal, print, fsm_power_off()
  • Stop, Start AdSec Arbitrator

03:31 Power On

03:33 Load Programs
  • Success first time

03:36 SetFlatAO. Success

03:37 ACE Preset. Success

03:40 RunAO
  • bad shape of shell when closed loop on 10 modes See screen shot
  • 03:44:28 Safe Skip Activated
  • Forces out of range ID 67

03:46 ACE Preset. Success

03:47 RunAO
  • 10 mode shell shape fine
  • success

04:16 Trying to get Gopt to work.
  • error in /tmp/gopt.stdout
  • cannot find idl_lapack.py

04:16 Trying to for creation of c2m file

---------- Forwarded message ----------
From: Alfio Puglisi 
Date: Wed, May 18, 2016 at 4:30 PM
Subject: Re: Trouble getting gopt to run
To: Douglas Miller 


Hi Doug,
from the logs it appears like a known problem: when the gopt first encounters a new modal basis (KL_v16) in this case, the elab_lib needs to invert the m2c matrix to obtain a c2m, but for some reason the IDL inversion routine crashes when called from gopt.
The solution is to open a TN with the elab_lib and make it calculate the c2m, for example asking for (a->control())->c2m()

I have just done that with a fresh TN, so try again the gopt and see if it repeats

Alfio

04:16 Saved optical loop data
  • 20160906_041638

04:42 Cannot get Gopt to run.
  • optical loop date 20160906_044208

04:44 Gopt not working. Send email to Alfio
  • in /tmp/gopt.stdout
  • python: symbol lookup error: /usr/local/itt/idl71/bin/bin.linux.x86/idl_lapack.so: undefined symbol: IDL_MessageDefineBlock
  • od_gopt.R |WAR| 26|2016-09-06 04:48:45.829560| GET_RAW_DATA > Error reading shared buffer: This operation requires previous initialization - trying to reattach [AdsecDiagnLib.cpp:144]

04:50 Stop and restart wfsarb
  • fix python error and error in od_gopt above
  • now 200 frames saved by od_gopt
  • other errors

/tmp/gopt.stdout

% SAVE: Feature disabled for demo mode.
% Execution halted at: AOSLOPES::DATIPRODUCER   58
   /home/flao/TEST/idl/elab_lib/aoslopes__define.pro
%                      AOSLOPES::GETDATI   88
   /home/flao/TEST/idl/elab_lib/aoslopes__define.pro
%                      AOSLOPES::SLOPES   74
   /home/flao/TEST/idl/elab_lib/aoslopes__define.pro
%                      AORESIDUAL_MODES::DATIPRODUCER   69
   /home/flao/TEST/idl/elab_lib/aoresidual_modes__define.pro
%                      AORESIDUAL_MODES::GETDATI  114
   /home/flao/TEST/idl/elab_lib/aoresidual_modes__define.pro
%                      AOTIME_SERIES::DATI  119
   /home/flao/TEST/idl/elab_lib/aotime_series__define.pro
%                      AORESIDUAL_MODES::MODES   82
   /home/flao/TEST/idl/elab_lib/aoresidual_modes__define.pro
%                      DEMOD4OPTICALGAIN   32
   /home/flao/TEST/idl/wfs_lib/demod4opticalgain.pro
%                      $MAIN$          

od_gopt.R          |INF|     91943|2016-09-06 05:03:03.672481|             MAIN > Getting frame 1996 of 2000
od_gopt.R          |INF|     91944|2016-09-06 05:03:03.674921|             MAIN > Getting frame 1997 of 2000
od_gopt.R          |INF|     91945|2016-09-06 05:03:03.676586|             MAIN > Getting frame 1998 of 2000
od_gopt.R          |INF|     91946|2016-09-06 05:03:03.678553|             MAIN > Getting frame 1999 of 2000
od_gopt.R          |INF|     91947|2016-09-06 05:03:03.680743|             MAIN > Getting frame 2000 of 2000
od_gopt.R          |INF|     91948|2016-09-06 05:03:03.680802|             MAIN > Writing on disk....
od_gopt.R          |INF|     91949|2016-09-06 05:03:04.309041|             MAIN > All data saved correctly

python_17510       |INF|        38|2016-09-06 05:02:28.404892|             MAIN > Tracknum: 20160906_250000 demodDelta/demodCmd:   0/  0 gopt: 1.00
python_17510       |INF|        39|2016-09-06 05:02:36.153726|             MAIN > Tracknum: 20160906_250000 demodDelta/demodCmd:   0/  0 gopt: 1.00
python_17510       |INF|        40|2016-09-06 05:02:43.145175|             MAIN > Tracknum: 20160906_250000 demodDelta/demodCmd:   0/  0 gopt: 1.00
python_17510       |INF|        41|2016-09-06 05:02:50.793431|             MAIN > Tracknum: 20160906_250000 demodDelta/demodCmd:   0/  0 gopt: 1.00
python_17510       |INF|        42|2016-09-06 05:02:57.540765|             MAIN > Tracknum: 20160906_250000 demodDelta/demodCmd:   0/  0 gopt: 1.00

Still cannot get elab to calculate c2m matrix

AO> (a->control())->c2m()

(a->control())->c2m()
                    ^
% Syntax error.
AO> 

05:15 ads_stop/start DX
  • IDL was Zombie
  • fastdiagn and adsecarb not connected to msgd

Change to LBC

07:39 Back to RFBG
  • a lot of coma
  • re-home M2 and M3. No change
  • let active optics do its correction

08:11 ACE Preset. Success
  • 12.4 mag
  • bin 2

08:13 RunAO
  • success
  • get correct command from Alfio
  • IDL> help, (a->control())->c2m()
  • Gopt Loop work
  • NCPA applied

08:41 ACE preset to 9.1 mag star
  • success
  • unchecked bad seeing table

08:43 ACE preset with good seeing table
  • success

08:44 RunAO
  • failed
  • safe skip active

08:53 Preset and RunAO success
  • safe skip many times during auto gain and during closed loop
  • Loop open with safe skip active

08:54 preset with bad seeing table.
  • Success
  • RunAO
  • Optical Gain = 0.2 Low!
  • Loop Open, safe skip activated

09:03 Preset with bad seeing
  • optical gain ~0.2
  • stable

09:15 Preset ACE with good table using KL_v16
  • failed. Arbitrator interface generic error
  • 09:15:20 message deserialization from AOS.R in AOARB.R.log

09:21 Preset
  • success
  • RunAO
  • stable
  • will leave in KL_V16 for good seeing
  • seeing ~ 0.8

09:31 Many offsets
  • 5" all good
  • 30, 0 OK star slight off in Y direction
  • 30, 0 to 60, 0 failed. Star slightly off in -Y direction. Tip on Adsec too much?
  • AdSec in Failed state. Recover on first try.

09:37 Preset, RunAO
  • success
  • offset 30, 0 OK
  • 0ffset 60, 0 OK
  • Offset 90,0 failed
Tue Sep 6 09:47:59.592 2016 right Offset alert for LUCIFER: Pause{FLAO}[22]
Tue Sep 6 09:47:59.606 2016 right Offset alert for LUCIFER: OffsetXY{FLAO}[155] - RETRY: Offset outside FoV limits. Target xyz is -127.08 -50.06 55.00 (-5002) VALUE_OUT_OF_RANGE_ERROR
Tue Sep 6 09:47:59.622 2016 right Offset alert for LUCIFER: guide star not stable in guide box
Tue Sep 6 09:47:59.636 2016 right Offset command complete with warnings for LUCIFER, Sound=offsetWarning.wav
  • Turned guiding/active optics back on.
  • offset 60, 0 failed.
    • star moved back onto acquisition field but not on hotspot because guiding had moved the stat.
      Tue Sep 6 09:49:41.129 2016 right Offset alert for LUCIFER: Pause{FLAO}[22]
      Tue Sep 6 09:49:41.140 2016 right Offset alert for LUCIFER: OffsetXY{FLAO}[157]
      Tue Sep 6 09:49:41.155 2016 right Offset alert for LUCIFER: Resume{FLAO}[22] - RETRY: Star not found - loop still paused (-20002) WFSARB_STAR_WRONGFLUX
      Tue Sep 6 09:49:41.170 2016 right Offset alert for LUCIFER: Resume{FLAO}[22] - RETRY: Star not found - loop still paused (-20002) WFSARB_STAR_WRONGFLUX
      Tue Sep 6 09:49:41.185 2016 right Offset command failed for LUCIFER, Sound=offsetFailed.wav
      
    • should not have guided!!

09:56 Offset 60, 0
  • failed
  • Ref star was ~4" low on acquisition camera. Move up to hotspot
  • Loop could not find star on Pyramid. Failed

10:11 Offset
  • 30, 0 barely
  • 0, 0 OK barely
  • 60, 0 Failed needed to move to the right ~ 4".

10:16 Hand over to Olga and LBC's

-- %USERSIG{DougMiller - 2016-09-06}%
Topic revision: r3 - 10 Sep 2016, DougMiller
This site is powered by FoswikiCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding Foswiki? Send feedback