Staff:

lbto: David, Alex, Jenny,Juan Carlos, Xianyu

Observer: Enrico, guido and Fabio remote Italy

Summary.

New software deployed for adsec and WFS.

Google Log doc:

https://docs.google.com/document/d/1r_eXvZYxr1lWq6O_G3g1v6I2z5gONORerc9Za2ZLDQk/edit?usp=sharing

> to-be-master

Forecast

forecast-20230402-0.png

forecast-20230402-1.png

forecast_20230402_2.png

Details.

Starting with LBC for high priority targets.

10:30 LuciSX AO

ocam dumps

from the : /home/AOeng/live/source

  • folder, you can call it with:
  • python scripts/bcuDumpScript.py
  • this will generate the 3 dumps at once, in the day's logs folder, with a TN style name (date_hour), something like:
  • dumpBCU2KSRAM_20230120_174742.txt,
  • for SRAM, SDRAM, DSP

nudge predictor.

[lbto@obs1 ObserverSupport ]$ ./nudgepredict.py -d 20230403 -e 12 -b 12
./nudgepredict.py script version of 28-Mar-2022
5187283199.0 end MJD sec for the end of this UT day
60037 end MJD day
5187240000.0 end MJD sec corrected for endhour 12.0
5187196800.0 start MJD sec using backhour 12.0
20230403 is the day to be plotted.
0.0 start hour using backhour 12.0 end hour 12.0
These UT start times will have a nudge if the telescope is tracking.
00:01:30
00:35:38
01:09:46
01:43:54
02:18:02
02:52:10
03:26:18
04:00:26
04:34:34
05:08:42
05:42:50
06:16:58
06:51:06
07:25:14
07:59:22
08:33:30
09:07:38
09:41:46
10:15:54
10:50:02
11:24:10
11:58:18

Jenny switching AO software versions

AdsecSX

Usage: use_soul [version]
Currently running: to-be-master (soul)
Available versions in /home/aoeng/soul:

AdsecDX

[AOeng@dxadsec ~]$ use_soul
Usage: use_soul [version]
Currently running: to-be-master (soul)
Available versions in /home/aoeng/soul:
dev-mmc_with_freeze
mixed_mode_control.20221028

WFS

adsec SX flat.

01:33:17.117903| MAIN > Maximum mode index used to apply flat -> # 639

SX ocam OK

TN:20230403_015249

variable medium-high seeing.

seeing_20230403_1024.png

10:54
  • reconfigure for Lucis
11:05

collimating

binocular OSCO.

11:25

bincular science PSF.

wind speed on SX 7m/s

TSS activated.

skipp frames 65%

TN:_063323

cancel preset. Adsec failure too wndy.

Move out of the wind.

11:39

OSCO bino

WfsArbitrator _89725|INF| 84|2023-04-03 06:39:47.471053| MAIN > Turning off RESET_BCU_47
WfsArbitrator_89725|INF| 85|2023-04-03 06:39:47.471306| MAIN > Resetting bcu47...
WfsArbitrator_89725|ERR| 86|2023-04-03 06:40:47.471980| MAIN > Timeout waiting for techviewctrl.L.STATUS (-5001) TIMEOUT_ERROR

Preset.
  • Mon Apr 3 06:44:40.228 2023 aos.PresetAO{FLAO}.complete - PresetAO {FLAO}[664] - dx:nan dy:nan slNull: f1:0.0 f2:1.0 freq:1700 mag:0 nBins:1 nModes:501 r0:nan snMode:0 strehl:0 ttMod:0
  • variable seeing
  • up to 2"
  • change to mono LuciSX
  • OSCO
  • loop closed +gopt
  • Optimize:_070040
  • jumps in the Tip, too large. Frequyency coordiante with the resonance at1700Hz
tiptilt_jumps_20230402.png
  • 20230403_070920
  • saved AO data.
  • Data_20230403_070920_070710,_070659,_070647,_070517,_070505,_070452,
  • cancel preset. MAIN > fsm_stop_ao end
    AdSecArbitrator_146586|WAR| 483|2023-04-03 07:10:15.956853| MAIN > Cannot dispatch alert "SkipFrame" to /AOARB.L: Outgoing.cpp:493: Ice::UnknownException:
    AdSecArbitrator_146586|WAR| 483|2023-04-03 07:10:15.956853| MAIN > . unknown exception:
    AdSecArbitrator_146586|WAR| 483|2023-04-03 07:10:15.956853| MAIN > . Traceback (most recent call last):
    AdSecArbitrator_146586|WAR| 483|2023-04-03 07:10:15.956853| MAIN > . File "aoarbitrator.py", line 185, in alert
    AdSecArbitrator_146586|WAR| 483|2023-04-03 07:10:15.956853| MAIN > . self._loop._fsm.SkfAlert()
    AdSecArbitrator_146586|WAR| 483|2023-04-03 07:10:15.956853| MAIN > . File "/home/aoeng/live/aoroot/lib/python/AOArb_sm.py", line 612, in trans_sm
    AdSecArbitrator_146586|WAR| 483|2023-04-03 07:10:15.956853| MAIN > . getattr(self.getState(), attrib)(self, *arglist)
    AdSecArbitrator_146586|WAR| 483|2023-04-03 07:10:15.956853| MAIN > . File "/home/aoeng/live/aoroot/lib/python/AOArb_sm.py", line 437, in SkfAlert
    AdSecArbitrator_146586|WAR| 483|2023-04-03 07:10:15.956853| MAIN > . fsm.getState().Exit(fsm)
    AdSecArbitrator_146586|WAR| 483|2023-04-03 07:10:15.956853| MAIN > . File "/home/aoeng/live/aoroot/lib/python/statemap.py", line 104, in getState
    AdSecArbitrator_146586|WAR| 483|2023-04-03 07:10:15.956853| MAIN > . raise StateUndefinedException
    AdSecArbitrator_146586|WAR| 483|2023-04-03 07:10:15.956853| MAIN > . StateUndefinedException
    AdSecArbitrator_146586|WAR| 483|2023-04-03 07:10:15.956853| MAIN > .
    AdSecArbitrator_146586|INF| 484|2023-04-03 07:10:15.966122| COMMANDHANDLER > Command Stop Ao (code 2015) successfully completed
    AdSecArbitrator_146586|WAR| 485|2023-04-03 07:10:16.970558| MAIN > Skip frame detected! (15.59% of frames skipped.)

  • Stop SX.
  • Set Safe
12:11
  • Go to Mono Dx.
  • Enrico and Fabio connected.
  • Mon Apr 3 07:18:48.267 2023 aos.PresetAO{FLAO}.complete - PresetAO {FLAO}[206] - dx:nan dy:nan slNull: f1:0.0 f2:2.0 freq:1700 mag:0 nBins:1 nModes:501 r0:nan snMode:0 strehl:0 ttMod:0
12:22
  • check pointing.
  • Preset.
  • Optimize:20230403_073114
  • next nudge: 07:59:22
  • TN:_073618,_073636,_073654,_073714,_073822(dimm),_073911,_
  • TN+Luci:_073948(no cube)
  • TN+Luci:_074145,_074217,_074240,_074306,_074334,_074357
  • TN+Luci:_074636,_074659,_074731
  • offset.
  • TN+Luci:_074907,_
  • dark: (2)
  • offset.
  • TN+Luci:_075137,_075206,_075229,_075252(jump TT),_075323, _075401(ncpa),_075440(ncpa),_075521(ncpa),_075542(ncpa),_075655(ncpa)
  • TN+Luci(TT jump):_075745
  • next nudge: 08:33:30
  • TN+Luci_ncpa:080103,_080141
01:02
  • bin1 mag 12.
Mon Apr 3 08:04:04.142 2023 aos.PresetAO{FLAO}.started - PresetAO {FLAO}[222] (aomode:ACE-AO,focst:bentGregorianFront,instr:LUCIFER,wfs:FLAOWFS,sox:0[0],soy:0,rox:-0.149263[-0.149263],roy:-0.112756,mag:11.77,cindex:0,,elev:nan,rotang:nan,grvang:nan,r0:0,skybr:nan,windsp:nan,winddir:nan)

  • wait for optimize
  • seeing went up to 2" down to 1.83"
  • optimize:)81059,_
  • seeing 1.5
  • optimize:_081218
  • TN:_081506,_081523,_081538,_081553,_081610,_081627,_081735,_081758,_081820,_081840
  • TN+Luci:_082012,_082038,_082102,_082130,_082156,_082220. ncpa:_082259,_082324,_082347,_082412,_082439,_
08:25
  • TN:_082505 during the drift.
  • loop drift.

  • Force to open,
  • star went back
  • reclose
  • optimize:_082633
  • offset for dark.
  • offset back
  • optimize:_083152
  • nudge catch.
  • next nudge:09:07:38
  • TN:_083537,_083629
  • TN=Luci
  • gopt too bad.
  • tn+luci:_083830,_083857,_083921,_083946,_084008,_084037
  • offset background.
  • dark(20)
01:44
  • offset back.
  • PSF, variables seeing.
40A09CA9-0006-4C52-B434-E6551A68656C.png
  • TN+luci_ncpa:_084527,_084552,_084614,_084655,_084759,_084823,_085109,_085136,_
  • seeing improved stable
  • optimize: _085207
  • false perception..
  • To investigate open loop (?)
AdSecArbitrator _118190|WAR| 1351|2023-04-03 08:53:15.626766| MAIN > Skip frame detected! (94.40% of frames skipped.)
AdSecArbitrator_118190|WAR| 1352|2023-04-03 08:53:16.631268| MAIN > Skip frame detected! (108.22% of frames skipped.)
AdSecArbitrator_118190|WAR| 1353|2023-04-03 08:53:16.631408| MAIN > Maximum skip frames reached: 108.22% of frames skipped. Will alert ICE clients.
AdSecArbitrator_118190|WAR| 1354|2023-04-03 08:53:17.639600| MAIN > Skip frame detected! (108.72% of frames skipped.)
  • change table:
  • table_LUCIFER_ACE-AO_20230403_500m_v01.txt
01:57
  • preset
  • Mon Apr 3 08:57:44.386 2023 aos.PresetAO{FLAO}.started - PresetAO {FLAO}[240] (aomode:ACE-AO,focst:bentGregorianFront,instr:LUCIFER,wfs:FLAOWFS,sox:0[0],soy:0,rox:-2.63266[-2.63266],roy:-2.07683,mag:15.95,cindex:0,,elev:nan,rotang:nan,grvang:nan,r0:0,skybr:nan,windsp:nan,winddir:nan
  • Optimize:_090327
  • TN:_090529,_090601,_090617
  • loop pause
  • loop resume.
next nudge: 09:41:46
  • TN:_090916,_090940,_091048,_091136,_091203,_091231,_
  • TN+Luci (5sec):_091619,_091701,_091731,_091800,_091830,_091859
2:20
  • offset
  • luci dark x2
  • offset back
  • TN+luci_ncpa:_092220,_092255,_092335,_092409,_092437,_092507
No too much sense to go B4, due to bad variable seeing . Moving to B2

02:27

preset.
  • Mon Apr 3 09:27:19.982 2023 aos.Stop{FLAO}.complete - Stop{FLAO}[251]
    Mon Apr 3 09:27:23.740 2023 aos.PresetAO{FLAO}.started - PresetAO {FLAO}[252] (aomode:ACE-AO,focst:bentGregorianFront,instr:LUCIFER,wfs:FLAOWFS,sox:0[0],soy:0,rox:-0.0421252[-0.0421252],roy:-0.0311404,mag:12.76,cindex:0,,elev:nan,rotang:nan,grvang:nan,r0:0,skybr:nan,windsp:nan,winddir:nan)
  • optimize:_093119,093309
  • gopt
  • TN:_093557,_093647,_
  • TN+luci:_093800(noluci),093855,_093921,_093947,_094007,_094029,
02:41
  • loop pause, wait for nudge
  • ok
  • next nudge:10:15:54
  • TN+luci:_094233,_094301
  • TN+luci_ncpa:_094354,_094415,_094437,_094538,_094608,_094648,_094719,_094742,_094803
02:48
  • offset for background.
  • dark x2.
02:50
  • back to 0
  • TN+luci_ncpa:_095054,_095131,_
02:58

preset.
  • Mon Apr 3 09:58:37.563 2023 aos.PresetAO{FLAO}.started - PresetAO {FLAO}[264] (aomode:ACE-AO,focst:bentGregorianFront,instr:LUCIFER,wfs:FLAOWFS,sox:0[0],soy:0,rox:-0.0157474[-0.0157474],roy:-0.112243,mag:13.94,cindex:0,,elev:nan,rotang:nan,grvang:nan,r0:0,skybr:nan,windsp:nan,winddir:nan)
  • center pupil
  • failed but the stop ao
AdSecArbitrator _118190|INF| 1783|2023-04-03 10:01:59.941805| COMMANDHANDLER > FSM (status: AORunning) has received command 2015 (Stop Ao)
AdSecArbitrator_118190|INF| 1784|2023-04-03 10:01:59.941864| SERIALIZATION > StopAoImpl (): restoreShape = 1
AdSecArbitrator _118190|ERR| 1785|2023-04-03 10:02:01.461431| IDL > Command returns error : Timeout error
AdSecArbitrator _118190|INF| 1786|2023-04-03 10:02:01.619453| COMMANDHANDLER > Command execution failed: Fsm forced to Failure
AdSecArbitrator _118190|ERR| 1787|2023-04-03 10:02:01.619645| MAIN > StopAo: FATAL - Timeout error


the idl gave an error loading the file (?)

idl_ctrl_118043 |INF| 42808|2023-04-03 10:02:00.436082| MAIN > Reload last shape selected
idl_ctrl_118043 |INF| 42809|2023-04-03 10:02:01.163377| MAIN > -5001
idl_ctrl_118043 |INF| 42810|2023-04-03 10:02:01.444408| MAIN > EndCmd


  • adsecarbitrator down.
  • adsec rest/flat.
  • 10:06:57.773677| MAIN > Maximum mode index used to apply flat -> # 247
  • 0:06:57.773730| MAIN > the limiting actuator is-> # 216

  • cancel preset.
  • preset again.
  • optimize:101121
  • dimm 1.7
  • TN:_101327,_101341,_101357,_101434,_101447
  • TN+luci(10sec):_101643,_101733,_101817,_102001,_102051,_102156
  • TN+luci_ncpa:_102306,_102354,_102443,_102535,_102628,_102719,_102805
next nudge:10:50:02

03:30
  • offset background.
  • dark x2
03:35

preset bin4 bright

Mon Apr 3 10:36:32.473 2023 aos.PresetAO{FLAO}.started - PresetAO {FLAO}[277] (aomode:ACE-AO,focst:bentGregorianFront,instr:LUCIFER,wfs:FLAOWFS,sox:0[0],soy:0,rox:-0.375169[-0.375169],roy:0.509064,mag:16.47,cindex:0,,elev:nan,rotang:nan,grvang:nan,r0:0,skybr:nan,windsp:nan,winddir:na
  • wfs mag 15.7 not for B4
3:41
  • cancel preset.
  • Mon Apr 3 10:42:45.592 2023 aos.Stop{FLAO}.complete - Stop{FLAO}[280]
    Mon Apr 3 10:42:49.793 2023 aos.PresetAO{FLAO}.started - PresetAO {FLAO}[281] (aomode:ACE-AO,focst:bentGregorianFront,instr:LUCIFER,wfs:FLAOWFS,sox:0[0],soy:0,rox:0.132975[0.132975],roy:-0.0192647,mag:16.5,cindex:0,,elev:nan,rotang:nan,grvang:nan,r0:0,skybr:nan,windsp:nan,winddir:nan)
  • optimize: 104805
  • TN:_105120,_105233
  • seeing up to 2.2"
  • TN+luci(10sec):_105449(noluci),_105516,_105626,_105803,_105914,_110004,_110055,_110152,_
next nudge: 11:24:10

04:03
  • offset sky
  • dark x2
4:04
  • dimm 2.4"
  • 04:06
  • offset back to 0
  • TN+luci:_110700,_110754,_110845,_110929,_111022,_111147,_111311,_
4:15

preset

Mon Apr 3 11:15:30.976 2023 aos.PresetAO{FLAO}.started - PresetAO {FLAO}[294] (aomode:ACE-AO,focst:bentGregorianFront,instr:LUCIFER,wfs:FLAOWFS,sox:0[0],soy:0,rox:0.0914628[0.0914628],roy:-0.00505175,mag:16.7,cindex:0,,elev:nan,rotang:nan,grvang:nan,r0:0,skybr:nan,windsp:nan,winddir:nan)
  • center star first failed, second attempt ok
  • mag 16.4
  • looking for a fainter target.
  • optimize:_111947
  • TN:_112339,_112400,_112509,_
AdSecArbitrator _29322|WAR| 528|2023-04-03 11:24:08.313505| MAIN > Skip frame detected! (1.54% of frames skipped.)
AdSecArbitrator_29322|WAR| 529|2023-04-03 11:24:11.420854| MAIN > Skip frame detected! (100.00% of frames skipped.)
AdSecArbitrator_29322|WAR| 530|2023-04-03 11:24:11.421929| MAIN > Maximum skip frames reached: 100.00% of frames skipped. Will alert ICE clients.
20230304 11:24:21.2541 Alert: HighOrderOffload: HighOrderOffload vector ready
  • nudge and the loop was ok
  • next nudge:11:58:18
  • TN+luci(10sec):_112626(noluci),_112706(noluci),_112733,_112835,_112959,_113108,_113211,_113313,_113412,_113507,_113603,
4:32
  • dimm 1.4"
04:38
  • offset sky
  • dark x2
04:40
  • back to 0,0
  • TN+luci:_114052,_114154,_114253,_114501,_114614,_114714
04:48

preset.

Mon Apr 3 11:49:08.539 2023 aos.PresetAO{FLAO}.started - PresetAO {FLAO}[304] (aomode:ACE-AO,focst:bentGregorianFront,instr:LUCIFER,wfs:FLAOWFS,sox:0[0],soy:0,rox:0.0541399[0.0541399],roy:-0.0111139,mag:17.2,cindex:0,,elev:nan,rotang:nan,grvang:nan,r0:0,skybr:nan,windsp:nan,winddir:nan)
  • during the preset.
itrator_119501|INF| 4394|2023-04-03 11:49:37.767481| MAIN > Recovering camera bcu...
WfsArbitrator_119501|INF| 4395|2023-04-03 11:49:37.767587| MAIN > Turning off RESET_BCU_2K
20230304 11:49:46.6478 Alert: Error: LOST COMMUNICATION WITH SLOPE COMPUTER
WfsArbitrator_119501|ERR| 4396|2023-04-03 11:50:07.769316| MAIN > Cannot turn off RESET2K -Active Low. Reason: Timeout waiting for powerboard.R.RESET_BCU_2K.CUR - TIMEOUT_ERROR (-1000) GENERIC_SYS_ERROR
WfsArbitrator_119501|DEB| 4397|2023-04-03 11:50:07.769646| MAIN > arbFunc updateModulationInternal (, 'FLAOWFS', 'LUCIFER', 100)
WfsArbitrator_119501|INF| 4398|2023-04-03 11:50:07.769979| MAIN > Tip-tilt frequency is not synced, skipping update
WfsArbitrator_119501|DEB| 4399|2023-04-03 11:50:07.770058| MAIN > arbFunc updateModulationInternal done.
  • the ping looks not live (red)
  • click power on bcu2k
  • restart.
04:56
  • seeing 2.5"
  • center star try three times and not pick up star.
  • try again with an improvement the seeing and went ok
  • seeing 2.5"
  • optmize:_120650
  • optimize finished with a flat TT
  • skip frames.
  • set gain to 0.110modes
5:10
  • seeing 1.52-1.8
  • optimize:121018
  • optimize failed.
  • not changes.
05:15
  • power off.

-- JuanCarlosGuerra - 03 Apr 2023
Topic revision: r3 - 03 Apr 2023, JuanCarlosGuerra
This site is powered by FoswikiCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding Foswiki? Send feedback