Staff:

LBTO: Xianyu, Guido, Brandon and Juan Carlos

Observer

Summary.

Test plan:

https://docs.google.com/spreadsheets/d/14e_WOkafQHx-Dlvws3c-jXjLu7yAvflgcZ4VyHmtoio/edit#gid=0

Details.

09:37

Version to use: to-be-master for adsec and wfs

Currently running: stable (soul)
Available versions in /home/aoeng/soul:
stable
stable.20211011.pause-resume
stable.20211012
stable.20211124
stable.20221117
stable.20230201
stable.20230305
test.20220419.hk-partial-timeout
test.20220518.shark-setncpa
test.20220602.setz0-bank-a
test.20220929.hk-log-telemetry-on-sbcu-timeout
test.20221031.hk-timeout
test.20230302.offsetZ
to-be-master

check.

Usage: use_soul [version]
Currently running: to-be-master (soul)
Available versions in /home/aoeng/soul:
stable
stable.20211011.pause-resume
stable.20211012
stable.20211124
stable.20221117
stable.20230201
stable.20230305
test.20220419.hk-partial-timeout
test.20220518.shark-setncpa
test.20220602.setz0-bank-a
test.20220929.hk-log-telemetry-on-sbcu-timeout
test.20221031.hk-timeout
test.20230302.offsetZ
to-be-master

adsec power on shows status undefined.

Xianyu checking.

adsec_status_unknown.png

l_ctrl_117402 |INF| 42|2023-03-29 16:37:13.385267| MAIN > . % Tag name ACT_W_MMC is undefined for structure <Anonymous>.
idl_ctrl_117402 |INF| 42|2023-03-29 16:37:13.385267| MAIN > . % Error occurred at: INIT_ADSEC_ELEC 221
idl_ctrl_117402 |INF| 42|2023-03-29 16:37:13.385267| MAIN > . /home/aoeng/live/aoroot/idl/adsec_lib/adsec/level3/init_adsec_elec.pro
idl_ctrl_117402 |INF| 42|2023-03-29 16:37:13.385267| MAIN > . % INIT_ADSEC 258
idl_ctrl_117402 |INF| 42|2023-03-29 16:37:13.385267| MAIN > . /home/aoeng/live/aoroot/idl/adsec_lib/adsec/level3/init_adsec.pro
idl_ctrl_117402 |INF| 42|2023-03-29 16:37:13.385267| MAIN > . % $MAIN$
idl_ctrl_117402 |INF| 42|2023-03-29 16:37:13.385267| MAIN > . % Execution halted at: $MAIN$
idl_ctrl_117402 |INF| 42|2023-03-29 16:37:13.385267| MAIN > .
idl_ctrl_117402 |INF| 43|2023-03-29 16:37:13.385316| MAIN > Executing command: print, 'Error code:',errcode
idl_ctrl_117402 |INF| 44|2023-03-29 16:37:13.385345| MAIN > StartCmd
idl_ctrl_117402 |INF| 45|2023-03-29 16:37:13.385379| MAIN > EndCmd
idl_ctrl_117402 |INF| 46|2023-03-29 16:37:13.385390| MAIN > % PRINT: Variable is undefined: ERRCODE.
idl_ctrl_117402 |INF| 46|2023-03-29 16:37:13.385390| MAIN > . % Execution halted at: $MAIN$

09:46

WFS power on

OCAM OK

Found the bug in the file; elec.txt

and adsec restarted again.

Brandon will deploy the Fabios Ocam in the master for testing.

Adsec flat good.

2023-03-29 16:53:45.492389| MAIN > Maximum mode index used to apply flat -> # 639

10:00

test preset.

Wed Mar 29 17:00:36.161 2023 aos.PresetAO{FLAO}.started - PresetAO {FLAO}[598] (aomode:ACE-AO,focst:bentGregorianFront,instr:LUCIFER,wfs:FLAOWFS,sox:0[0],soy:0,rox:0[0],roy:0,mag:10,cindex:0,,elev:nan,rotang:nan,grvang:nan,r0:0,skybr:nan,windsp:nan,winddir:nan)
Wed Mar 29 17:00:36.176 2023 aos.info - WFS source set to: FLAOWFS
Wed Mar 29 17:00:37.505 2023 aos.info - FLAO: WFS: loading setup for LUCIFER

ok.

Wed Mar 29 17:05:12.635 2023 aos.PresetAO{FLAO}.started - PresetAO {FLAO}[599] (aomode:ACE-AO,focst:bentGregorianFront,instr:LUCIFER,wfs:FLAOWFS,sox:0[0],soy:0,rox:0[0],roy:0,mag:10,cindex:0,,elev:nan,rotang:nan,grvang:nan,r0:0,skybr:nan,windsp:nan,winddir:nan)
Wed Mar 29 17:05:12.654 2023 aos.info - WFS source set to: FLAOWFS
Wed Mar 29 17:05:12.695 2023 aos.info - FLAO: WARNING: added atmospheric disturbance file dist_flao2_KL_v20_atm_s1.6_L040.0_v15.0_ovfreq1700.00_sd3892.fits

optmize:20230329_171104

gopt

TN:20230329_171542,_171614,_171629,_

plan row#25

z pos 53.916

z=3mm.

TN:_172102.

TN+Luci:172402.

luci:luci1.20230329.0263, 0264

z=-3mm

ed Mar 29 17:25:49.567 2023 aos.OffsetZ{FLAO}.complete - OffsetZ {FLAO}[605]

TN:_172634

Wed Mar 29 17:29:51.289 2023 aos.OffsetZ{FLAO}.started - OffsetZ {FLAO}[606] (ofstz:15)
Wed Mar 29 17:29:51.307 2023 aos.OffsetZ{FLAO}.failed - OffsetZ {FLAO}[606] - [Exception] 'NoneType' object is not callable

Wed Mar 29 17:30:33.336 2023 aos.OffsetZ{FLAO}.started - OffsetZ {FLAO}[607] (ofstz:-15)
Wed Mar 29 17:30:33.355 2023 aos.OffsetZ{FLAO}.failed - OffsetZ {FLAO}[607] - [Exception] 'NoneType' object is not callable

AOS: OffsetZ message; threshold: >+-10mm

gain zero

disable offload.

ed Mar 29 17:37:26.052 2023 aos.OffsetZ{FLAO}.started - OffsetZ {FLAO}[608] (ofstz:-1)
Wed Mar 29 17:37:26.067 2023 aos.OffsetZ{FLAO}.failed - OffsetZ {FLAO}[608] - Illegal command for state LoopClosed

set gain 10modes.

optimize:_174414

gopt

z=-5mm

moving in 5 steps.

Wed Mar 29 17:46:33.453 2023 aos.OffsetZ{FLAO}.started - OffsetZ {FLAO}[609] (ofstz:-5)

    1. |2023-03-29 17:46:33.312971| MAIN > offsetZ(): starting offset of -1.000 mm

Wed Mar 29 17:47:27.394 2023 aos.OffsetZ{FLAO}.complete - OffsetZ {FLAO}[609]

TN:_174813,_

luci1.20230329.0265.fits

z=5mm

Wed Mar 29 17:49:42.627 2023 aos.OffsetZ{FLAO}.started - OffsetZ {FLAO}[610] (ofstz:5)

step of 1mm


Wed Mar 29 17:50:36.986 2023 aos.OffsetZ{FLAO}.complete - OffsetZ {FLAO}[610]

TN:_175115

luci1.20230329.0266.fits

10:55

z=-10

the command was not send to the AOS, not commands sent to WFS either.

Xianyu checking that maybe is the irc...

not connection to obs2-32bit machine. Calling IT.

TN+Luc:_175751

dark:luci1.20230329.0268.fits,0269,0270

TN:_180401

ncpa on

Tn:_180649

11:07

solve the issue wtht he machine

z=-10mm

Wed Mar 29 18:07:32.459 2023 aos.OffsetZ{FLAO}.started - OffsetZ {FLAO}[613] (ofstz:-10)

TN+luci:_181019

luci.273

Wed Mar 29 18:12:03.523 2023 aos.OffsetZ{FLAO}.started - OffsetZ {FLAO}[614] (ofstz:10)

Wed Mar 29 18:13:53.245 2023 aos.OffsetZ{FLAO}.complete - OffsetZ {FLAO}[614]

TN:_181433

luci.274

z=52.92

11:16

move XY

TN:_181927

11:19

loop pause

move z

stage moved.

Wed Mar 29 18:20:08.436 2023 aos.OffsetZ{FLAO}.started - OffsetZ {FLAO}[620] (ofstz:1)
Wed Mar 29 18:20:10.462 2023 aos.OffsetZ{FLAO}.complete - OffsetZ {FLAO}[620]
Wed Mar 29 18:20:59.443 2023 aos.OffsetZ{FLAO}.started - OffsetZ {FLAO}[621] (ofstz:0.5)
Wed Mar 29 18:21:01.669 2023 aos.OffsetZ{FLAO}.complete - OffsetZ {FLAO}[621]
Wed Mar 29 18:21:31.831 2023 aos.OffsetZ{FLAO}.started - OffsetZ {FLAO}[622] (ofstz:-1)
Wed Mar 29 18:21:33.953 2023 aos.OffsetZ{FLAO}.complete - OffsetZ {FLAO}[622]
Wed Mar 29 18:21:50.956 2023 aos.OffsetZ{FLAO}.started - OffsetZ {FLAO}[623] (ofstz:-0.5)
Wed Mar 29 18:21:53.282 2023 aos.OffsetZ{FLAO}.complete - OffsetZ {FLAO}[623]

Wed Mar 29 18:23:39.381 2023 aos.OffsetZ{FLAO}.started - OffsetZ {FLAO}[624] (ofstz:-1.5)
Wed Mar 29 18:23:39.398 2023 aos.OffsetZ{FLAO}.failed - OffsetZ {FLAO}[624] - Illegal command for state LoopSuspended

Wed Mar 29 18:24:29.848 2023 aos.OffsetZ{FLAO}.started - OffsetZ {FLAO}[625] (ofstz:1.5)
Wed Mar 29 18:24:29.865 2023 aos.OffsetZ{FLAO}.failed - OffsetZ {FLAO}[625] - Illegal command for state LoopSuspended

sbframe winfows for luci

darks:

0275,0276,0277

darks J (5sec)

0278,0279,0280

11:30

STOP SX

back to stable versions.

wfs_start_all

w_idle.

12:15

restart wit DX.

version change for adsec and WFS

[AOeng@dxadsec ~]$ use_soul
Usage: use_soul [version]
Currently running: to-be-master (soul)
Available versions in /home/aoeng/soul:
dev-mmc_with_freeze
mixed_mode_control.20221028
mixed_mode_control.20230124
mixed_mode_control.20230201
stable
stable.20211124
stable.20230305
stable.old
test.20220829.restart
to-be-master
[AOeng@dxadsec ~]$

adsec flat.

19:30:04.283014| MAIN > Maximum mode index used to apply flat -> # 623

WFS power on.

CCD47 not live.

cycle the bcu doing a change of bin.

test preset.

Wed Mar 29 19:46:33.434 2023 aos.PresetAO{FLAO}.started - PresetAO {FLAO}[139] (aomode:ACE-AO,focst:bentGregorianFront,instr:LUCIFER,wfs:FLAOWFS,sox:0[0],soy:0,rox:0[0],roy:0,mag:10,cindex:0,,elev:nan,rotang:nan,grvang:nan,r0:0,skybr:nan,windsp:nan,winddir:nan)
Wed Mar 29 19:46:33.453 2023 aos.info - WFS source set to: FLAOWFS
Wed Mar 29 19:46:33.547 2023 aos.info - FLAO: WARNING: added atmospheric disturbance file dist_flao2_KL_v20_atm_s1.6_L040.0_v15.0_ovfreq1700.00_sd3892.fits

ocam not live when the loop closed.

power cycle bcu2k

restart master from WFS.

Wed Mar 29 19:46:33.434 2023 aos.PresetAO{FLAO}.started - PresetAO {FLAO}[139] (aomode:ACE-AO,focst:bentGregorianFront,instr:LUCIFER,wfs:FLAOWFS,sox:0[0],soy:0,rox:0[0],roy:0,mag:10,cindex:0,,elev:nan,rotang:nan,grvang:nan,r0:0,skybr:nan,windsp:nan,winddir:nan)
Wed Mar 29 19:46:33.453 2023 aos.info - WFS source set to: FLAOWFS
Wed Mar 29 19:46:33.547 2023 aos.info - FLAO: WARNING: added atmospheric disturbance file dist_flao2_KL_v20_atm_s1.6_L040.0_v15.0_ovfreq1700.00_sd3892.fits

ocam not live during the center pupil.

power off.

master adsec:

MasterDiagnostic _102818|ERR| 602|2023-03-29 19:59:19.464881ADAPTIVE-SECONDARY > > FRAME BCU_MIRROR_1 HEADER bytes: 0 41c0 e37d6
MasterDiagnostic_102818|ERR| 602|2023-03-29 19:59:19.464881ADAPTIVE-SECONDARY > .
MasterDiagnostic_102818|ERR| 603|2023-03-29 19:59:19.464895ADAPTIVE-SECONDARY > Detected a wrong filotto (BcuMirror _2 frame header don't match BcuMirror _3 header) !!!
MasterDiagnostic_102818|WAR| 604|2023-03-29 19:59:19.464906ADAPTIVE-SECONDARY > Wrong filotto. Frame skipped.
MasterDiagnostic_102818|ERR| 605|2023-03-29 19:59:19.465456ADAPTIVE-SECONDARY > > FRAME BCU_MIRROR_2 HEADER bytes: 0 0 0
MasterDiagnostic_102818|ERR| 605|2023-03-29 19:59:19.465456ADAPTIVE-SECONDARY > .
MasterDiagnostic_102818|ERR| 606|2023-03-29 19:59:19.465476ADAPTIVE-SECONDARY > > FRAME BCU_MIRROR_1 HEADER bytes: 0 41c0 e37d7
MasterDiagnostic_102818|ERR| 606|2023-03-29 19:59:19.465476ADAPTIVE-SECONDARY > .
MasterDiagnostic_102818|ERR| 607|2023-03-29 19:59:19.465490ADAPTIVE-SECONDARY > Detected a wrong filotto (BcuMirror _2 frame header don't match BcuMirror _3 header) !!!
MasterDiagnostic_102818|WAR| 608|2023-03-29 19:59:19.465501ADAPTIVE-SECONDARY > Wrong filotto. Frame skipped.

power cycle WFS.


Wed Mar 29 20:20:49.932 2023 aos.PresetAO{FLAO}.started - PresetAO {FLAO}[143] (aomode:ACE-AO,focst:bentGregorianFront,instr:LUCIFER,wfs:FLAOWFS,sox:0[0],soy:0,rox:0[0],roy:0,mag:10,cindex:0,,elev:nan,rotang:nan,grvang:nan,r0:0,skybr:nan,windsp:nan,winddir:nan)
Wed Mar 29 20:20:49.955 2023 aos.info - WFS source set to: FLAOWFS
Wed Mar 29 20:20:50.009 2023 aos.info - FLAO: WARNING: added atmospheric disturbance file dist_flao2_KL_v20_atm_s1.6_L040.0_v15.0_ovfreq1700.00_sd3892.fits
Wed Mar 29 20:20:50.573 2023 aos.info - FLAO: WFS: loading setup for LUCIFER


Wed Mar 29 20:20:49.932 2023 aos.PresetAO{FLAO}.started - PresetAO {FLAO}[143] (aomode:ACE-AO,focst:bentGregorianFront,instr:LUCIFER,wfs:FLAOWFS,sox:0[0],soy:0,rox:0[0],roy:0,mag:10,cindex:0,,elev:nan,rotang:nan,grvang:nan,r0:0,skybr:nan,windsp:nan,winddir:nan)
Wed Mar 29 20:20:49.955 2023 aos.info - WFS source set to: FLAOWFS
Wed Mar 29 20:20:50.009 2023 aos.info - FLAO: WARNING: added atmospheric disturbance file dist_flao2_KL_v20_atm_s1.6_L040.0_v15.0_ovfreq1700.00_sd3892.fits
Wed Mar 29 20:20:50.573 2023 aos.info - FLAO: WFS: loading setup for LUCIFER

ocam not live durungthe center pupil close loop

1:28

power off/on adscec.


Wed Mar 29 20:28:35.975 2023 aos.AdsecOn.started - AdsecOn [148]
Wed Mar 29 20:28:35.993 2023 aos.info - FLAO: Adsec 672a-right power on started.
Wed Mar 29 20:28:53.712 2023 aos.info - FLAO: Adsec 672a-right reset started.
Wed Mar 29 20:29:31.615 2023 aos.info - FLAO: Adsec 672a-right reset done.
Wed Mar 29 20:29:31.636 2023 aos.info - FLAO: Adsec 672a-right power on done.
Wed Mar 29 20:29:31.657 2023 aos.info - FLAO: Adsec 672a-right uploading DSP code.

20:31:00.811432| MAIN > Maximum mode index used to apply flat -> # 623

Wed Mar 29 20:30:58.196 2023 aos.info - Doing PresetFlat (LUCIFER)
Wed Mar 29 20:31:48.360 2023 aos.PresetAO{FLAO}.started - PresetAO {FLAO}[150] (aomode:ACE-AO,focst:bentGregorianFront,instr:LUCIFER,wfs:FLAOWFS,sox:0[0],soy:0,rox:0[0],roy:0,mag:10,cindex:0,,elev:nan,rotang:nan,grvang:nan,r0:0,skybr:nan,windsp:nan,winddir:nan)
Wed Mar 29 20:31:48.377 2023 aos.info - WFS source set to: FLAOWFS
Wed Mar 29 20:31:48.410 2023 aos.info - FLAO: WARNING: added atmospheric disturbance file dist_flao2_KL_v20_atm_s1.6_L040.0_v15.0_ovfreq1700.00_sd3892.fits
Wed Mar 29 20:31:48.830 2023 aos.info - FLAO: WFS: loading setup for LUCIFER

cancel.

Wed Mar 29 20:30:58.196 2023 aos.info - Doing PresetFlat (LUCIFER)
Wed Mar 29 20:31:48.360 2023 aos.PresetAO{FLAO}.started - PresetAO {FLAO}[150] (aomode:ACE-AO,focst:bentGregorianFront,instr:LUCIFER,wfs:FLAOWFS,sox:0[0],soy:0,rox:0[0],roy:0,mag:10,cindex:0,,elev:nan,rotang:nan,grvang:nan,r0:0,skybr:nan,windsp:nan,winddir:nan)
Wed Mar 29 20:31:48.377 2023 aos.info - WFS source set to: FLAOWFS
Wed Mar 29 20:31:48.410 2023 aos.info - FLAO: WARNING: added atmospheric disturbance file dist_flao2_KL_v20_atm_s1.6_L040.0_v15.0_ovfreq1700.00_sd3892.fits
Wed Mar 29 20:31:48.830 2023 aos.info - FLAO: WFS: loading setup for LUCIFER

close loop.

skipping frame with gain LNgain

TN:_204030

gain zero disturbance running and still skip frames.

disable sync

load a lower disturbance.

Wed Mar 29 20:30:58.196 2023 aos.info - Doing PresetFlat (LUCIFER)
Wed Mar 29 20:31:48.360 2023 aos.PresetAO{FLAO}.started - PresetAO {FLAO}[150] (aomode:ACE-AO,focst:bentGregorianFront,instr:LUCIFER,wfs:FLAOWFS,sox:0[0],soy:0,rox:0[0],roy:0,mag:10,cindex:0,,elev:nan,rotang:nan,grvang:nan,r0:0,skybr:nan,windsp:nan,winddir:nan)
Wed Mar 29 20:31:48.377 2023 aos.info - WFS source set to: FLAOWFS
Wed Mar 29 20:31:48.410 2023 aos.info - FLAO: WARNING: added atmospheric disturbance file dist_flao2_KL_v20_atm_s1.6_L040.0_v15.0_ovfreq1700.00_sd3892.fits
Wed Mar 29 20:31:48.830 2023 aos.info - FLAO: WFS: loading setup for LUCIFER

optimize:_204949

gopt

TN:_205221,_205235

TN+luci:_205303

1:54

offsetZ

Wed Mar 29 20:55:22.584 2023 aos.OffsetZ{FLAO}.started - OffsetZ {FLAO}[159] (ofstz:15)
Wed Mar 29 20:55:22.602 2023 aos.OffsetZ{FLAO}.failed - OffsetZ {FLAO}[159] - [Exception] 'NoneType' object is not callable
Wed Mar 29 20:55:45.388 2023 aos.OffsetZ{FLAO}.started - OffsetZ {FLAO}[160] (ofstz:-15)
Wed Mar 29 20:55:45.405 2023 aos.OffsetZ{FLAO}.failed - OffsetZ {FLAO}[160] - [Exception] 'NoneType' object is not callable
Wed Mar 29 20:55:49.422 2023 aos.info - TTF offload: previous 2 requests ignored
Wed Mar 29 20:55:49.439 2023 aos.info - TTF Offload request (FLAO) Z: 0.0301153 -0.0184094 -0.000194578
Wed Mar 29 20:55:52.033 2023 aos.info - TTF offload command end

z=-10

moving by step 1mm

Wed Mar 29 20:56:07.228 2023 aos.OffsetZ{FLAO}.started - OffsetZ {FLAO}[161] (ofstz:-10)

Wed Mar 29 20:58:00.451 2023 aos.OffsetZ{FLAO}.complete - OffsetZ {FLAO}[161]

TN:_205824,_205929

TN+lci(5sec):_210117

z+10

Wed Mar 29 21:04:08.082 2023 aos.info - TTF offload command end
Wed Mar 29 21:04:19.088 2023 aos.OffsetZ{FLAO}.started - OffsetZ {FLAO}[162] (ofstz:10)
Wed Mar 29 21:04:21.238 2023 aos.info - TTF Offload request (FLAO) Z: 0.016792 0.00338252 0.000748933
Wed Mar 29 21:04:23.598 2023 aos.info - TTF offload command end
Wed Mar 29 21:04:24.485 2023 aos.info - TTF offload: previous 2 requests ignored
Wed Mar 29 21:04:24.505 2023 aos.info - TTF Offload request (FLAO) Z: 0.0619431 -0.0604706 0.000708959
Wed Mar 29 21:04:27.106 2023 aos.info - TTF offload command end

Tn+luci:_211223

2:15

moveXY

0.3,-0.3

TN+Luci:_211538\luci2:

luci2:.0008

Wed Mar 29 21:22:07.591 2023 aos.OffsetXY{FLAO}.started - OffsetXY {FLAO}[164] (ofsx:0.3[0.3],ofsy:0.3)

TN+luci:_212230

luci2:.0009

2:30

loop pause

Wed Mar 29 21:29:33.820 2023 aos.Pause{FLAO}.complete - Pause{FLAO}[149]
Wed Mar 29 21:29:58.294 2023 aos.OffsetZ{FLAO}.started - OffsetZ {FLAO}[166] (ofstz:1)
Wed Mar 29 21:29:59.914 2023 aos.OffsetZ{FLAO}.complete - OffsetZ {FLAO}[166]
Wed Mar 29 21:30:20.243 2023 aos.OffsetZ{FLAO}.started - OffsetZ {FLAO}[167] (ofstz:-1)
Wed Mar 29 21:30:22.163 2023 aos.OffsetZ{FLAO}.complete - OffsetZ {FLAO}[167]
Wed Mar 29 21:30:39.891 2023 aos.OffsetZ{FLAO}.started - OffsetZ {FLAO}[168] (ofstz:-1.5)
Wed Mar 29 21:30:39.907 2023 aos.OffsetZ{FLAO}.failed - OffsetZ {FLAO}[168] - Illegal command for state LoopSuspended

Wed Mar 29 21:31:10.180 2023 aos.OffsetZ{FLAO}.started - OffsetZ {FLAO}[169] (ofstz:1.5)
Wed Mar 29 21:31:10.200 2023 aos.OffsetZ{FLAO}.failed - OffsetZ {FLAO}[169] - Illegal command for state LoopSuspended

stop AO

luci darks.

luci2.20230330.0009.fits,0010

2:47

Stop

version back to stable.

- JuanCarlosGuerra - 29 Mar 2023
Topic revision: r1 - 29 Mar 2023, JuanCarlosGuerra
This site is powered by FoswikiCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding Foswiki? Send feedback