Staff.

Lbto: Juan Carlos, Brandon.

Summary.

Details.

Starting at 1:00PM.

Change to latest environment.

Set flat OK

WFS power on

fsArbitrator_166466|INF| 58|2022-02-16 20:21:42.714657| MAIN > Cannot turn on INS_TEST_OUT_3. Reason: Timeout waiting for powerboard.L.INS_TEST_OUT_3.CUR - TIMEOUT_ERROR - GENERIC_SYS_ERROR
WfsArbitrator_166466|ERR| 59|2022-02-16 20:21:42.714758| MAIN > Exception: Cannot turn on INS_TEST_OUT_3. Reason: Timeout waiting for powerboard.L.INS_TEST_OUT_3.CUR - TIMEOUT_ERROR
WfsArbitrator_166466|ERR| 60|2022-02-16 20:21:42.714810| MAIN > Cannot turn on INS_TEST_OUT_3. Reason: Timeout waiting for powerboard.L.INS_TEST_OUT_3.CUR - TIMEOUT_ERROR (-1000) GENERIC_SYS_ERR

Second operate.

power on ok.

frames saved: 20220216_202845

Activate the disturbance with 1" seeing.

SW tests.

New environemnt.

Flao GUi with the option Skip frame Alert !

Wed Feb 16 20:30:47.122 2022 aos.PresetAO{FLAO}.started - PresetAO{FLAO}[1353] (aomode:ACE-AO,focst:bentGregorianFront,instr:LUCIFER,wfs:FLAOWFS,sox:0[0],soy:0,rox:0[0],roy:0,mag:11,cindex:0,,elev:nan,rotang:nan,grvang:nan,r0:0,skybr:nan,windsp:nan,winddir:nan)

No star, the hexapod was in another position.

AO,focst:bentGregorianFront,instr:LUCIFER,wfs:FLAOWFS,sox:0[0],soy:0,rox:0[0],roy:0,mag:11,cindex:0,,elev:nan,rotang:nan,grvang:nan,r0:0,skybr:nan,windsp:nan,winddir:nan)
Wed Feb 16 20:34:57.024 2022 aos.info - WFS source set to: FLAOWFS

2-16 20:36:31.448297| MAIN > arbFunc doCenterPupils (, 'FLAOWFS', 'LUCIFER')
WfsArbitrator_166466|ERR| 283|2022-02-16 20:36:31.449264| MAIN > RETRY: Camera lens temperature too low. T=-0.18, minimum allowed is 7.00 (0) NO_ERROR.

* Discussing to add a feature in the AOs to warn when temperature out of range and the log in the AOS and it can be visualize from the AOS... Make an IT.

Wed Feb 16 20:55:13.331 2022 aos.PresetAO{FLAO}.started - PresetAO{FLAO}[1357] (aomode:ACE-AO,focst:bentGregorianFront,instr:LUCIFER,wfs:FLAOWFS,sox:0[0],soy:0,rox:0[0],roy:0,mag:11,cindex:0,,elev:nan,rotang:nan,grvang:nan,r0:0,skybr:nan,windsp:nan,winddir:nan)

B| 349|2022-02-16 20:56:34.347692| MAIN > arbFunc doCenterPupils (, 'FLAOWFS', 'LUCIFER')
WfsArbitrator_166466|ERR| 350|2022-02-16 20:56:34.348632| MAIN > RETRY: Camera lens temperature too low. T= 4.90, minimum allowed is 7.00 (0) NO_ERROR

restart wfs arbitrator to check if the disturbance is loaded.

No loaded.

Wed Feb 16 21:06:47.518 2022 aos.PresetAO{FLAO}.started - PresetAO{FLAO}[1366] (aomode:ACE-AO,focst:bentGregorianFront,instr:LUCIFER,wfs:FLAOWFS,sox:0[0],soy:0,rox:0[0],roy:0,mag:11,cindex:0,,elev:nan,rotang:nan,grvang:nan,r0:0,skybr:nan,windsp:nan,winddir:nan)

center pupil ok.

close loop.

optimize

gopt.

skip frames continous..

button open the loop, preset running floa option ios to reclose.

no star in the PyWFS.

CCD47 image is defocused and at one side.

Looking at th e PSF gui-> zocus +0.264

the offload continous to work...

idl_135371 |INF| 1509|2022-02-16 21:12:30.158586| MAIN > Cleaned last slopes command.
idl_135371 |INF| 1510|2022-02-16 21:12:30.158664| MAIN > Modes out of safe range ID: # -1
idl_135371 |INF| 1511|2022-02-16 21:12:30.158707| MAIN > Commands out of safe range ID: #113
idl_135371 |INF| 1512|2022-02-16 21:12:30.158819| MAIN > Forces out of safe range ID: # 0 # 1 # 2 # 3 # 4 # 5 # 6 # 7 # 8 # 9 # 10 # 11 # 12 # 13 # 14 # 15 # 16 # 17 # 18 # 19 # 20 # 21 # 22 # 23 # 24 # 25 # 26 # 27 # 28 # 29 # 30 # 31 # 32 # 33 # 34 # 35 # 36 # 37 # 38 # 39 # 40 # 41 # 42 # 43 # 44 # 45 # 46 # 47 # 48 # 49 # 50 # 51 # 52 # 53 # 54 # 55 # 56 # 57 # 58 # 59 # 60 # 61 # 62 # 63 # 64 # 65 # 66 # 67 # 68 # 69 # 70 # 71 # 72 # 73 # 74 # 75 # 76 # 77 # 78 # 79 # 80 # 81 # 82 # 83 # 84 # 85 # 86 # 87 # 88 # 89 # 90 # 91 # 92 # 93 # 94 # 95 # 96 # 97 # 98 # 99 #100 #101 #102 #103 #104 #105 #106 #107 #108 #109 #110 #111 #112 #113 #114 #115 #116 #117 #118 #119 #120 #121 #122 #123 #124 #125 #126 #127 #128 #129 #130 #131 #132 #133 #134 #135 #136 #137 #138 #139 #140 #141 #142 #143 #144 #145 #146 #147 #148 #149 #150 #151 #152 #153 #154 #155 #156 #157 #158 #159 #160 #161 #162 #163 #164 #165 #166 #167
idl_135371 |INF| 1513|2022-02-16 21:12:30.158862| MAIN > SafeSkipFrames caused by commands out of range detected.
idl_135371 |INF| 1514|2022-02-16 21:12:30.158880| MAIN > SafeS

bad shape in the ocam.

bad_ocam_frames_20220216.png

CANCEL PRESET.

NEW PRESET.

AdSecArbitrator_135490|INF| 466|2022-02-16 21:12:29.816239| COMMANDHANDLER > FSM (status: AORunning) has received command 2015 (Stop Ao)
AdSecArbitrator_135490|INF| 467|2022-02-16 21:12:29.816269| SERIALIZATION > StopAoImpl(): restoreShape = 1
idl_135371 |INF| 1506|2022-02-16 21:12:29.816682| MAIN > fsm_stop_ao start
idl_135371 |INF| 1507|2022-02-16 21:12:29.816752| MAIN > fsm_skip_recovery

Wed Feb 16 21:20:58.897 2022 aos.PresetAO{FLAO}.started - PresetAO{FLAO}[1368] (aomode:ACE-AO,focst:bentGregorianFront,instr:LUCIFER,wfs:FLAOWFS,sox:0[0],soy:0,rox:0[0],roy:0,mag:11,cindex:0,,elev:nan,rotang:nan,grvang:nan,r0:0,skybr:nan,windsp:nan,winddir:nan)

PUPIL:20211201_210322

CHECK OCAM VIEWER:

TN:_212545

RESTART BCU2K

Wed Feb 16 21:28:22.802 2022 aos.PresetAO{FLAO}.started - PresetAO{FLAO}[1370] (aomode:ACE-AO,focst:bentGregorianFront,instr:LUCIFER,wfs:FLAOWFS,sox:0[0],soy:0,rox:0[0],roy:0,mag:11,cindex:0,,elev:nan,rotang:nan,grvang:nan,r0:0,skybr:nan,windsp:nan,winddir:nan)


2022-02-16 21:32:41.463688| -13006 - [AOException] OptimizeGain: FATAL - Safe skip active - cannot proceed (-10045) IDL_SAFE_SKIP_ACTIVE

SKIPPING 100%.

LOOP CLOSED.

TEST BUTTON

OK.

OPEN LOOP.

OPTION RECLOSE

OK.

OPTIMIZE

FAILED

LOOP BACK TO LN GAIN.

OPEN LOOP

SAVE OCAM FRAMES: _213751.

RECONFIGURE OCAM 2X2.

LOG OF SLKIP FRAMES LOGGED OK.

POWER CYCLE BCU2K.

RECONFIGURE.

CANCEL PRESET.

Wed Feb 16 21:44:18.117 2022 aos.PresetAO{FLAO}.started - PresetAO{FLAO}[1372] (aomode:ACE-AO,focst:bentGregorianFront,instr:LUCIFER,wfs:FLAOWFS,sox:0[0],soy:0,rox:0[0],roy:0,mag:11,cindex:0,,elev:nan,rotang:nan,grvang:nan,r0:0,skybr:nan,windsp:nan,winddir:nan)

2022-02-16 21:45:23.787470| Command canceled
2022-02-16 21:52:18.157455| -13006 - [AOException] OptimizeGain: FATAL - Safe skip active - cannot proceed (-10045) IDL_SAFE_SKIP_ACTIVE

TEST BUTTON WHEN LOOP CLOSED AFTER SKIP FRAME.

restart wfs processes.

ed Feb 16 22:03:21.873 2022 aos.PresetAO{FLAO}.started - PresetAO{FLAO}[1377] (aomode:ACE-AO,focst:bentGregorianFront,instr:LUCIFER,wfs:FLAOWFS,sox:0[0],soy:0,rox:0[0],roy:0,mag:11,cindex:0,,elev:nan,rotang:nan,grvang:nan,r0:0,skybr:nan,windsp:nan,winddir:nan)
Wed Feb 16 22:0

flat Adsec.

idl_135371 |INF| 2246|2022-02-16 22:06:27.876671| MAIN > Maximum mode index used to apply flat -> # 637

....

Wed Feb 16 22:07:17.292 2022 aos.PresetAO{FLAO}.started - PresetAO{FLAO}[1379] (aomode:ACE-AO,focst:bentGregorianFront,instr:LUCIFER,wfs:FLAOWFS,sox:0[0],soy:0,rox:0[0],roy:0,mag:11,cindex:0,,elev:nan,rotang:nan,grvang:nan,r0:0,skybr:nan,windsp:nan,winddir:nan)

Still see extra noise in the ocam.

3:15 PM powr off WFS

Bin1 close loop test different rotation angle, w/o NCPA.

Bin1 ESM fake bin2 mag=12.51

Wed Feb 16 21:01:16.888 2022 aos.PresetAO{FLAO}.started - PresetAO{FLAO}[1361] (aomode:TTM-AO,focst:bentGregorianFront,instr:LUCIFER,wfs:FLAOWFS,sox:0[0],soy:0,rox:0[0],roy:0,mag:12.51,cindex:0,,elev:nan,rotang:nan,grvang:nan,r0:0,skybr:nan,windsp:nan,winddir:nan)

Wed Feb 16 21:02:46.213 2022 aos.PresetAO{FLAO}.complete - PresetAO{FLAO}[1361] - dx:nan dy:nan slNull: f1:0.0 f2:1.0 freq:400 mag:0 nBins:2 nModes:12 r0:nan snMode:0 strehl:0 ttMod:0

OK

Wed Feb 16 21:03:19.621 2022 aos.PresetAO{FLAO}.started - PresetAO{FLAO}[1363] (aomode:TTM-AO,focst:bentGregorianFront,instr:LUCIFER,wfs:FLAOWFS,sox:0[0],soy:0,rox:0[0],roy:0,mag:12.5,cindex:0,,elev:nan,rotang:nan,grvang:nan,r0:0,skybr:nan,windsp:nan,winddir:nan)

Wed Feb 16 21:03:19.621 2022 aos.PresetAO{FLAO}.started - PresetAO{FLAO}[1363] (aomode:TTM-AO,focst:bentGregorianFront,instr:LUCIFER,wfs:FLAOWFS,sox:0[0],soy:0,rox:0[0],roy:0,mag:12.5,cindex:0,,elev:nan,rotang:nan,grvang:nan,r0:0,skybr:nan,windsp:nan,winddir:nan)

Wed Feb 16 21:04:18.073 2022 aos.PresetAO{FLAO}.started - PresetAO{FLAO}[1365] (aomode:TTM-AO,focst:bentGregorianFront,instr:LUCIFER,wfs:FLAOWFS,sox:0[0],soy:0,rox:0[0],roy:0,mag:12.49,cindex:0,,elev:nan,rotang:nan,grvang:nan,r0:0,skybr:nan,windsp:nan,winddir:nan)

Wed Feb 16 21:05:23.212 2022 aos.PresetAO{FLAO}.complete - PresetAO{FLAO}[1365] - dx:nan dy:nan slNull: f1:0.0 f2:1.0 freq:400 mag:0 nBins:1 nModes:12 r0:nan snMode:0 strehl:0 ttMod:0

3:37 PM Revert to stable environment.

test flat

ok 637 modes.

ocam frames good.

Wed Feb 16 22:47:41.905 2022 aos.PresetAO{FLAO}.started - PresetAO{FLAO}[1381] (aomode:ACE-AO,focst:bentGregorianFront,instr:LUCIFER,wfs:FLAOWFS,sox:0[0],soy:0,rox:0[0],roy:0,mag:11,cindex:0,,elev:nan,rotang:nan,grvang:nan,r0:0,skybr:nan,windsp:nan,winddir:nan)
Wed Feb 16 22:47:41.919 2022 aos.info - WFS source set to: FLAOWFS

Still skipping.

New preset.

Wed Feb 16 23:18:41.210 2022 aos.PresetAO{FLAO}.started - PresetAO{FLAO}[1383] (aomode:ACE-AO,focst:bentGregorianFront,instr:LUCIFER,wfs:FLAOWFS,sox:0[0],soy:0,rox:0[0],roy:0,mag:11,cindex:0,,elev:nan,rotang:nan,grvang:nan,r0:0,skybr:nan,windsp:nan,winddir:nan)

optimize gain_20220216.png

close good.

reset 12.5

Wed Feb 16 23:24:11.518 2022 aos.PresetAO{FLAO}.started - PresetAO{FLAO}[1387] (aomode:ACE-AO,focst:bentGregorianFront,instr:LUCIFER,wfs:FLAOWFS,sox:0[0],soy:0,rox:0[0],roy:0,mag:12.5,cindex:0,,elev:nan,rotang:nan,grvang:nan,r0:0,skybr:nan,windsp:nan,winddir:nan)

rec:20191213_000000

adsec failure.

power bump

AdSecArbitrator_71830|INF| 364|2022-02-16 23:27:11.418690| COMMANDHANDLER > Command execution failed: Fsm forced to Failure
AdSecArbitrator_71830|ERR| 365|2022-02-16 23:27:11.418810| MAIN > LoadDisturbTag: FATAL - Generic communication error (nobody replying or timeout)
AdSecArbitrator_71830|ERR| 366|2022-02-16 23:28:16.032710| ALERTHANDLER > Received an ERROR alert! Forcing Failure state.
AdSecArbitrator_71830|ERR| 367|2022-02-16 23:28:16.032770| ALERTHANDLER > Alert message: COILS DISABLED from fastdiagn.L
20221602 23:28:16.0334 Alert: Error: COILS DISABLED

restart MOXA watchdog
Traceback (most recent call last):
File "/home/aoeng/live/aoroot/bin/adsc_start", line 256, in <module>
if name == '__main__': main()
File "/home/aoeng/live/aoroot/bin/adsc_start", line 201, in main
send_to_MOXA(str_ip)
File "/home/aoeng/live/aoroot/bin/adsc_start", line 238, in send_to_MOXA
c.perform()
pycurl.error: (7, "couldn't connect to host")

ping adamsx

ping adamsx

[AOeng@sxadsec source]$ ping adamsx
PING adamsx (192.168.13.150) 56(84) bytes of data.
From adsecsx-private (192.168.13.13) icmp_seq=3 Destination Host Unreachable

AdSecArbitrator_71830|INF| 368|2022-02-16 23:28:16.092433| ALERTHANDLER > Received from masterdiagnostic.L a DumpSaved alert with filename /local/aolog/2022/02/16/ADAPTIVE-SECONDARY_00001645054096_20220216_232816.bin
AdSecArbitrator_71830|INF| 369|2022-02-16 23:28:16.092460| ALERTHANDLER > Processdump is skipped
20221602 23:28:16.0931 Alert: DumpSaved: DumpSaved vector ready

Guido and Xianyu connected to zoom.

[AOeng@sxadsec AdOpt]$ ping adamsx
PING adamsx (192.168.13.150) 56(84) bytes of data.
64 bytes from adamsx (192.168.13.150): icmp_seq=1 ttl=255 time=1.96 ms
64 bytes from adamsx (192.168.13.150): icmp_seq=2 ttl=255 time=3.30 ms
64 bytes from adamsx (192.168.13.150): icmp_seq=3 ttl=255 time=2.10 ms

adsceng &

Checking the housekeeper log...

system power off and TSS disabled.

[AOeng@sxadsec AdOpt]$ ping adamsx
PING adamsx (192.168.13.150) 56(84) bytes of data.
64 bytes from adamsx (192.168.13.150): icmp_seq=1 ttl=255 time=1.96 ms
64 bytes from adamsx (192.168.13.150): icmp_seq=2 ttl=255 time=3.30 ms
64 bytes from adamsx (192.168.13.150): icmp_seq=3 ttl=255 time=2.10 ms

Argos cal unit light source not connected.

WFS software restarted.

still recovery the telescope.

5:40 PM stop testing..

-- JuanCarlosGuerra - 16 Feb 2022
Topic revision: r2 - 17 Feb 2022, JuanCarlosGuerra
This site is powered by FoswikiCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding Foswiki? Send feedback