Summary.

Close loop withg disturbance for both Soul-LuciWFS. Power bump and tume to recover limited the time of close loop. Close loop without lucis and disturbance showed that both system are working fine.

Argos cal units controllers were recovered after the power bump.

Details.

Power on SX/DX.

SX Ocam two bad quadrants.

20240104_191719

20240104 19:19:41 mean: [189.58713055555555, 192.26473333333328, 190.7335833333334, 187.83883055555555, 187.82643055555553, 190.53901666666661, 184.52198333333337, 186.61864166666663]
20240104 19:19:41 rms: [56.733212401915843, 65.045505350649634, 63.49226437681962, 52.282276549191394, 52.106995906270392, 63.540645332706951, 67.167881569986633, 49.967697734969207]
20240104 19:19:41 std: [4.17617950848354, 4.5687106857208031, 74.932062806174869, 3.4614101214663906, 3.2295925694681342, 68.127042724330963, 3.8685645128004711, 2.755849615898287]
20240104 19:19:43 mean: [189.63196111111117, 192.3227722222222, 190.51678055555553, 187.90325555555563, 187.89322222222222, 190.44129444444442, 184.58346111111115, 186.64353333333341]
20240104 19:19:43 rms: [56.870489552405587, 65.211765449199532, 63.098216009709816, 52.174416156399253, 52.053654214995575, 62.969084504524481, 66.622441274448562, 49.921684251690785]
20240104 19:19:43 std: [4.1809928270015284, 4.56665788111028, 60.789153422087786, 3.1812915935655899, 3.0743550773432418, 69.439017195841458, 3.8702982655506846, 2.7702340021857226]
20240104 19:19:46 mean: [189.71578888888894, 192.37494444444451, 190.06785000000002, 187.91027777777776, 188.09574444444445, 190.44776388888891, 184.66786944444445, 186.74841388888888]
20240104 19:19:46 rms: [57.152408669419991, 65.37292550818519, 62.095817306344379, 51.8085989830291, 52.183661510358306, 62.714056251450778, 65.903908396828484, 50.077193621381731]
20240104 19:19:46 std: [4.1818770588257026, 4.5782148201055222, 73.236033294889452, 2.7296117723662725, 2.6911591566916901, 53.034967706300222, 3.8811243094095369, 2.7858285283516251]

0240104 19:20:20 mean: [190.17174444444444, 192.76986944444442, 197.29893888888887, 188.31227777777787, 188.32714166666668, 196.61096666666666, 185.14553611111111, 187.19183055555561]
20240104 19:20:20 rms: [58.596458731922624, 66.52186878383371, 64.506666709635752, 54.937191355329766, 54.959887646616309, 64.479070129843777, 63.543713445743158, 50.544080012043338]
20240104 19:20:20 std: [4.2055622189339292, 4.6093243545575664, 171.08371540562052, 4.842752016036493, 4.8120775406825747, 160.52340210336158, 3.9111986652199779, 2.8083291764269518]
20240104 19:20:23 mean: [190.1686861111111, 192.76538055555557, 195.46462222222229, 188.33295555555563, 188.3141055555555, 195.25659722222227, 185.15270833333332, 187.18966111111109]
20240104 19:20:23 rms: [58.592240299935632, 66.50842347807999, 64.451846518267658, 54.992053589344408, 54.916897392480053, 64.292655860323109, 63.353196221524442, 50.628967192717035]
20240104 19:20:23 std: [4.2123298019149367, 4.6143143814436067, 147.59505921436576, 4.8480530188963549, 4.7916853558603369, 146.03051540941425, 3.9114562835104549, 2.8306624428671761]

"flame" not too large.

20240104 19:26:23 rms: [68.404712160726746, 74.327014278239403, 67.411442968095287, 64.290005056226562, 64.212118591913438, 67.095038048379223, 57.097929801477115, 61.731110910763384]
20240104 19:26:23 std: [4.511481993383252, 4.8146640767203088, 19.019304897812376, 3.5512157287247161, 3.3719714161570642, 16.768033506388008, 3.7099745781509896, 3.2340464981790609]

TN_192734

Easy to catch those types using the STdev.

The bad frame task to be improved to catch this type of errors.

DX Ocam OK

12:15

Pwer bump.

Xianyu recovering the Adsecs.

Power cycle BCU2K
  • Come not live.
  • OPTLOOP share memory error,
  • Thge AdsecSX still power off.
Setting the ocam in ambient.

email from TIM that we don;t have chiller running.

Adsec still power off.

retract the Argos swing arms untill the chiller recovered and restore operations.

12:43

Chiller back

power cycle bcu2k

type of error:

SlopeCompCtrl2K _110690|ERR| 1579|2024-01-04 19:49:41.197064| MAIN > Lost communication with slope computer!
SlopeCompCtrl2K_110690|INF| 1580|2024-01-04 19:49:41.197487| MAIN > Alert to WFS Arbitrator succesfully sent! [SlopeCompCtrl2K.cpp:384]
SlopeCompCtrl2K_110690|WAR| 1581|2024-01-04 19:49:42.197861| MAIN > Error in BCU command, retrying....
SlopeCompCtrl2K_110690|WAR| 1582|2024-01-04 19:49:43.198103| MAIN > Error in BCU command, retrying....
SlopeCompCtrl2K_110690|ERR| 1583|2024-01-04 19:49:44.198438| MAIN > Error in TestComm (): [AOException] Timeout error in sendMultiBcuCommand() (code -5001) Timeout error File bcucommand.cpp line 164
SlopeCompCtrl2K_110690|WAR| 1584|2024-01-04 19:49:46.198933| MAIN > Error in BCU command, retrying....
SlopeCompCtrl2K_110690|WAR| 1585|2024-01-04 19:49:47.199180| MAIN > Error in BCU command, retrying....
SlopeCompCtrl2K_110690|ERR| 1586|2024-01-04 19:49:48.199526| MAIN > Error in TestComm (): [AOException] Timeout error in sendMultiBcuCommand() (code -5001) Timeout error File bcucommand.cpp line 164
SlopeCompCtrl2K_110690|WAR| 1587|2024-01-04 19:49:50.200076| MAIN > Error in BCU command, retrying....
SlopeCompCtrl2K_110690|WAR| 1588|2024-01-04 19:49:51.200330| MAIN > Error in BCU command, retrying....
SlopeCompCtrl2K_110690|ERR| 1589|2024-01-04 19:49:52.200664| MAIN > Error in TestComm (): [AOException] Timeout error in sendMultiBcuCommand() (code -5001) Timeout error File bcucommand.cpp line 164
SlopeCompCtrl2K_110690|WAR| 1590|2024-01-04 19:49:54.201197| MAIN > Error in BCU command, retrying....
SlopeCompCtrl2K_110690|WAR| 1591|2024-01-04 19:49:55.201407| MAIN > Error in BCU command, retrying...

ocam come back live.

TN:_195229

crop of log after a good powercycle.

l2K_110690|INF| 1653|2024-01-04 19:50:05.612250| CONFIG-LOADER > - WatchDog _ms: 0
SlopeCompCtrl2K_110690|INF| 1654|2024-01-04 19:50:05.612268| CONFIG-LOADER > - WatchdogMirrorLogLevel: ERR
SlopeCompCtrl2K_110690|INF| 1655|2024-01-04 19:50:05.612284| CONFIG-LOADER > - WatchdogSwitchLogLevel: ERR
SlopeCompCtrl2K_110690|INF| 1656|2024-01-04 19:50:05.612630| MAIN > Detected network interface for BCU communication: IP 172.16.34.100, MAC d0:94:66:5d:94:90
SlopeCompCtrl2K_110690|INF| 1657|2024-01-04 19:50:05.615700| MAIN > Section 5
SlopeCompCtrl2K_110690|INF| 1657|2024-01-04 19:50:05.615700| MAIN > .
SlopeCompCtrl2K_110690|INF| 1658|2024-01-04 19:50:05.616164| MAIN > Camera Type set
SlopeCompCtrl2K_110690|INF| 1658|2024-01-04 19:50:05.616164| MAIN > .
SlopeCompCtrl2K_110690|INF| 1659|2024-01-04 19:50:05.816937| MAIN > SlopComp: Setting fastlink area: /home/AOeng/live/aoroot//calib//wfs/current/dsp_programs/sl_fl_cmd_switch.txt
SlopeCompCtrl2K_110690|INF| 1660|2024-01-04 19:50:05.817628| MAIN > Done
SlopeCompCtrl2K_110690|INF| 1660|2024-01-04 19:50:05.817628| MAIN > .
SlopeCompCtrl2K_110690|INF| 1661|2024-01-04 19:50:37.886992| MAIN > Disabling fastlink
SlopeCompCtrl2K_110690|INF| 1662|2024-01-04 19:50:37.888253| MAIN > Fastlink Disabled
SlopeCompCtrl2K_110690|INF| 1663|2024-01-04 19:50:37.888313| MAIN > Received stop DSP request
SlopeCompCtrl2K_110690|INF| 1664|2024-01-04 19:50:37.888439| MAIN > DSP stopped
SlopeCompCtrl2K_110690|INF| 1665|2024-01-04 19:50:37.890722| MAIN > Frame burst stopped
SlopeCompCtrl2K_110690|INF| 1665|2024-01-04 19:50:37.890722| MAIN > .
SlopeCompCtrl2K_110690|INF| 1666|2024-01-04 19:50:38.391910| MAIN > Setting mode: 2 - FLAO
SlopeCompCtrl2K_110690|INF| 1667|2024-01-04 19:50:38.391952| MAIN > Disabling ocam interface
SlopeCompCtrl2K_110690|INF| 1668|2024-01-04 19:50:38.392728| MAIN > Ocam interface Disabled
SlopeCompCtrl2K_110690|INF| 1669|2024-01-04 19:50:38.393160| MAIN > DSP stopped
SlopeCompCtrl2K_110690|INF| 1670|2024-01-04 19:50:38.493262| MAIN > NUMSLOPES: 2848 - nSlopePixels: 5696 - slopeOffset: 0
SlopeCompCtrl2K_110690|INF| 1670|2024-01-04 19:50:38.493262| MAIN > .
SlopeCompCtrl2K_110690|INF| 1671|2024-01-04 19:50:38.503554| MAIN > mscub_ParamAverageFluxAreaPtr : 00105900
SlopeCompCtrl2K_110690|INF| 1671|2024-01-04 19:50:38.503554| MAIN > .
SlopeCompCtrl2K_110690|INF| 1672|2024-01-04 19:50:38.503595| MAIN > mscub_AverageFluxAreaPtr : 00081644
SlopeCompCtrl2K_110690|INF| 1672|2024-01-04 19:50:38.503595| MAIN > .
SlopeCompCtrl2K_110690|INF| 1673|2024-01-04 19:50:38.504671| MAIN > Setting n. of subapertures to 1424
SlopeCompCtrl2K_110690|INF| 1674|2024-01-04 19:50:38.504695| MAIN > Disabling ocam interface
SlopeCompCtrl2K_110690|INF| 1675|2024-01-04 19:50:38.505145| MAIN > Ocam interface Disabled
SlopeCompCtrl2K_110690|INF| 1676|2024-01-04 19:50:38.505571| MAIN > DSP stopped
SlopeCompCtrl2K_110690|INF| 1677|2024-01-04 19:50:38.605766| MAIN > No. of subapertures set to 1424
SlopeCompCtrl2K_110690|INF| 1678|2024-01-04 19:50:38.605827| MAIN > Loading Fastlink command file: sl_fl_cmd_switch.mode2.txt
SlopeCompCtrl2K_110690|INF| 1679|2024-01-04 19:50:38.605855| MAIN > Disabling ocam interface
SlopeCompCtrl2K_110690|INF| 1680|2024-01-04 19:50:38.606582| MAIN > Ocam interface Disabled
SlopeCompCtrl2K_110690|INF| 1681|2024-01-04 19:50:38.607117| MAIN > DSP stopped
SlopeCompCtrl2K_110690|INF| 1682|2024-01-04 19:50:38.707338| MAIN > SlopComp: Setting fastlink area: /home/AOeng/live/aoroot//calib//wfs/current/dsp_programs/sl_fl_cmd_switch.mode2.txt
SlopeCompCtrl2K_110690|INF| 1683|2024-01-04 19:50:38.708043| MAIN > Fastlink command file loaded: sl_fl_cmd_switch.mode2.txt
SlopeCompCtrl2K_110690|INF| 1684|2024-01-04 19:50:38.708093| MAIN > Disabling ocam interface
SlopeCompCtrl2K_110690|INF| 1685|2024-01-04 19:50:38.708734| MAIN > Ocam interface Disabled
SlopeCompCtrl2K_110690|INF| 1686|2024-01-04 19:50:38.709228| MAIN > DSP stopped
SlopeCompCtrl2K_110690|INF| 1687|2024-01-04 19:50:40.017946| MAIN > Loading pixel gating file: /home/AOeng/live/aoroot/calib/wfs/current/ocam2/LUTs/current/pixelGating.txt
SlopeCompCtrl2K_110690|INF| 1688|2024-01-04 19:50:40.018575| MAIN > DSP stopped
SlopeCompCtrl2K_110690|INF| 1689|2024-01-04 19:50:40.021070| MAIN > Pixel gating file loaded: /home/AOeng/live/aoroot/calib/wfs/current/ocam2/LUTs/current/pixelGating.txt
SlopeCompCtrl2K_110690|INF| 1690|2024-01-04 19:50:40.021545| MAIN > Loading slope gating file: /home/AOeng/live/aoroot/calib/wfs/current/ocam2/LUTs/current/slopesGating.txt
SlopeCompCtrl2K_110690|INF| 1691|2024-01-04 19:50:40.022230| MAIN > DSP stopped
SlopeCompCtrl2K_110690|INF| 1692|2024-01-04 19:50:40.024665| MAIN > Slope gating file loaded: /home/AOeng/live/aoroot/calib/wfs/current/ocam2/LUTs/current/slopesGating.txt
SlopeCompCtrl2K_110690|INF| 1693|2024-01-04 19:50:40.025096| MAIN > Loading slope LUT file: /home/AOeng/live/aoroot/calib/wfs/current/ocam2/LUTs/mode2/20220611_204439/SlopesLUT.txt
SlopeCompCtrl2K_110690|INF| 1694|2024-01-04 19:50:40.025706| MAIN > DSP stopped
SlopeCompCtrl2K_110690|INF| 1695|2024-01-04 19:50:40.047286| MAIN > Slope LUT file loaded: /home/AOeng/live/aoroot/calib/wfs/current/ocam2/LUTs/mode2/20220611_204439/SlopesLUT.txt
SlopeCompCtrl2K_110690|INF| 1696|2024-01-04 19:50:40.047716| MAIN > Loading slopes-to-do file: /home/AOeng/live/aoroot/calib/wfs/current/ocam2/LUTs/current/readySlopes.txt
SlopeCompCtrl2K_110690|INF| 1697|2024-01-04 19:50:40.048131| MAIN > DSP stopped
SlopeCompCtrl2K_110690|INF| 1698|2024-01-04 19:50:40.049264| MAIN > Slopes-to-do file loaded: /home/AOeng/live/aoroot/calib/wfs/current/ocam2/LUTs/current/readySlopes.txt
SlopeCompCtrl2K_110690|INF| 1699|2024-01-04 19:50:41.022421| MAIN > Ccd39 current binning to 1
SlopeCompCtrl2K_110690|INF| 1700|2024-01-04 19:50:41.067995| MAIN > Setting tomography gain to 1256.000000
SlopeCompCtrl2K_110690|INF| 1701|2024-01-04 19:50:41.068043| MAIN > Disabling ocam interface
SlopeCompCtrl2K_110690|INF| 1702|2024-01-04 19:50:41.068728| MAIN > Ocam interface Disabled
SlopeCompCtrl2K_110690|INF| 1703|2024-01-04 19:50:41.069227| MAIN > DSP stopped
SlopeCompCtrl2K_110690|INF| 1704|2024-01-04 19:50:41.176156| MAIN > Tomography gain set to 1256.000000
SlopeCompCtrl2K_110690|INF| 1705|2024-01-04 19:50:42.286666| MAIN > Setting pixel decimation to 3
SlopeCompCtrl2K_110690|INF| 1706|2024-01-04 19:50:53.226381| MAIN > Frame burst started
SlopeCompCtrl2K_110690|INF| 1706|2024-01-04 19:50:53.226381| MAIN > .
SlopeCompCtrl2K_110690|INF| 1707|2024-01-04 19:50:53.645288| MAIN > Frame burst stopped
SlopeCompCtrl2K_110690|INF| 1707|2024-01-04 19:50:53.645288| MAIN > .
SlopeCompCtrl2K_110690|INF| 1708|2024-01-04 19:50:53.647715| MAIN > Setting pixel decimation to 3
SlopeCompCtrl2K_110690|INF| 1709|2024-01-04 19:50:53.852608| MAIN > Frame burst started
SlopeCompCtrl2K_110690|INF| 1709|2024-01-04 19:50:53.852608| MAIN > .
SlopeCompCtrl2K_110690|INF| 1710|2024-01-04 19:50:54.734141| MAIN > Setting optical gain to 1.000000
SlopeCompCtrl2K_110690|INF| 1711|2024-01-04 19:50:54.736870| MAIN > Optical gain set to 1.000000

01:15

back t operations.

Adsecs ready.

Argos deployed.

close loop with DX no disturbance

OK.

The automatic mode does not apply the Gopt in the processess.

CLOSE LOOP SX.

01-04 21:04:00.172670| MAIN > Maximum mode index used to apply flat -> # 243

21:04:00.172693| MAIN > the limiting actuator is-> # 375

STOPAO

idl_70160 |INF| 938|2024-01-04 21:07:10.381556| MAIN > Maximum mode index used to apply flat -> # 228
idl_70160 |INF| 939|2024-01-04 21:07:10.381583| MAIN > the limiting actuator is-> # 375

DXAO

70 |INF| 1278|2024-01-04 21:09:55.562164| MAIN > Maximum mode index used to apply flat -> # 620
idl_92070 |INF| 1279|2024-01-04 21:09:55.562185| MAIN > the limiting actuator is-> # 328

Stop2:15PM

-- JuanCarlosGuerra - 04 Jan 2024
Topic revision: r2 - 04 Jan 2024, JuanCarlosGuerra
This site is powered by FoswikiCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding Foswiki? Send feedback