Staff:

Lbto: Josh, Andrew, Alex, Juan Carlos

Observer: Enrico, Guido and Fabio (remote Italy)

Forecast.

forecast2_20230427.png

forecast0-20230427.png

last night forecast.

forecast1_20230427.png

Summary.

Observations start in the second half of the night.

some plots from yesterday data.

plots_yesterday.png

Bad frame Excel link:

https://docs.google.com/spreadsheets/d/13lppT6YWFlHJ4iSjlFw5yPhpr3flD6NV1W5oHS_vVKY/edit?usp=sharing

Details.

Nudge predictor.

[lbto@obs1 ObserverSupport ]$ ./nudgepredict.py -d 20230428 -e 13 -b 13
./nudgepredict.py script version of 28-Mar-2022
5189443199.0 end MJD sec for the end of this UT day
60062 end MJD day
5189403600.0 end MJD sec corrected for endhour 13.0
5189356800.0 start MJD sec using backhour 13.0
20230428 is the day to be plotted.
0.0 start hour using backhour 13.0 end hour 13.0
These UT start times will have a nudge if the telescope is tracking.
00:12:10
00:46:18
01:20:26
01:54:34
02:28:42
03:02:50
03:36:58
04:11:06
04:45:14
05:19:22
05:53:30
06:27:38
07:01:46
07:35:54
08:10:02
08:44:10
09:18:18
09:52:26
10:26:34
11:00:42
11:34:50
12:08:58
12:43:06

11:50PM

WFS power on.

Fabio restarted the soft. version: master-fwFix

Ocam

not live.

change binning didn;t solve it.

Power cycle BCU2k and set bin from WFS control GUI solved.

12:29
  • pointing preset.
  • ok.
  • some high cirrus passing.

Fri Apr 28 07:36:27.003 2023 aos.PresetAO{FLAO}.started - PresetAO{FLAO}[2942] (aomode:ACE-AO,focst:bentGregorianFront,instr:LUCIFER,wfs:FLAOWFS,sox:0[0],soy:0,rox:-0.0224508[-0.0224508],roy:0.0432712,mag:12.72,cindex:0,,elev:nan,rotang:nan,grvang:nan,r0:0,skybr:nan,windsp:nan,winddir:nan)
  • shell failure.
  • it coincide with a nudge during the center pupil.
  • restart adsc/wfs soft.

Fri Apr 28 07:45:40.297 2023 aos.PresetAO{FLAO}.started - PresetAO{FLAO}[2945] (aomode:ACE-AO,focst:bentGregorianFront,instr:LUCIFER,wfs:FLAOWFS,sox:0[0],soy:0,rox:-0.032526[-0.032526],roy:0.044106,mag:12.72,cindex:0,,elev:nan,rotang:nan,grvang:nan,r0:0,skybr:nan,windsp:nan,winddir:nan)

  • seeing 1.35"
  • optimize:20230428_074935
  • tt:3.64,0.71,0.7
  • tn:tn:_075123,_075140,_075209,_075320,_075333,_075420,_075140,_075209,_075320,_075333,c
  • variable seeing, the gopt oscillation.
  • luci filter H, exp 0, frames 30
  • tn+luci:_075527,_075630,_075701,_075725,_075750,_075815
  • ncpaon
  • 04-28 07:59:30.162163| MAIN > arbFunc updateNcpaInternal (, 'FLAOWFS', 'LUCIFER', 320.98099999999999, 0)
  • WfsArbitrator_29470|DEB| 305|2023-04-28 07:59:30.225187| MAIN > arbFunc updateNcpaInternal done.
  • TN+luci:_075943,_080027,_080100,_080126,_080156,_080221
  • luci background: 20230428.0104,0105

nudge: 08:10:02

Fri Apr 28 08:08:10.211 2023 aos.PresetAO{FLAO}.started - PresetAO{FLAO}[2952] (aomode:ACE-AO,focst:bentGregorianFront,instr:LUCIFER,wfs:FLAOWFS,sox:0[0],soy:0,rox:-0.218527[-0.218527],roy:0.198552,mag:15,cindex:0,,elev:nan,rotang:nan,grvang:nan,r0:0,skybr:nan,windsp:nan,winddir:nan)

  • next nudge: 08:44:10
  • optimize: _081335
  • 4.88,1.26,0.68

1:16am
  • seeing 1.8 - 2
  • Tn:_081541,_081553,_081627,_081706,_081806,_081828
  • seeing up to 2" Arcetri no taking data....

01:20am
  • gain 0.1modes.
  • wait to see the improvement of the seeing.

bad-seeing_0120.png

1:24am
  • seeing down to 1.5
  • optimize:_082430
  • but seeing starts to go up up to 3
  • gopt failed.

jump_seeing_0128.png

01:26am
  • lower the gains
  • standby and following the seeing trends

badseeing_0128.png

01:44

nudge happened and loop keeps.
  • 01:46
  • seeing 1.7

next nudge: 09:18:18
  • change target to a brighter.

esetAO{FLAO}.started - PresetAO{FLAO}[2956] (aomode:ACE-AO,focst:bentGregorianFront,instr:LUCIFER,wfs:FLAOWFS,sox:0[0],soy:0,rox:0.0575583[0.0575583],roy:-0.057963,mag:9.37,cindex:0,,elev:nan,rotang:nan,grvang:nan,r0:0,skybr:nan,windsp:nan,winddir:nan)

02:23am
  • DXM1 panic.
  • Recovering

02:31 done.

ri Apr 28 09:31:03.595 2023 aos.Stop{FLAO}.complete - Stop{FLAO}[2957]
Fri Apr 28 09:31:07.348 2023 aos.PresetAO{FLAO}.started - PresetAO{FLAO}[2958] (aomode:ACE-AO,focst:bentGregorianFront,instr:LUCIFER,wfs:FLAOWFS,sox:0[0],soy:0,rox:0.0479525[0.0479525],roy:-0.0588773,mag:9.37,cindex:0,,elev:nan,rotang:nan,grvang:nan,r0:0,skybr:nan,windsp:nan,wind
  • cancel.
  • Apr 28 09:32:51.700 2023 aos.PresetAO{FLAO}.started - PresetAO{FLAO}[2960] (aomode:ACEAO,focst:bentGregorianFront,instr:LUCIFER,wfs:FLAOWFS,sox:0[0],soy:0,rox:0.0460709[0.0460709],roy:-0.0590253,mag:9.37,cindex:0,,elev:nan,rotang:nan,grvang:nan,r0:0,skybr:nan,windsp:nan,winddir:nan)
  • optimize:_093727
  • seeing 1.3"

next nudge:09:52:26
  • TN:_093942,_094002,_094015,_094040,_094057.
  • TN+luci:_094114,_094150,_094223,_094257,_094324,_094351 (no dimm data.)
  • wating to have dimm data......
  • TN+luci:_094454,_044613,_094645,_095020,_095211,_
  • nudge happen.
  • loop open, recover, not taking data, seeing was not available
  • optimize:095316
  • TN+luci:_095531,_095601,_
  • oscillation at 200Hz, reduce TT to 0.8
  • no dimm data for most of the time.
  • tn, osicllaiton of TT anemometer around 5m/s: acquisiton of data with wind correlaiton-> TN_100426,_100512,_100602,_100647,_100711,_100757

next nudge: 10:26:34
Fri Apr 28 10:08:57.890 2023 aos.PresetAO{FLAO}.started - PresetAO{FLAO}[2964] (aomode:ACE-AO,focst:bentGregorianFront,instr:LUCIFER,wfs:FLAOWFS,sox:0[0],soy:0,ro
  • wind gusts up to 7m/s
  • mag 10.3
  • optimize:_101349
  • Tn:_101716,_101737,_101757,_101841,102321
  • too elongated PSF,..

next nudge:11:00:42
  • wind speed gust 6m/s
  • not luck with the dimm.
  • changing target

Fri Apr 28 10:30:44.011 2023 aos.info - Updated variable adamhousekeeper.R.TSS_STATUS: 2
Fri Apr 28 10:30:47.235 2023 aos.PresetAO{FLAO}.started - PresetAO{FLAO}[2968] (aomode:ACE-AO,focst:bentGregorianFront,instr:LUCIFER,wfs:FLAOWFS,sox:0[0],soy:0,rox:0.147526[0.147526],roy:-0.65227,mag:11.53,cindex:0,,elev:nan,rotang:nan,grvang:nan,r0:0,skybr:nan,windsp:nan,winddir:nan)
Fri Apr 28 10:30:47.247 2023 aos.info - WFS source set to: FLAOWFS
  • mag 12.12
  • optimize:_103535
  • TN:_103721,_103738,_103756,_103831,_103907
  • seeing 1.1
  • luci 0exp, 30 frames
  • tn+luci:_103924,_104003,_104057,_104124,_104204,_104232
  • gopt oscillating.
  • ncpaon:
  • |2023-04-28 10:43:28.179214| MAIN > arbFunc updateNcpaInternal (, 'FLAOWFS', 'LUCIFER', 173.05699999999999, 0)
  • WfsArbitrator_29470|DEB| 1695|2023-04-28 10:43:28.212317| MAIN > arbFunc updateNcpaInternal done.
  • TN+Luci:_104347,_104417,_104512,_104540,_104608,_104642
  • luci background:0146,0147
  • skipping frames seeing getting worst from 1 to 1.5
  • TN:105115,_

3:52am

change target.
Fri Apr 28 10:53:04.758 2023 aos.PresetAO{FLAO}.started - PresetAO{FLAO}[2975] (aomode:ACE-AO,focst:bentGregorianFront,instr:LUCIFER,wfs:FLAOWFS,sox:0[0],soy:0,rox:-0.0392041[-0.0392041],roy:-0.0486632,mag:13.46,cindex:0,,elev:nan,rotang:nan,grvang:nan,r0:0,skybr:nan,windsp:nan,winddir:n
  • this target face the wind, wind inside 5m/s
  • optimize:105735 MAIN > arbFunc startGoptInternal (, 'FLAOWFS', 'LUCIFER')
    WfsArbitrator_29470|INF| 2040|2023-04-28 10:58:42.440574| MAIN > Waiting for stable gopt (relative threshold is 15%)
    WfsArbitrator_29470|ERR| 2041|2023-04-28 10:59:20.025253| MAIN > RETRY: Gopt did not stabilize within 10 iterations (-5001) TIMEOUT_ERROR
    WfsArbitrator_29470|DEB| 2042|2023-04-28 10:59:41.893882| MAIN > arbFunc startGoptInternal (, 'FLAOWFS', 'LUCIFER')
    WfsArbitrator_29470|INF| 2043|2023-04-28 10:59:41.894132| MAIN > Waiting for stable gopt (relative threshold is 15%)
    WfsArbitrator_29470|INF| 2044|2023-04-28 11:00:14.287719| MAIN > Gopt is stable, renormalizing gains
    WfsArbitrator_29470|INF| 2045|2023-04-28 11:00:14.288020| MAIN > Waiting again for a few iterations

65056 |INF| 1523|2023-04-28 11:00:48.660603| MAIN > Done.
idl_65056 |INF| 1524|2023-04-28 11:00:48.662424| MAIN > All Done. Succefully recovered from SafeSkipFrames.
idl_65056 |INF| 1525|2023-04-28 11:00:48.676035| MAIN > ACC_DELAY after setting: 50 (0.00070494118s)
idl_65056 |INF| 1526|2023-04-28 11:00:48.676103| MAIN > ACC_LEN after setting: 6 (8.4592941e-05s)
AdSecArbitrator_65134|ERR| 1997|2023-04-28 11:00:49.075284| ALERTHANDLER > Received an ERROR alert! Forcing Failure state.
AdSecArbitrator_65134|ERR| 1998|2023-04-28 11:00:49.075365| ALERTHANDLER > Alert message: COILS DISABLED from housekeeper.R
20232804 11:00:49.0765 Alert: Error: COILS DISABLED
idl_65056 |INF| 1527|2023-04-28 11:00:49.148908| MAIN > fsm_stop_ao end
AdSecArbitrator_65134|INF| 1999|2023-04-28 11:00:49.181818| COMMANDHANDLER > Command Stop Ao (code 2015) successfully completed
AdSecArbitrator_65134|WAR| 2000|2023-04-28 11:00:50.241837| MAIN > Skip frame detected! (33.97% of frames skipped.)
AdSecArbitrator_65134|INF| 2001|2023-04-28 11:00:50.481245| ALERTHANDLER > Received from masterdiagnostic.R a DumpSaved alert with filename /home/aoeng/soul/aolog/2023/04/28/ADAPTIVE-SECONDARY_00001682679650_20230428_110050.bin
AdSecArbitrator_65134|INF| 2002|2023-04-28 11:00:50.481276| ALERTHANDLER > Processdump is skipped
20232804 11:00:50.4825 Alert: DumpSaved: DumpSaved vector ready
  • looking for another star in the filed away from the wind. (South...)
  • nudge skip shell rip, TSS enabled
04:05am
  • adsc/wfs-stop/start
  • 8 11:06:56.748722| MAIN > Maximum mode index used to apply flat -> # 386
next nudge:11:34:50

Fri Apr 28 11:12:07.562 2023 aos.Stop{FLAO}.complete - Stop{FLAO}[2979]
Fri Apr 28 11:12:11.434 2023 aos.PresetAO{FLAO}.started - PresetAO{FLAO}[2980] (aomode:ACE-AO,focst:bentGregorianFront,instr:LUCIFER,wfs:FLAOWFS,sox:0[0],soy:0,rox:0.00275202[0.00275202],roy:0.0543025,mag:10.62,cindex:0,,elev:nan,rotang:nan,grvang:nan,r0:0,skybr:nan,windsp:nan,winddir:nan)
  • mag 11.1
  • optimize:_111642
  • double
  • TN:_111849, (luci 0151),111951(luci0152),112041
4:21am

no dimm data available, still searching for stars

TN+luci:_112221,_112259,_112420,_112449,112645
  • lcu background:.0158,0159
  • TN+lui113111,_113144,_113212,_113241,_113336,_113440
  • fake pse shape.observed in the number of dumps and the the command gui shows time to time some "pie"
  • optimize:_113547
0|2023-04-28 11:36:26.586612| MAIN > OCAM Bad Frames/Slopes Error, code 2
WfsArbitrator_90374|ERR| 161|2023-04-28 11:36:26.586683| MAIN > OCAM Error Description: Code 2 - Slopes are all 0
WfsArbitrator_90374|ERR| 162|2023-04-28 11:36:26.586702| MAIN > OCAM Suggested action to recover: Change Bin back and forth via WFS control GUI; if required, power cycle BCU
  • _113825,_113953,_114042,_114136,_114531,_114444,_114533,_114602,_114756
  • there are not options of Stars. Enrico couldnt get any suitable

4:51am

Power off

-- JuanCarlosGuerra - 27 Apr 2023
I Attachment Action Size Date Who Comment
bad-seeing_0120.pngpng bad-seeing_0120.png manage 112 K 28 Apr 2023 - 08:21 JuanCarlosGuerra  
badseeing_0128.pngpng badseeing_0128.png manage 243 K 28 Apr 2023 - 08:28 JuanCarlosGuerra  
forecast0-20230427.pngpng forecast0-20230427.png manage 692 K 27 Apr 2023 - 22:29 JuanCarlosGuerra  
forecast1_20230427.pngpng forecast1_20230427.png manage 799 K 27 Apr 2023 - 22:29 JuanCarlosGuerra  
forecast2_20230427.pngpng forecast2_20230427.png manage 103 K 27 Apr 2023 - 22:30 JuanCarlosGuerra  
jump_seeing_0128.pngpng jump_seeing_0128.png manage 124 K 28 Apr 2023 - 08:29 JuanCarlosGuerra  
plots_yesterday.pngpng plots_yesterday.png manage 262 K 28 Apr 2023 - 07:25 JuanCarlosGuerra  
Topic revision: r2 - 28 Apr 2023, JuanCarlosGuerra
This site is powered by FoswikiCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding Foswiki? Send feedback