UT 20120918 AO#2 Commissioning

Observer: Buzoni,L, Esposito, S. Riccardi,A. (INAF)
Telescope Operator: Bechetti,G (LBTO)
Additional AO Support: JCGuerra,. Christou,J. (LBTO)
Telescope Support: (LBTO)
Instrument Support: (LBTO)

Summary

• Night time operation of the AO#2.

• Check of the AO system working at bin 3 and bin 4. Check performances and robustness of the system.

• Many skip+RIP of the system. Most of the rip came from the change of the seeing conditions.

• Changes in the wfs software to improve the robustness of the acquire reference star and the estimation of the reference star magnitude.

• Hard failure of the active optics after 12:05 UT. The PSF couldn't be collimate at two different elevations and objects.

• Seeing variable 2" to 0.8"

Details

Start 2:13UT

preset, AO1044, MODE=ACE, GS=10, RS=0

IDL> IDL> iif_runao ===> Error in irc_runao err = Resmsg[0] = RunAO result status: Error err = Resmsg[1] = Timeout error on baysidey (-5001) TIMEOUT_ERROR err = Resmsg[2] = AcquireRef[561] failed - Timeout error on baysidey (-5001) TIMEOUT_ERROR IDL> iif_runao ===> Error in irc_runao err = Resmsg[0] = RunAO result status: Error err = Resmsg[1] = AOARB:Illegal command for state Operational (AcquireRefAO) err = Resmsg[2] = AcquireRef[562] failed - AOARB:Illegal command for state Operational (AcquireRefAO)

preset, AO1044, MODE=ACE, GS=10, RS=0

===> Error in irc_presetTelescope err = Resmsg[0] = PresetTelescope result status: Error err = Resmsg[1] = Stop[563] complete err = Resmsg[2] = PresetAO[564] failed - Command timeout - -13107: Arbitrator interface generic error

 5:15. Error in the stage positioning. The slit doesn't do the homing. LBT Rotator:311 degrees. Rotator moved to Zero.
Power off/on the WFS. 

Tue Sep 18 05:26:37.863 2012 aos.PresetAO.started - PresetAO[569] (aomode:ACE-AO,focalst:bentGregorianFront,instr:LUCIFER,wfs:FLAOWFS,so1:0,so2:0,ro1:-5.26779e-07,ro2:-2.7702e-08,mag:14.14,cindex:2.01,elev:nan,rotang:nan,gravang:nan,r0:0,skybrgt:nan,windspeed:nan,winddir:nan) Tue Sep 18 05:28:15.005 2012 aos.PresetAO.complete - PresetAO[569] complete - dx:nan dy:nan slNull: f1:Filter #0 f2:Filter #0 freq:200 mag:0 nBins:3 nModes:66 r0:0 snMode:0 strehl:0 ttMod:6 Tue Sep 18 05:28:45.383 2012 aos.AcquireRef.started - AcquireRef[570]

Tue Sep 18 05:32:26.534 2012 aos.AcquireRef.failed - AcquireRef[570] failed - Camera lens centering did not converge after 180 seconds

IDL> iif_runao ===> Error in irc_runao err = Resmsg[0] = RunAO result status: Error err = Resmsg[1] = Camera lens centering did not converge after 180 seconds err = Resmsg[2] = AcquireRef[570] failed - Camera lens centering did not converge after 180 seconds

 Position of LBT rot :308.5 at this angle the camera lens is in the limit and it doesn't move. The loop open due to that issue. 

Tue Sep 18 05:40:40.683 2012 aos.PresetAO.started - PresetAO[572] (aomode:ACE-AO,focalst:bentGregorianFront,instr:LUCIFER,wfs:FLAOWFS,so1:0,so2:0,ro1:-3.54113e-07,ro2:8.92128e-07,mag:14.1,cindex:2.17,elev:nan,rotang:nan,gravang:nan,r0:0,skybrgt:nan,windspeed:nan,winddir:nan)

Tue Sep 18 05:41:13.276 2012 aos.PresetAO.complete - PresetAO[572] complete - dx:nan dy:nan slNull: f1:Filter #0 f2:Filter #0 freq:200 mag:0 nBins:3 nModes:66 r0:0 snMode:0 strehl:0 ttMod:6

Tue Sep 18 05:45:44.947 2012 aos.StartAO.started - StartAO[574]

seeing: about 1"

 5:52... SKIP+RIP during the close loop. 

Tue Sep 18 05:58:33.778 2012 aos.PresetAO.complete - PresetAO[576] complete - dx:nan dy:nan slNull: f1:Filter #0 f2:Filter #0 freq:200 mag:0 nBins:3 nModes:66 r0:0 snMode:0 strehl:0 ttMod:6 Tue Sep 18 05:58:43.986 2012 aos.AcquireRef.started - AcquireRef[577] Tue Sep 18 05:59:30.449 2012 aos.info - WFS: star found, estimated magnitude: 15.46

Stop preset: 6:30

Tue Sep 18 06:30:42.747 2012 aos.PresetAO.started - PresetAO[580] (aomode:ACE-AO,focalst:bentGregorianFront,instr:LUCIFER,wfs:FLAOWFS,so1:0,so2:0,ro1:-2.61279e-06,ro2:8.36113e-07,mag:14.1,cindex:2.17,elev:nan,rotang:nan,gravang:nan,r0:0,skybrgt:nan,windspeed:nan,winddir:nan) Tue Sep 18 06:31:48.852 2012 aos.AcquireRef.started - AcquireRef[581]

Tue Sep 18 06:36:10.366 2012 aos.AcquireRef.failed - AcquireRef[581] failed - Camera lens centering did not converge after 180 seconds.

 The preset failed because the camera lens arrived to the limit (100) 

preset, AO891, MODE=ACE, GS=2, RS=0, PA=90

===> Error in irc_presetTelescope err = Resmsg[0] = PresetTelescope result status: Error err = Resmsg[1] = Stop[582] complete err = Resmsg[2] = AGw command status: AGW1: Requested position is Out of Range err = Resmsg[3] = error: setProbePosition: couldn't move probe to position (SFP) (x,y,z): 55.1587, -45.6059, 29.0424 mm. err = Resmsg[4] = guidestar list successfully changed but probe couldn't be moved to position.

Tue Sep 18 07:03:26.040 2012 aos.AcquireRef.complete - AcquireRef[594] complete - dx:-0.937 dy:-1.01 slNull: f1:Filter #0 f2:Filter #0 freq:200 mag:14.775 nBins:4 nModes:36 r0:0 snMode:0 strehl:0 ttMod:6 Tue Sep 18 07:03:26.141 2012 aos.StartAO.started - StartAO[595]

Tue Sep 18 07:04:47.614 2012 aos.info - COILS DISABLED Tue Sep 18 07:04:47.665 2012 aos.error - Stopping WFS...

 SKIP+RIP during the Autogain procedure.

IDL> iif_runao ===> Error in irc_runao err = Resmsg[0] = RunAO result status: Error err = Resmsg[1] = AcquireRef[594] complete - dx:-0.937 dy:-1.01 slNull: f1:Filter #0 f2:Filter #0 freq:200 mag:14.775 nBins:4 nModes:36 r0:0 snMode:0 strehl:0 ttMod:6 err = Resmsg[2] = thWaitMsg error(-5001): Timeout error err = Resmsg[3] = StartAO[595] failed - thWaitMsg error(-5001): Timeout error

7:08 SEEING: 1.4"

Tue Sep 18 07:08:29.880 2012 aos.PresetAO.started - PresetAO[597] (aomode:ACE-AO,focalst:bentGregorianFront,instr:LUCIFER,wfs:FLAOWFS,so1:0,so2:0,ro1:-5.35125e-07,ro2:-1.24429e-06,mag:14.1,cindex:2.17,elev:nan,rotang:nan,gravang:nan,r0:0,skybrgt:nan,windspeed:nan,winddir:nan) Tue Sep 18 07:08:29.931 2012 aos.info - WFS source set to: FLAOWFS

7:20 SEEING:2"

8:09 SEEING:1.8"

Tue Sep 18 08:08:28.170 2012 aos.PresetAO.started - PresetAO[613] (aomode:ACE-AO,focalst:bentGregorianFront,instr:LUCIFER,wfs:FLAOWFS,so1:0,so2:0,ro1:-1.37154e-07,ro2:1.51268e-06,mag:14.1,cindex:2.17,elev:nan,rotang:nan,gravang:nan,r0:0,skybrgt:nan,windspeed:nan,winddir:nan)

 SKIP 

Tue Sep 18 08:23:54.912 2012 aos.error - Stopping WFS... Tue Sep 18 08:23:55.192 2012 aos.error - Stopping AdSec

8:25 SEEING:1.4"

 SKIP+RIP 

Tue Sep 18 08:31:56.685 2012 aos.info - COILS DISABLED Tue Sep 18 08:31:56.736 2012 aos.error - Stopping WFS... Tue Sep 18 08:31:57.007 2012 aos.error - Recovering AdSec failure

Tue Sep 18 08:33:44.671 2012 aos.info - Adsec 672b-left recovery from FAILURE done.

Tue Sep 18 08:35:42.946 2012 aos.PresetAO.started - PresetAO[619] (aomode:ACE-AO,focalst:bentGregorianFront,instr:LUCIFER,wfs:FLAOWFS,so1:0,so2:0,ro1:6.74515e-07,ro2:-3.60826e-07,mag:15.1,cindex:0.3,elev:nan,rotang:nan,gravang:nan,r0:0,skybrgt:nan,windspeed:nan,winddir:nan) Tue Sep 18 08:35:42.997 2012 aos.info - WFS source set to: FLAOWFS

Tue Sep 18 08:41:32.443 2012 aos.AcquireRef.failed - AcquireRef[620] failed - Timeout error on baysidey (-5001) TIMEOUT_ERROR IDL> iif_runao ===> Error in irc_runao err = Resmsg[0] = RunAO result status: Error err = Resmsg[1] = Timeout error on baysidey (-5001) TIMEOUT_ERROR err = Resmsg[2] = AcquireRef[620] failed - Timeout error on baysidey (-5001) TIMEOUT_ERROR IDL>

Tue Sep 18 08:42:39.868 2012 aos.AcquireRef.failed - AcquireRef[621] failed - AOARB:Illegal command for state Operational (AcquireRefAO)

===> Error in irc_presetTelescope err = Resmsg[0] = PresetTelescope result status: Error err = Resmsg[1] = Stop[622] complete err = Resmsg[2] = WARNING: guide cam exposure time is less than 2000 ms which might cause guiding on atmospheric dispersions err = Resmsg[3] = adjusted exposure time to 500 ms err = Resmsg[4] = PresetAO[623] failed - Command timeout - -13107: Arbitrator interface generic error IDL> iif_runao ===> Error in irc_runao err = Resmsg[0] = RunAO result status: Error err = Resmsg[1] = left Preset inactive ] Tue Sep 18 08:48:36.287 2012 aos.PresetAO.failed - PresetAO[625] failed - Command timeout - -13107: Arbitrator interface generic error ===> Error in irc_presetTelescope err = Resmsg[0] = PresetTelescope result status: Error err = Resmsg[1] = Stop[624] complete err = Resmsg[2] = PresetAO[625] failed - Command timeout - -13107: Arbitrator interface generic error

Tue Sep 18 08:50:38.395 2012 aos.PresetAO.complete - PresetAO[627] complete - dx:nan dy:nan slNull: f1:Filter #0 f2:Filter #0 freq:200 mag:0 nBins:4 nModes:36 r0:0 snMode:0 strehl:0 ttMod:6 Tue Sep 18 08:50:49.524 2012 aos.AcquireRef.started - AcquireRef[628]

Tue Sep 18 08:56:06.739 2012 aos.PresetAO.complete - PresetAO[631] complete - dx:nan dy:nan slNull: f1:Filter #0 f2:Filter #0 freq:200 mag:0 nBins:4 nModes:36 r0:0 snMode:0 strehl:0 ttMod:6 Tue Sep 18 08:56:25.660 2012 aos.info - Updated variable L.IDL_STAT: 1

8:59 SEEING:1.7"

Tue Sep 18 09:35:35.440 2012 aos.PresetAO.started - PresetAO[635] (aomode:ACE-AO,focalst:bentGregorianFront,instr:LUCIFER,wfs:FLAOWFS,so1:0,so2:0,ro1:-3.67595e-07,ro2:-1.70908e-07,mag:15.1,cindex:0.3,elev:nan,rotang:nan,gravang:nan,r0:0,skybrgt:nan,windspeed:nan,winddir:nan)

Tue Sep 18 09:01:55.859 2012 aos.info - Maximum skip reached Tue Sep 18 09:01:55.910 2012 aos.error - Stopping WFS... Tue Sep 18 09:01:56.182 2012 aos.error - Stopping AdSec

 SKIP Open the loop 

===> Error in irc_presetTelescope err = Resmsg[0] = PresetTelescope result status: Error err = Resmsg[1] = Stop[634] complete err = Resmsg[2] = left PMC Mirror GoToPositionAbs Command Failed because Wrong mirror state err = Resmsg[3] = Secondary mirror collimation reached limit IDL>

 *PRIMARY MIRROR: PANIC* 

 *SECONDARY REACH THE HARD LIMIT IN RY 900.* 

Tue Sep 18 09:45:55.929 2012 aos.PresetAO.started - PresetAO[638] (aomode:ACE-AO,focalst:bentGregorianFront,instr:LUCIFER,wfs:FLAOWFS,so1:0,so2:0,ro1:1.02501e-06,ro2:-9.05083e-08,mag:15.1,cindex:0.3,elev:nan,rotang:nan,gravang:nan,r0:0,skybrgt:nan,windspeed:nan,winddir:nan) Tue Sep 18 09:45:55.980 2012 aos.info - WFS source set to: FLAOWFS

IDL> iif_runao ===> Error in irc_runao err = Resmsg[0] = RunAO result status: Error err = Resmsg[1] = RETRY: source_acq error: Star centering procedure failed to converge after 5 iterations (-20003) WFSARB_STAR_NOTCONVERGED err = Resmsg[2] = AcquireRef[643] failed - RETRY: source_acq error: Star centering procedure failed to converge after 5 iterations (-20003) WFSARB_STAR_NOTCONVERGED

Tue Sep 18 10:01:11.159 2012 aos.AcquireRef.failed - AcquireRef[643] failed - RETRY: source_acq error: Star centering procedure failed to converge after 5 iterations (-20003) WFSARB_STAR_NOTCONVERGED

10:03 seeing:1.6"

IDL> iif_runao ===> Error in irc_runao err = Resmsg[0] = RunAO result status: Error err = Resmsg[1] = Reading shared buffer masterdiagnostic.L:OPTLOOPBUF (-5001) TIMEOUT_ERROR err = Resmsg[2] = AcquireRef[646] failed - Reading shared buffer masterdiagnostic.L:OPTLOOPBUF (-5001) TIMEOUT_ERROR

Tue Sep 18 10:07:29.907 2012 aos.AcquireRef.failed - AcquireRef[646] failed - Reading shared buffer masterdiagnostic.L:OPTLOOPBUF (-5001) TIMEOUT_ERROR Tue Sep 18 10:07:39.894 2012 aos.warning - Variable iif.DIMM.seeing expired

Tue Sep 18 10:10:47.129 2012 aos.PresetAO.complete - PresetAO[649] complete - dx:nan dy:nan slNull: f1:Filter #0 f2:Filter #0 freq:200 mag:0 nBins:4 nModes:36 r0:0 snMode:0 strehl:0 ttMod:6 Tue Sep 18 10:10:53.611 2012 aos.AcquireRef.started - AcquireRef[650]

IDL> iif_runao ===> Error in irc_runao err = Resmsg[0] = RunAO result status: Error err = Resmsg[1] = Timeout error on baysidey (-5001) TIMEOUT_ERROR err = Resmsg[2] = AcquireRef[650] failed - Timeout error on baysidey (-5001) TIMEOUT_ERROR

Tue Sep 18 10:11:51.212 2012 aos.AcquireRef.failed - AcquireRef[650] failed - Timeout error on baysidey (-5001) TIMEOUT_ERROR

10:16 SEEING:1.3"

Tue Sep 18 10:14:01.362 2012 aos.PresetAO.complete - PresetAO[652] complete - dx:nan dy:nan slNull: f1:Filter #0 f2:Filter #0 freq:200 mag:0 nBins:4 nModes:36 r0:0 snMode:0 strehl:0 ttMod:6 Tue Sep 18 10:14:07.186 2012 aos.AcquireRef.started - AcquireRef[653]

Tue Sep 18 10:15:14.607 2012 aos.AcquireRef.failed - AcquireRef[653] failed - RETRY: source_acq error: Star centering procedure failed to converge after 5 iterations (-20003) WFSARB_STAR_NOTCONVERGED Tue Sep 18 10:15:25.835 2012 aos.info - Updated variable L.IDL_STAT: 1

Tue Sep 18 10:32:42.295 2012 aos.PresetAO.started - PresetAO[655] (aomode:ACE-AO,focalst:bentGregorianFront,instr:LUCIFER,wfs:FLAOWFS,so1:0,so2:0,ro1:1.23199e-06,ro2:-7.62299e-08,mag:15.1,cindex:0.3,elev:nan,rotang:nan,gravang:nan,r0:0,skybrgt:nan,windspeed:nan,winddir:nan) Tue Sep 18 10:32:42.345 2012 aos.info - WFS source set to: FLAOWFS

 SKIP+RIP 

IDL> iif_runao ===> Error in irc_runao err = Resmsg[0] = RunAO result status: Error err = Resmsg[1] = AcquireRef[656] complete - dx:-1.537 dy:-0.951 slNull: f1:Filter #0 f2:Filter #0 freq:312 mag:13.764 nBins:3 nModes:66 r0:0 snMode:0 strehl:0 ttMod:6 err = Resmsg[2] = wfsarb:Illegal command for state AOSet (OptimizeGain) err = Resmsg[3] = StartAO[657] failed - wfsarb:Illegal command for state AOSet (OptimizeGain)

Tue Sep 18 10:36:39.374 2012 aos.StartAO.failed - StartAO[657] failed - wfsarb:Illegal command for state AOSet (OptimizeGain)

10:38. SEEING:1.6"

Tue Sep 18 10:41:28.827 2012 aos.PresetAO.started - PresetAO[660] (aomode:ACE-AO,focalst:bentGregorianFront,instr:LUCIFER,wfs:FLAOWFS,so1:0,so2:0,ro1:-2.02641e-06,ro2:-1.08047e-07,mag:15.1,cindex:0.3,elev:nan,rotang:nan,gravang:nan,r0:0,skybrgt:nan,windspeed:nan,winddir:nan) Tue Sep 18 10:41:28.878 2012 aos.info - WFS source set to: FLAOWFS

Tue Sep 18 10:54:50.793 2012 aos.PresetAO.started - PresetAO[662] (aomode:ACE-AO,focalst:bentGregorianFront,instr:LUCIFER,wfs:FLAOWFS,so1:0,so2:0,ro1:-2.945e-06,ro2:7.88007e-09,mag:15.1,cindex:0.3,elev:nan,rotang:nan,gravang:nan,r0:0,skybrgt:nan,windspeed:nan,winddir:nan) Tue Sep 18 10:54:50.844 2012 aos.info - WFS source set to: FLAOWFS

 SKIP+RIP 

Tue Sep 18 10:58:38.417 2012 aos.info - COILS DISABLED

IDL> iif_runao ===> Error in irc_runao err = Resmsg[0] = RunAO result status: Error err = Resmsg[1] = AcquireRef[663] complete - dx:-1.825 dy:-1.179 slNull: f1:Filter #0 f2:Filter #0 freq:200 mag:14.701 nBins:4 nModes:36 r0:0 snMode:0 strehl:0 ttMod:6 err = Resmsg[2] = wfsarb:Illegal command for state AOSet (OptimizeGain) err = Resmsg[3] = StartAO[664] failed - wfsarb:Illegal command for state AOSet (OptimizeGain)

Tue Sep 18 10:58:51.615 2012 aos.StartAO.failed - StartAO[664] failed - wfsarb:Illegal command for state AOSet (OptimizeGain)

 CHANGE STAR BECAUSE  (EL:47) THE ACTIVE OPTICS DIDN'T CONVERGE 

Tue Sep 18 12:08:47.332 2012 aos.PresetAO.started - PresetAO[676] (aomode:ACE-AO,focalst:bentGregorianFront,instr:LUCIFER,wfs:FLAOWFS,so1:0,so2:0,ro1:2.16563e-06,ro2:-1.67028e-07,mag:15.1,cindex:1.89,elev:nan,rotang:nan,gravang:nan,r0:0,skybrgt:nan,windspeed:nan,winddir:nan) Tue Sep 18 12:08:47.383 2012 aos.info - WFS source set to: FLAOWFS

 it was impossible to close the active optics loop, the system couldn't converge after removing the active optics corrections from the PSFGUI. 

hard to collimate.

STOP 12:39

-- JuanGuerra - 18 Sep 2012

• second active optics failure:
  

• first active optics failure: