AGW Commissioning and LUCIFER Commissioning on 12-13 September 2008
Observers: J. Hill, N. Ageorges, W. Seifert, and numerous other LUCIFERians on mtn
More Observers: D. Miller and A. Rakich in Tucson
Software Support: N. Cushing on mtn
Telescope Operators: D. Gonzalez Huerta and W. Wack
The last of the clouds cleared away just after sunset. It was clear the rest of the night. Seeing was poor at first with everything out of
temperature equilibrium. Our first significant problem was that when authorized as LUCIFER, we don't find off-axis guide stars.
A guide star 90 sec due south of the target lands at the very upper right corner off the acquisition image (an error of ~15 arcsec in 90 sec).
The corresponding error when authorized at IRTC is a factor of 4-5 smaller. ??? The only differences in the PCSInstrument.conf file is that
IRTC has wavelength 1.4 versus LUCIFER 1.5, and LUCIFER has the -1.5 deg LEFTIAA term which isn't nearly large enough to cause this effect.
We lost more than half the night to various telescope failures. One of the chillers in the utility bldg failed. We limped along through
the second half without mirror ventilation and with big fans blowing hot air out of the computer room.
We got some WFS checking done. GCS active optics does now collimate the telescope on/off-axis.
MCSPU (Jet) crashed 3 times losing another 3 hours of time. There were various other minor problems mixed in with these.
We had lots of problems finding the star. Partly this is due to the changing temperature gradient of the telescope structure, partly due
to many restarts of MCSPU and PCS, and partly due to the problem with the off-axis probe position for LUCIFER.
After many days of rain, the sky is clearing off.
00:05 Start mirror ventilation with manual setpoint of 9 degC.
01:08 Open facing east for pre-sunset sky flats. T=7degC, D=5degC, wind light from SW, sky mostly clear with dissipating cumulus clouds.
02:01 Close for fog / low clouds blowing over the mountain.
02:20 Fog is gone, and humidity is down, so we prepare to reopen as soon as Nancy and Peter have checked the window ventilation.
02:28 Open shutter doors again. T=7 degC D=-3 degC.
02:35 First preset fails to find star
02:42 Send again with typo in the guide star coordinates corrected.
02:49 Move guide probe on-axis and adjust IE=-107 CA=-46
02:52 Restart GCSL after John's still running readGuideCam loop crashed it.
02:53 Back to Nancy's original off-axis preset. A star is there on-axis.
03:00 Adjust IE/CA on the off-axis star (maybe not a good plan) IE=-118 CA=-42
03:05 Preset in guide mode, fails with jump?
03:07 Preset fails for OSS not running. Then still can't find the star that we see in the acquisition image.
03:11 Preset to guide on-axis. no star
03:12 Preset to guide on-axis again with IE=-107 CA=-46 - Conclude that our initial centering was on the
Restore IE=-90 CA=-60
03:19 Find a new star on-axis IE=-123 CA=-83
03:20 Preset Active on-axis. WFS is saturated, setWFSExpTime 15000
03:25 Preset Active off-axis. no star
Problem with position probe on off-axis star
03:32 Preset back to the on-axis star, and let WFS converge. LUCIFER is taking images at each position.
03:35 Preset 30 arcsec South, using the same star for guiding. (found star at 351, 359)
03:40 Preset 60 arcsec South, but star is now up in the corner of the acquisition image. Vibration made some cigar images for some seconds.
One of the 45degF chillers has tripped off. David resets it several times during the evening.
03:50 Preset 90 arcsec South, star at 471,473, missed on first guide image, but pulled it in. Preset succeeded despite the following error.
Sep 12 20:40:54 lbtmu107 LBT_left_GCS: TCPSocket::recv error: Transport endpoint is not connected
03:57 Preset 120 arcsec South, star is just tucked in the corner of the acquisition image, but the guider picks it up.
04:05 LBTO@lbtmu107:24 % stopWFS
WFS loop NOT stopped!
but succeed on second try.
04:06 Doug running IDL WFS
04:09 Sent corrections to primary /Repository/AGW_Data/080913w, exp = 15 sec, wfsc 2, 3, 4,5
04:13 exp = 10 sec, 6, 7, 8 Looks like a bunch of astigmatism and coma. Try a BS star
04:14 Set mirror setpoints back to automatic (PID) mode
04:17 Authorize IRTC
04:25 pointto BS9178, TRACK, John search for star, found at offset -30 -30, and set IE=-40 and CA=-50. We think that the pointing offsets are
changing rapidly because the telescope structure is out of temperature equilibrium.
04:40 wfsc 9-15
04:49 TO apply +1000 Z7: see -600 Z7 on wfsc #16
04:51 apply corrections wfsc 17-21 Still bad
04:55 Adjust focus in AIP_L.cfg from 21 to 29 (our previous setting was overwritten by the build)
05:03 Preset to a new star
05:12 My third IRTC.offset command failed because pause guiding didn't work. Why didn't the first two fail? PA on Guider looks OK.
05:17 pointto GUIDE, found star at 286,213
David reset 45degF chiller for the third time.
05:27 apply z15 -200 see ~+100 change on wfsc to ~0
05:30 apply z14 100 see +40 change to +80
05:34 apply z14 -300 (-200 from original) see
05:37 -300 doesn't look better
05:40 -300 doesn't look better, driving wrong axis, z14 -210
05:42 +500 z14 -60
05:45 +800 z14 +140
05:49 -500 z14 to 6
05:50 z25 +200 can not tell difference #37
05:55 z25 -400 can not tell difference #38
05:57 back to original wfsc 39-42
Took LUCIFER image here
06:00 BS9183 gstar=51, didn't find guide star
06:01 TRACK, found star at 455,128, John reset IE=-29 CA -45
06:04 didn't receive full CCD readout
06:09 found star off-axis at 174,215
Nancy confirms that LUCIFER position angle rotation is correct with LEFTIAA = -1.533.
LUCIFER image luci_20080912_0110 has 0.7 arcsec images.
06:xx on-axis ??
06:17 guiderimage004215.fits off-axis GUIDE, gstar=51, not subtracting off-axis corrections. Changed IDL routines.
06:20 off-axis gstar=51, with off-axis corrections applied. collimate 49-55, found star at 166,231
Note that guide images have an upper left to lower right trend. Elevation? Vibration?
06:28 go on-axis and measure aberrations 56-58
06:35 on-axis with "ACTIVE" /tmp/wfscimage0000509-521
06:46 off-axis with "ACTIVE" 522-534, found star at 138,253 at probe position x=
LUCIFER image luci_20080912_0115
06:55 on-axis with "GUIDE" wfsc 59-61 to check the GCS off-axis result
07:02 off-axis with "ACTIVE" 0000535-545, found star at 163,115 with probe position x=102 y=513.8
LUCI image 117 is out of focus.
Beware that we have accidentally been sending the active wavefront corrections as default. Apparently all the copies of PSFGUI don't syncronize the
07:12 Authorize LUCIFER
07:15 LUCI preset to off-axis star fails to find any star at probe position x=24.6 y=527.0
07:19 LUCI preset to on-axis star fails with full MCSPU shutdown - even our window disappeared. jet has rebooted on its own as of 00:26 MST.
07:30 David has to restart the jet rpcserver (as is common after a reboot)
07:38 Back to preset (lost 20 minutes)
07:42 Back to Nancy's original object in GUIDE mode, but acquire fails, manual adjust Z global offset by 0.1 to focus.
07:47 now guiding works and locks onto one of two stars in the acquisition image.
07:52 manually dialing Active Optics corrections out of M2 while GCS WFS loop puts them into M1.
07:58 Stop SX mirror ventilation to try to keep alive longer on only one chiller
08:01 stop guiding
08:03 resend the LUCI preset, but MCSPU crashes again. Lost only 12 minutes this time, since we had a more clear idea what happened, but then
had trouble getting PCS to run correctly after restarting it so lost another 5 minutes.
Called Dan Cox (about jet)
Called Butch and John L. (about chiller),
08:16 Resend LUCIFER preset. From the sound of building moving, slew polynomials made a mistake. Failed to acquire the guide stars
08:24 Resend LUCIFER preset with PA180 - they are checking for mask alignment. (could not reach the same guide star)
08:30 Jet crashes again.
08:48 Norm presses reset button in Jet after the core dump to lbtmu102 was unsuccessful due to NMIs.
08:56 Snapshot of telescope temps (chamber was ~15 degC 10 hours ago)
Location Air Steel
C-Ring Upper 6.42 6.92
C-Ring Middle 7.53 7.97
C-Ring Lower 7.25 7.72
Extension Left 5.65 5.25 (reversed?)
Extension Right 5.43 5.52
Upper 5.02 5.95
09:00 Summer chiller CH0401 is stable at LWT of -8.44 degC (normal), but A/C in control / computer room is still overwhelmed.
09:03 Jet back online - lost 33 minutes.
09:06 LUCI preset failed because OSS not running.
09:08 LUCI preset again, failed to find off-axis star
09:14 pointto BS9188 gs=0 PA=0 TRACK move probe manually
09:18 spiral search found at -30,60 (IE CA had reverted to pointing model when we restarted PCS)
09:32 MSCPU crashed at offset -12 30 with IE=-65 CA=-25 (offset command eventually timed out in 300s)
09:42 LUCIFER taking pinhole image while telescope down, to check internal aberrations. See LUCI image 0135. Pinhole spots look OK.
10:05 Jet comes briefly back to life, but crashes again before we could even move the telescope. David goes up to give
it the full power cycle reboot.
Call Dave A. to learn howto reload rotator FPGA
Problems with frost on LUCI window
11:26 pointto BS9107 Binary IE=-65 CA=-40
11:33 pointto BS9107 ACTIVE (but forgot to stop the manual images)
Sep 13 04:33:23 lbtmu107 LBT_left_GCS: TCPSocket::recv error: Bad file descriptor
11:37 pointto again after killing GCSL
Sep 13 04:39:06 lbtmu107 LBT_left_GCS: fatal error: did not receive full CCD readout from guide camera within timeout period of 6459 ms.
11:41 pointto ACTIVE - finally succeeds, starting WFSing
LUCI image 0137
11:52 pointto again, guiding on faint star
12:00 Lucifer preset
12:04 offset -30 60 fails after the spiral.cl script was working.
12:11 IE=-35, CA=-40 from centering on LUCIFER
12:12 LUCI preset finds on-axis star 361,417
12:14 LUCI preset with guidestar 60 arcsec South
Sep 13 05:13:50 lbtmu107 LBT_left_GCS: fatal error: did not receive full CCD readout from guide camera within timeout period of 6159 ms.
happened again around 05:17
12:18 LUCI preset tracking
12:20 object moved north along columns on offset, but "E-W offsets are wierd". (confused by frost and probe)
12:29 trying N-S offsets again
12:32 trying E-W offsets again. LUCIFER offsets (from the guide paddle) work correctly in TRACK mode.
12:35 LUCI preset in guide mode, but sky too bright for this star
12:40 Close dome. T=5degC D=3degC
- 13 Sep 2008