Unit A: cooling failure (started to NOT chill and after the FLUX dropped to 0)

housekeeper.R |WAR| 1181290|2011-08-31 16:49:40.898774| FUNCTWARNING > FunctWarning SWITCHSTRATIXTEMP-0000 57.875
housekeeper.R |ERR| 1181291|2011-08-31 16:49:40.901267| FUNCTEMERGENCYST > FLUXRATEIN-0000 = 0.006506 [Funct.cpp:94]
housekeeper.R |INF| 1181292|2011-08-31 16:49:40.901307| ADAM > Adam: disabling coils...
housekeeper.R |INF| 1181293|2011-08-31 16:49:40.902031| ADAM > Adam: coils succesfully disabled
housekeeper.R |INF| 1181294|2011-08-31 16:49:40.902050| FUNCTEMERGENCYST > [FunctEmergencyStop] try to send Alert to AdSec Arbitrator [Funct.cpp:123]
housekeeper.R |INF| 1181295|2011-08-31 16:49:40.902144| FUNCTEMERGENCYST > [FunctEmergencyStop] Alert to AdSec Arbitrator succesfully sent! [Funct.cpp:133]
housekeeper.R |INF| 1181296|2011-08-31 16:49:41.917276| MAIN > forcing telemetry output due to dump signal [HouseKeeper.cpp]
housekeeper.R |INF| 1181342|2011-08-31 16:49:42.426583| FAST > Processed 1 cycles of 22441 vars in 1.56 s ( 0.641 Hz). HW frame rate 0.641 [DiagnApp.cpp:838]
housekeeper.R |WAR| 1181343|2011-08-31 16:49:42.455760| FUNCTWARNING > FunctWarning BCUSTRATIXTEMP-0001 53.3125
housekeeper.R |ERR| 1181344|2011-08-31 16:49:42.455809| FUNCTEMERGENCYST > BCUSTRATIXTEMP-0003 = 55.125 [Funct.cpp:94]
housekeeper.R |INF| 1181345|2011-08-31 16:49:42.455889| ADAM > Adam: disabling coils...
housekeeper.R |INF| 1181346|2011-08-31 16:49:42.456563| ADAM > Adam: coils succesfully disabled
housekeeper.R |INF| 1181347|2011-08-31 16:49:42.456578| ADAM > Adam: disabling main power...
housekeeper.R |INF| 1181348|2011-08-31 16:49:42.457254| ADAM > Adam: main power succesfully disabled

Unit B: (NOTE: time is 5 hours BEFORE UT ---> issuetrack)

housekeeper.L |ERR| 317762|2011-08-31 11:49:07.733848| FUNCTEMERGENCYST > SWITCHSTRATIXTEMP-0000 = 65.0625 [Funct.cpp:94]
housekeeper.L |INF| 317763|2011-08-31 11:49:07.753773| ADAM > Adam: disabling coils...
housekeeper.L |INF| 317764|2011-08-31 11:49:07.754487| ADAM > Adam: coils succesfully disabled
housekeeper.L |INF| 317765|2011-08-31 11:49:07.754512| ADAM > Adam: disabling main power...
housekeeper.L |INF| 317766|2011-08-31 11:49:07.755186| ADAM > Adam: main power succesfully disabled
housekeeper.L |INF| 317767|2011-08-31 11:49:07.755202| FUNCTEMERGENCYST > [FunctEmergencyStop] try to send Alert to AdSec Arbitrator [Funct.cpp:123]
housekeeper.L |INF| 317768|2011-08-31 11:49:07.755581| FUNCTEMERGENCYST > [FunctEmergencyStop] Alert to AdSec Arbitrator succesfully sent! [Funct.cpp:129]
housekeeper.L |WAR| 317769|2011-08-31 11:49:07.755638| FUNCTWARNING > FunctWarning SWITCHPOWERTEMP-0000 56.875
housekeeper.L |INF| 317770|2011-08-31 11:49:08.774917| MAIN > forcing telemetry output due to dump signal [HouseKeeper.cpp]
housekeeper.L |INF| 317812|2011-08-31 11:49:09.158937| MAIN > forcing telemetry output due to dump signal [HouseKeeper.cpp]
housekeeper.L |INF| 317854|2011-08-31 11:49:09.534589| MAIN > dumpadsecdiagnhistory sent to masterdiagnostic [HouseKeeper.cpp:2885]

actuator 528DSP jumping to 20cm at horizon. removed.

Flux meter: 11.3 secondary and 14.5 tot.

TSS module replaced with spare. The TSS problem not disappeared, same behavior.

housekeeper.R |INF| 1215870|2011-08-31 20:52:06.605222| FAST > Processed 1 cycles of 22441 vars in 1.41 s ( 0.709 Hz). HW frame rate 0.709 [DiagnApp.cpp:838]
housekeeper.R |INF| 1215898|2011-08-31 20:52:08.027379| FAST > Processed 1 cycles of 22441 vars in 1.42 s ( 0.703 Hz). HW frame rate 0.703 [DiagnApp.cpp:838]
housekeeper.R |WAR| 1215899|2011-08-31 20:52:08.060675| FUNCTWARNING > FunctWarning EXTERNALTEMPERATURE-0000 23.575
housekeeper.R |INF| 1215941|2011-08-31 20:52:09.496745| FAST > Processed 1 cycles of 22441 vars in 1.47 s ( 0.681 Hz). HW frame rate 0.681 [DiagnApp.cpp:838]
housekeeper.R |ERR| 1215942|2011-08-31 20:52:10.499351| MAIN > Error reading BCUs: [CommandSenderTimeoutException] Timeout expired [HouseKeeper.cpp:2630]
housekeeper.R |ERR| 1215943|2011-08-31 20:52:12.504169| MAIN > Error reading BCUs: [CommandSenderTimeoutException] Timeout expired [HouseKeeper.cpp:2630]
housekeeper.R |ERR| 1215944|2011-08-31 20:52:14.508094| MAIN > Error reading BCUs: [CommandSenderTimeoutException] Timeout expired [HouseKeeper.cpp:2630]

At this time the BCU5 start NOT RESPONDING.

housekeeper.R |WAR| 1220039|2011-08-31 21:47:13.089986| FUNCTWARNING > FunctWarning BCUSTRATIXTEMP-0003 48.4375
housekeeper.R |INF| 1220067|2011-08-31 21:47:14.398854| FAST > Processed 1 cycles of 22441 vars in 1.34 s ( 0.746 Hz). HW frame rate 0.746 [DiagnApp.cpp:838]
housekeeper.R |INF| 1220095|2011-08-31 21:47:15.743278| FAST > Processed 1 cycles of 22441 vars in 1.34 s ( 0.744 Hz). HW frame rate 0.744 [DiagnApp.cpp:838]
housekeeper.R |ERR| 1220096|2011-08-31 21:47:16.746598| MAIN > Error reading BCUs: [CommandSenderTimeoutException] Timeout expired

[HouseKeeper.cpp:263

UNIT A:

Maybe restarted few seconds???

Restarted unit A after cooling loss auto power off.

fastdiagn.R |INF| 1875740|2011-08-31 16:49:42.361731| FAST > Processed 49 cycles of 7634 vars in 1 s ( 49 Hz). HW frame rate 50 [DiagnApp.cpp:838]
fastdiagn.R |WAR| 1875752|2011-08-31 16:49:44.646433| MAIN > Timeout - Will emergencyReact next loop [FastDiagnostic.cpp:1093]

housekeeper.R |INF| 1181350|2011-08-31 16:49:42.457416| FUNCTEMERGENCYST > [FunctEmergencyStop] Alert to AdSec Arbitrator succesfully sent! [Funct.cpp:129]
housekeeper.R |INF| 1181351|2011-08-31 16:49:43.474295| MAIN > forcing telemetry output due to dump signal [HouseKeeper.cpp]
housekeeper.R |INF| 1181397|2011-08-31 16:49:43.941770| FAST > Processed 1 cycles of 22441 vars in 1.52 s ( 0.66 Hz). HW frame rate 0.66 [DiagnApp.cpp:838]
housekeeper.R |ERR| 1181398|2011-08-31 16:49:44.943511| MAIN > Error reading BCUs: [CommandSenderTimeoutException] Timeout expired [HouseKeeper.cpp:2630]

All good until 20:52:10: BCU crate #5 died. (was working from 20:33:20.339654 UT)

LOG:

fastdiagn.R |INF| 2039255|2011-08-31 20:52:07.862933| FAST > Processed 50 cycles of 7634 vars in 1.02 s ( 48.9 Hz). HW frame rate 49.9 [DiagnApp.cpp:838]
fastdiagn.R |WAR| 2039256|2011-08-31 20:52:10.103344| MAIN > Timeout - Will emergencyReact next loop [FastDiagnostic.cpp:1093]
fastdiagn.R |WAR| 2039257|2011-08-31 20:52:12.104097| MAIN > Timeout - Will emergencyReact now [FastDiagnostic.cpp:1088]

housekeeper.R |WAR| 1215899|2011-08-31 20:52:08.060675| FUNCTWARNING > FunctWarning EXTERNALTEMPERATURE-0000 23.575
housekeeper.R |INF| 1215941|2011-08-31 20:52:09.496745| FAST > Processed 1 cycles of 22441 vars in 1.47 s ( 0.681 Hz). HW frame rate 0.681 [DiagnApp.cpp:838]
housekeeper.R |ERR| 1215942|2011-08-31 20:52:10.499351| MAIN > Error reading BCUs: [CommandSenderTimeoutException] Timeout expired [HouseKeeper.cpp:2630]
housekeeper.R |ERR| 1215943|2011-08-31 20:52:12.504169| MAIN > Error reading BCUs: [CommandSenderTimeoutException] Timeout expired [HouseKeepe

Tested in DEFAULT configuration: no update, crate #5 continues to be not recheable.

Powered back at 7 UT. all working. What happened?????? Nobody knows.

UNIT B - resume:

Vulcano effect around actuator 390 . removed from ICC the actuators AROUND: 380 387 389 391 + 386
Vulcano effect around actuator 237, removed from ICC the actuators AROUND 235, 233, 238 (236 was previously removed from control)

Actuator DSP528/MIR178 removed. No in the previous Arcetri/Mario list.

First interferometer alignment.

3+horiz Slew test from 90 to 30 starting @ Thu Sep 1 06:15:30 UT

x, around 528 to be analized., x-x ok (breathing around 390)

Test end @ Thu Sep 1 06:30:15 UT 2011

DSP170/MIR313 removed from control loop (was removed from ICC). Not in the previous bad lists of Arcetri nor Microgate

-- MarcoXompero - 31 Aug 2011
Topic revision: r7 - 01 Sep 2011, MarcoXompero
This site is powered by FoswikiCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding Foswiki? Send feedback