Fault unit A: system sudden power off @ 09:53 without reason.

Verified:

Housekeeper not powered off system

FastDiagnostic not powered off the system

No power plant shutdown

Adam out MAin power on but no log availlable.

MIRRORCTRL00 |WAR| 52|2009-11-02 09:40:41.495642| MAIN > Watchdog to ADAM is disabled
...

MIRRORCTRL00 |INF| 781819|2009-11-02 09:53:53.546728| BCUCOMMANDHANDLE > BcuCommandHandler 2_P3 handling request...
MIRRORCTRL00 |DEB| 781820|2009-11-02 09:53:53.546740| BCUCOMMANDHANDLE > Setting BcuRequestInfo for BCUCOMMANDHANDLER [2_P3]
MIRRORCTRL00 |DEB| 781821|2009-11-02 09:53:53.546753| MAIN > BcuRequestInfo initialized:
MIRRORCTRL00 |DEB| 781822|2009-11-02 09:53:53.546764| MAIN > > OpCode: 148
MIRRORCTRL00 |DEB| 781823|2009-11-02 09:53:53.546776| MAIN > > Flags: 1
MIRRORCTRL00 |DEB| 781824|2009-11-02 09:53:53.546787| MAIN > > Bcu: 2 first, 2 last
MIRRORCTRL00 |DEB| 781825|2009-11-02 09:53:53.546798| MAIN > > Dsp: 255 first, 255 last
MIRRORCTRL00 |DEB| 781826|2009-11-02 09:53:53.546810| MAIN > > Address: 229376 dword, 917504 bytes
MIRRORCTRL00 |DEB| 781827|2009-11-02 09:53:53.546821| MAIN > > Size: 174 dword, 696 bytes
MIRRORCTRL00 |DEB| 781828|2009-11-02 09:53:53.546832| MAIN > > Full size: 174 dword, 696 bytes
MIRRORCTRL00 |DEB| 781829|2009-11-02 09:53:53.546849| MAIN > shm ID: 37912590
MIRRORCTRL00 |DEB| 781830|2009-11-02 09:53:53.546866| MAIN > > Packets: 2 (for each BCU)
MIRRORCTRL00 |DEB| 781831|2009-11-02 09:53:53.546896| MAIN > > Packets tot: 2
MIRRORCTRL00 |DEB| 781832|2009-11-02 09:53:53.546914| BCUCOMMANDHANDLE > Request flags: 1 (WANTREPLY=1, ASQUADWORD=2)
MIRRORCTRL00 |DEB| 781833|2009-11-02 09:53:53.546924| BCUCOMMANDHANDLE > --> Waiting reply...
MIRRORCTRL00 |WAR| 781834|2009-11-02 09:53:53.903552| ROUNDQUEUE_BCU-3 > UdpTimeoutException:recoverTimeout
MIRRORCTRL00 |WAR| 781835|2009-11-02 09:53:53.903570| ROUNDQUEUE_BCU-3 > TIMEOUT id 140: recovering...
MIRRORCTRL00 |ERR| 781836|2009-11-02 09:53:53.903584| MAIN > ****** FAILED PACKET FROM BCU 3 ******
MIRRORCTRL00 |WAR| 781837|2009-11-02 09:53:53.903673| ROUNDQUEUE_BCU-4 > UdpTimeoutException:recoverTimeout
MIRRORCTRL00 |WAR| 781838|2009-11-02 09:53:53.903688| ROUNDQUEUE_BCU-4 > TIMEOUT id 181: recovering...
MIRRORCTRL00 |ERR| 781839|2009-11-02 09:53:53.903700| MAIN > *******
FAILED PACKET FROM BCU 4 ******
MIRRORCTRL00 |WAR| 781840|2009-11-02 09:53:53.903777| ROUNDQUEUE_BCU-5 > UdpTimeoutException:recoverTimeout
MIRRORCTRL00 |WAR| 781841|2009-11-02 09:53:53.903791| ROUNDQUEUE_BCU-5 > TIMEOUT id 113: recovering...
MIRRORCTRL00 |ERR| 781842|2009-11-02 09:53:53.903804| MAIN > *******
FAILED PACKET FROM BCU 5 ******
MIRRORCTRL00 |WAR| 781843|2009-11-02 09:53:53.903877| ROUNDQUEUE_BCU-6 > UdpTimeoutException:recoverTimeout
MIRRORCTRL00 |WAR| 781844|2009-11-02 09:53:53.903891| ROUNDQUEUE_BCU-6 > TIMEOUT id 195: recovering...
MIRRORCTRL00 |ERR| 781845|2009-11-02 09:53:53.903903| MAIN > *******
FAILED PACKET FROM BCU 6 ******
MIRRORCTRL00 |WAR| 781846|2009-11-02 09:53:53.903976| ROUNDQUEUE_BCU-7 > UdpTimeoutException:recoverTimeout
MIRRORCTRL00 |WAR| 781847|2009-11-02 09:53:53.903990| ROUNDQUEUE_BCU-7 > TIMEOUT id 205: recovering...
MIRRORCTRL00 |ERR| 781848|2009-11-02 09:53:53.904002| MAIN > *******
FAILED PACKET FROM BCU 7 ******
MIRRORCTRL00 |WAR| 781849|2009-11-02 09:53:53.904531| ROUNDQUEUE_BCU-8 > UdpTimeoutException:recoverTimeout
MIRRORCTRL00 |WAR| 781850|2009-11-02 09:53:53.904545| ROUNDQUEUE_BCU-8 > TIMEOUT id 198: recovering...
MIRRORCTRL00 |ERR| 781851|2009-11-02 09:53:53.904557| MAIN > *******
FAILED PACKET FROM BCU 8 *******
MIRRORCTRL00 |ERR| 781852|2009-11-02 09:53:53.904617| BCUCOMMANDHANDLE > BcuCommandHandler::handleBcuReply: REQUEST COMPLETED but FAILED :-(
MIRRORCTRL00 |DEB| 781853|2009-11-02 09:53:53.904650| BCUCOMMANDHANDLE > Clearing BcuRequestInfo for BCUCOMMANDHANDLER [ID:3_P3]
MIRRORCTRL00 |INF| 781854|2009-11-02 09:53:53.904673| MAIN > BcuRequestInfo cleared (detached from shm) !!!
MIRRORCTRL00 |INF| 781855|2009-11-02 09:53:53.904687| BCUCOMMANDHANDLE > --------------------------------------------------------------------------------

FASTDGN00 |INF| 15924|2009-11-02 09:53:48.714643| FAST > Processed 51 cycles of 7637 vars in 1.02 s ( 49.9 Hz). HW frame rate 49.9
[DiagnApp.cpp:720]
FASTDGN00 |INF| 15925|2009-11-02 09:53:49.712395| FAST > Processed 50 cycles of 7637 vars in 0.998 s ( 50.1 Hz). HW frame rate 50.1
[DiagnApp.cpp:720]
FASTDGN00 |WAR| 15926|2009-11-02 09:53:51.453694| MAIN > Timeout - Will emergencyReact next loop [FastDiagnostic.cpp:836]
FASTDGN00 |WAR| 15927|2009-11-02 09:53:52.454567| MAIN > Timeout - Will emergencyReact now [FastDiagnostic.cpp:833]
FASTDGN00 |WAR| 15928|2009-11-02 09:53:52.454586| MAIN > emergencyReact: going to disable coils [FastDiagnostic.cpp:196]
FASTDGN00 |INF| 15929|2009-11-02 09:53:52.454602| ADAM > Adam: disabling coils...
FASTDGN00 |DEB| 15930|2009-11-02 09:53:52.454672| ADAM > Command to Adam: #011300
FASTDGN00 |DEB| 15931|2009-11-02 09:53:52.455268| ADAM > Answer from Adam: 01^M#011300
FASTDGN00 |INF| 15932|2009-11-02 09:53:52.455291| ADAM > Adam: coils succesfully disabled

HOUSEKEEPER |INF| 97548|2009-11-02 09:53:50.545729| CONFIG-LOADER > Getting configuration file '/usr/local/adopt/conf/left/mirrorctrl_adsec.conf'
HOUSEKEEPER |INF| 97549|2009-11-02 09:53:50.545778| CONFIG-LOADER > LBT SIDE: L
HOUSEKEEPER |INF| 97550|2009-11-02 09:53:50.546058| CONFIG-LOADER > Dict of size 31 created from conf/left/mirrorctrl_adsec.conf
HOUSEKEEPER |INF| 97551|2009-11-02 09:53:50.546115| MAIN > Reading DSP [255-255] from BCU_SWITCH [HouseKeeper.cpp:2161]
HOUSEKEEPER |DEB| 97552|2009-11-02 09:53:50.546130| MAIN > CommandSender::sendMultiBcuCommand: SEQ request
HOUSEKEEPER |DEB| 97553|2009-11-02 09:53:50.546140| MAIN > CommandSender::sendMultiBcuCommand: allocating shm...
HOUSEKEEPER |DEB| 97554|2009-11-02 09:53:50.546170| MAIN > CommandSender::sendMultiBcuCommand: shm allocated !!!
HOUSEKEEPER |DEB| 97555|2009-11-02 09:53:50.546191| MAIN > sendMultiBcuCommand: shared memory cleaned
HOUSEKEEPER |DEB| 97556|2009-11-02 09:53:50.546234| MAIN > sendMultiBcuCommand: REPLY EXPECTED !!!
HOUSEKEEPER |ERR| 97557|2009-11-02 09:53:51.548785| MAIN > Error reading BCUs: [CommandSenderTimeoutException] 02/11/2009 09:53:51.548614 Timeout expired [HouseKeeper.cpp:2186]

Fault unit A: system sudden power off @ 09:53 without reason.

Verified:

Housekeeper not powered off system

FastDiagnostic not powered off the system

No power plant shutdown

MIRRORCTRL00 |WAR| 52|2009-11-02 09:40:41.495642| MAIN > Watchdog to ADAM is disabled
...

MIRRORCTRL00 |INF| 781819|2009-11-02 09:53:53.546728| BCUCOMMANDHANDLE > BcuCommandHandler 2_P3 handling request...
MIRRORCTRL00 |DEB| 781820|2009-11-02 09:53:53.546740| BCUCOMMANDHANDLE > Setting BcuRequestInfo for BCUCOMMANDHANDLER [2_P3]
MIRRORCTRL00 |DEB| 781821|2009-11-02 09:53:53.546753| MAIN > BcuRequestInfo initialized:
MIRRORCTRL00 |DEB| 781822|2009-11-02 09:53:53.546764| MAIN > > OpCode: 148
MIRRORCTRL00 |DEB| 781823|2009-11-02 09:53:53.546776| MAIN > > Flags: 1
MIRRORCTRL00 |DEB| 781824|2009-11-02 09:53:53.546787| MAIN > > Bcu: 2 first, 2 last
MIRRORCTRL00 |DEB| 781825|2009-11-02 09:53:53.546798| MAIN > > Dsp: 255 first, 255 last
MIRRORCTRL00 |DEB| 781826|2009-11-02 09:53:53.546810| MAIN > > Address: 229376 dword, 917504 bytes
MIRRORCTRL00 |DEB| 781827|2009-11-02 09:53:53.546821| MAIN > > Size: 174 dword, 696 bytes
MIRRORCTRL00 |DEB| 781828|2009-11-02 09:53:53.546832| MAIN > > Full size: 174 dword, 696 bytes
MIRRORCTRL00 |DEB| 781829|2009-11-02 09:53:53.546849| MAIN > shm ID: 37912590
MIRRORCTRL00 |DEB| 781830|2009-11-02 09:53:53.546866| MAIN > > Packets: 2 (for each BCU)
MIRRORCTRL00 |DEB| 781831|2009-11-02 09:53:53.546896| MAIN > > Packets tot: 2
MIRRORCTRL00 |DEB| 781832|2009-11-02 09:53:53.546914| BCUCOMMANDHANDLE > Request flags: 1 (WANTREPLY=1, ASQUADWORD=2)
MIRRORCTRL00 |DEB| 781833|2009-11-02 09:53:53.546924| BCUCOMMANDHANDLE > --> Waiting reply...
MIRRORCTRL00 |WAR| 781834|2009-11-02 09:53:53.903552| ROUNDQUEUE_BCU-3 > UdpTimeoutException:recoverTimeout
MIRRORCTRL00 |WAR| 781835|2009-11-02 09:53:53.903570| ROUNDQUEUE_BCU-3 > TIMEOUT id 140: recovering...
MIRRORCTRL00 |ERR| 781836|2009-11-02 09:53:53.903584| MAIN > ****** FAILED PACKET FROM BCU 3 ******
MIRRORCTRL00 |WAR| 781837|2009-11-02 09:53:53.903673| ROUNDQUEUE_BCU-4 > UdpTimeoutException:recoverTimeout
MIRRORCTRL00 |WAR| 781838|2009-11-02 09:53:53.903688| ROUNDQUEUE_BCU-4 > TIMEOUT id 181: recovering...
MIRRORCTRL00 |ERR| 781839|2009-11-02 09:53:53.903700| MAIN > *******
FAILED PACKET FROM BCU 4 ******
MIRRORCTRL00 |WAR| 781840|2009-11-02 09:53:53.903777| ROUNDQUEUE_BCU-5 > UdpTimeoutException:recoverTimeout
MIRRORCTRL00 |WAR| 781841|2009-11-02 09:53:53.903791| ROUNDQUEUE_BCU-5 > TIMEOUT id 113: recovering...
MIRRORCTRL00 |ERR| 781842|2009-11-02 09:53:53.903804| MAIN > *******
FAILED PACKET FROM BCU 5 ******
MIRRORCTRL00 |WAR| 781843|2009-11-02 09:53:53.903877| ROUNDQUEUE_BCU-6 > UdpTimeoutException:recoverTimeout
MIRRORCTRL00 |WAR| 781844|2009-11-02 09:53:53.903891| ROUNDQUEUE_BCU-6 > TIMEOUT id 195: recovering...
MIRRORCTRL00 |ERR| 781845|2009-11-02 09:53:53.903903| MAIN > *******
FAILED PACKET FROM BCU 6 ******
MIRRORCTRL00 |WAR| 781846|2009-11-02 09:53:53.903976| ROUNDQUEUE_BCU-7 > UdpTimeoutException:recoverTimeout
MIRRORCTRL00 |WAR| 781847|2009-11-02 09:53:53.903990| ROUNDQUEUE_BCU-7 > TIMEOUT id 205: recovering...
MIRRORCTRL00 |ERR| 781848|2009-11-02 09:53:53.904002| MAIN > *******
FAILED PACKET FROM BCU 7 ******
MIRRORCTRL00 |WAR| 781849|2009-11-02 09:53:53.904531| ROUNDQUEUE_BCU-8 > UdpTimeoutException:recoverTimeout
MIRRORCTRL00 |WAR| 781850|2009-11-02 09:53:53.904545| ROUNDQUEUE_BCU-8 > TIMEOUT id 198: recovering...
MIRRORCTRL00 |ERR| 781851|2009-11-02 09:53:53.904557| MAIN > *******
FAILED PACKET FROM BCU 8 *******
MIRRORCTRL00 |ERR| 781852|2009-11-02 09:53:53.904617| BCUCOMMANDHANDLE > BcuCommandHandler::handleBcuReply: REQUEST COMPLETED but FAILED :-(
MIRRORCTRL00 |DEB| 781853|2009-11-02 09:53:53.904650| BCUCOMMANDHANDLE > Clearing BcuRequestInfo for BCUCOMMANDHANDLER [ID:3_P3]
MIRRORCTRL00 |INF| 781854|2009-11-02 09:53:53.904673| MAIN > BcuRequestInfo cleared (detached from shm) !!!
MIRRORCTRL00 |INF| 781855|2009-11-02 09:53:53.904687| BCUCOMMANDHANDLE > --------------------------------------------------------------------------------

FASTDGN00 |INF| 15924|2009-11-02 09:53:48.714643| FAST > Processed 51 cycles of 7637 vars in 1.02 s ( 49.9 Hz). HW frame rate 49.9
[DiagnApp.cpp:720]
FASTDGN00 |INF| 15925|2009-11-02 09:53:49.712395| FAST > Processed 50 cycles of 7637 vars in 0.998 s ( 50.1 Hz). HW frame rate 50.1
[DiagnApp.cpp:720]
FASTDGN00 |WAR| 15926|2009-11-02 09:53:51.453694| MAIN > Timeout - Will emergencyReact next loop [FastDiagnostic.cpp:836]
FASTDGN00 |WAR| 15927|2009-11-02 09:53:52.454567| MAIN > Timeout - Will emergencyReact now [FastDiagnostic.cpp:833]
FASTDGN00 |WAR| 15928|2009-11-02 09:53:52.454586| MAIN > emergencyReact: going to disable coils [FastDiagnostic.cpp:196]
FASTDGN00 |INF| 15929|2009-11-02 09:53:52.454602| ADAM > Adam: disabling coils...
FASTDGN00 |DEB| 15930|2009-11-02 09:53:52.454672| ADAM > Command to Adam: #011300
FASTDGN00 |DEB| 15931|2009-11-02 09:53:52.455268| ADAM > Answer from Adam: 01^M#011300
FASTDGN00 |INF| 15932|2009-11-02 09:53:52.455291| ADAM > Adam: coils succesfully disabled

-- MarcoXompero - 2009-11-02
Topic revision: r1 - 02 Nov 2009, MarcoXompero
This site is powered by FoswikiCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding Foswiki? Send feedback