====== LVPS Trip monitoring in 2022 ====== From Stan: LBA33 and EBC58. Both have troubles to start MB_side bricks - see https://pcata007.cern.ch/elog/Maintenance/4980 - In LBA33 we saw HV and DIG bricks started but not MB bricks. - In EBC58 all but Dig+5 bricks started. The ATLAS detector is already closed - we have no possibility To replace LVPS until next shut down ( dec 2022) ====== LVPS Trip monitoring in 2018 ====== All manual interventions were taken from [[https://atlasop.cern.ch/elisa/display | Operation elog]] ====== LVPS Trip monitoring in 2017 ====== All manual interventions were taken from [[https://atlasop.cern.ch/elisa/display | Operation elog]] ====== LVPS Trip monitoring in 2016 ====== All manual interventions were taken from [[https://atlasop.cern.ch/elisa/display | Operation elog]] ====== LVPS Trip monitoring in 2015 ====== Current trip status is given on [[https://atlaswww.hep.anl.gov/asc/TileCal/EventReporterLVPS/| trip monitoring chart]]. All manual interventions are removed based on the table shown below. | Module | Trip time | Symptom, problem found | DCS image | |EBC10| 2015.07.05 06:19.16 | trip? https://atlasop.cern.ch/elisa/display/267540| |EBC22|2015-06-12 10:36:28|NOT a real trip. Automatic Power Cycle on EBC22, asked by DAQ System https://atlasop.cern.ch/elisa/display/264611| |LBA43|2015-05-12 16:54:12|NOT a real trip. Intervention was necessary to reboot the server which handles the ELMB monitoring - the detector was all the time ON (Filipe e-mail)| |LBA47|2015-04-29 09:56:12|NOT a real trip. Did TileMB test which turned off and then turned on the module https://atlasop.cern.ch/elisa/display/259446| |LBA37|2015-04-28 13:33:51|NOT a real trip. Power-cycled to verify deskew adjustment https://atlasop.cern.ch/elisa/display/259331| |LBC12|2015-04-28 13:31:01|NOT a real trip. Power-cycled to verify deskew adjustment https://atlasop.cern.ch/elisa/display/259331| |LBA07|2015-04-28 13:30:11|NOT a real trip. Power-cycled to verify deskew adjustment https://atlasop.cern.ch/elisa/display/259331| |EBA19|2015-04-28 13:22:03|NOT a real trip. Power-cycled to verify deskew adjustment https://atlasop.cern.ch/elisa/display/259331| |LBC24|2015-04-28 13:16:51|NOT a real trip. Power-cycled to verify deskew adjustment https://atlasop.cern.ch/elisa/display/259331| |EBC62| 2015-04-22 11:18:28 | NOT a real trip, EBC62 was power-cycled requested by DCS to fix timing jump (power-cycled https://atlasop.cern.ch/elisa/display/258617 ; timing jump https://atlasop.cern.ch/elisa/display/258618) | |LBC18|2015-04-22 11:19:31|NOT a real trip. Power-cycled https://atlasop.cern.ch/elisa/display/258618| |EBA08|2015-04-17 22:47:27|Not a real trip, HV_830 tripped, restarted HV side https://atlasop.cern.ch/elisa/display/258168| |EBA02|2015-04-16 15:19:54|NOT a real trip, power-cycled to fix discarding events https://atlasop.cern.ch/elisa/display/257996| |EBC26| 2015-04-04 15:10:21| REAL trip https://atlasop.cern.ch/elisa/display/256790| |LBC03| 2015-04-09 06:07:10 | NOT a real trip, power cycles requested by DAQ FSM | |LBC31| 2015-04-03 10:01:31 | NOT a real trip, the module was due to discarding events and auto power-cycled many time. It was off at ~0:00 on April 3, 2015 https://atlasop.cern.ch/elisa/display/256633 and was switched on again ~13:00 on April 3, 2015 https://atlasop.cern.ch/elisa/display/256669. The problem was fixed by using 2nd readout fiber https://atlasop.cern.ch/elisa/display/256668 | |LBC31| 2015-04-03 02:00:00 | NOT a real trip, the module was due to discarding events and auto power-cycled many time. It was off on ~0:00 on April 3, 2015 https://atlasop.cern.ch/elisa/display/256633 and was switched on again ~13:00 on April 3, 2015 https://atlasop.cern.ch/elisa/display/256669. The problem was fixed by using 2nd readout fiber https://atlasop.cern.ch/elisa/display/256668 | |LBC31| 2015-04-02 21:01:49 | NOT a real trip, power-cycled to fix 100% discarding events https://atlasop.cern.ch/elisa/display/256626. It was switched off ~0:00 on April 03, 2015 https://atlasop.cern.ch/elisa/display/256633| |LBC31|2015-04-02 12:18:09| NOT a real trip, LBC31 experienced multiple auto power cycle during 2014-04-02 until it turned off https://atlasop.cern.ch/elisa/display/256633 | | LBC31 | 2015-04-02 00:59:29 | NOT a real trip, power-cycled to fix 99% discarding events https://atlasop.cern.ch/elisa/display/256502 | | EBA11 | 2015-03-31 23:35:39 |NOT a real trip, power cycled https://atlasop.cern.ch/elisa/display/256382 | | | LBC11 | 2015-03-31 10:22:27 |NOT a real trip, power cycles requested by DAQ FSM| | | EBC10 | 2015-03-25 11:57:07 |REAL trip https://atlasop.cern.ch/elisa/display/255607 | | | EBC25 | 2015-03-25 01:45:56 |NOT a real trip. Power-cycled due to lost CAN-bus communication https://atlasop.cern.ch/elisa/display/255559| | | EBC26 | 2015-03-19 08:08:17 |REAL trip https://atlasop.cern.ch/elisa/display/254713 | | | EBC10 | 2015-03-13 23:18:49 |REAL trip https://atlasop.cern.ch/elisa/display/254196 | | | LBC20 | 2015-03-11 10:14:45 |NOT a real trip. HV_Micro reset ( by LVforHV PWR cycle) to fix HV on PMT42 https://atlasop.cern.ch/elisa/display/253653 | | | EBC56 | 2015-03-10 13:23:45 |NOT a real trip. EBC56 was power cycled due to "No communication" with HV-Micro inside drawer (issue also reported by the OPCUA server) https://atlasop.cern.ch/elisa/display/253516 | | | LBA47 | 2015-03-09 16:00:02 |NOT a real trip. Performed several tests for debugging the synchronization problem. The module was switched on and off during test. https://atlasop.cern.ch/elisa/display/253373| | | LBA05 | 2015-03-06 12:56:09 |NOT a real trip. Performed MinBias test and module was power-cycled https://atlasop.cern.ch/elisa/display/252976| | ====== LVPS Trip monitoring in 2014 ====== LVPS trip monitoring program: [[https://atlaswww.hep.anl.gov/asc/TileCal/EventReporterLVPS/]] | Module | Trip time | Last installation before trip, box number | Symptom, problem found | DCS image | | EBC56 | 2014-01-16 21:50:26 | | | tripped by -15V_HV, 5V_HV Vout = 0 at ~21:50 pm but Iout didn't change until ~10:40 pm {{:tilecal:ebc56_21h_jan16_2014.pdf|}} | | LBA53 | 2014-01-14 22:08:17 | 19-NOV-13, 543 | | {{:tilecal:lba53_22h_jan14_2014.pdf|}}| Note: we have masked dead EBC42 since it is not accessible at this moment Also look at [[https://pcata007.cern.ch/elog/Maintenance/ | Maintenance elog]] and [[https://atlasop.cern.ch/elisa/display | Operation elog]] ====== History ====== [[tilecal:lvpstripmonitoring2013| History of 2013]] ====== Useful notes ====== * Offline LVPS trip monitoring. Software implementation / Chekanov, S (ANL); Norberg, S (ANL/University of Oklahoma); Proudfoot, J (ANL) ATL-COM-TILECAL-2011-020.- Geneva : CERN, 2011 - 7 p.http://cdsweb.cern.ch/record/1228921?ln=en * Analysis of TileCal fLVPS Trip Characteristics / Chekanov, S (ANL); Norberg, S (ANL/University of Oklahoma); Proudfoot, J (ANL) ATL-COM-TILECAL-2011-019.- Geneva : CERN, 2011 - 11 p.ttp://cdsweb.cern.ch/record/1211303?ln=en Local copy: {{:tilecal:lvpsnote.pdf|}}