|
|
Sunday, November 22, 2009 8:32:55 CST: General/Operations: 93922: Alex Himmel
**Comment by Alex Himmel on Sunday, November 22, 2009 8:34:18 AM CST
These images show the Wrong Datatype and Priority Truncate errors. There are lots of them (100+, 200+ respectively), and they seem to be showing up in channel 1 of many different minders.
Sunday, November 22, 2009 8:41:19 CST: General/Operations: 93923: Alex Himmel
OmCheckListFar
| Shifter | ahimmel | | at | Fermilab | | Start OM Viewer | x | | OM Status | x | | Run | 45074/16 | | ROP temperatures | OK | | Rogue crate entries | 0 | | TRC - PPS Time | OK | | TRC - Status Bit | OK | | Spars Error Code | OK | | Etc Error Code | OK | | Problems, Crate Monitor | | | Problems, Rogue Crates | | | Flat CI entries | 0 | | Problems, CI | | | Gain Curve Running | Yes | | Singles rate/Crate | OK | | Singles rate/VARC | OK | | Hot Chips | 0 | | Problems, Singles | | | Problems, Singles | | | Planes | Problem | | Hits, post-trigger | OK | | Hits, pre-trigger | OK | | Problems, Raw Digits | Still have a strange bump ~80 planes. Attaching an image in next post. | | LI East Dead | 9 | | LI East Low Eff | 535 | | LI West Dead | 2 | | LI West Low Eff | 292 | | Problems, LI | | | Rogue Pedestals | 1 | | Pedestals, Mean | OK | | Pedestals, RMS | Problem | | Problems, Pedestals | RMS: 15-1-4-1-0 | | Shield, post-trigger | OK | | Shield, pre-trigger | OK | | Problems, Veto Shield | |
Sunday, November 22, 2009 8:42:07 CST: General/Operations: 93924: Alex Himmel
Shows a small second peak around 80 planes.
Sunday, November 22, 2009 8:47:04 CST: General/Operations: 93925: Alex Himmel
Sunday, November 22, 2009 8:49:22 CST: General/Operations: 93926: Alex Himmel
BeamCheckList
| Date | 11/22/2009 | | Time | 8:47:08 | | Shifter | ahimmel | | at | Fermilab | | Intensity | 38e12 | | Configuration | L010185R | | Made Plots | x | | Plots in CRL | x | | Plots in Elog | x | | JAS Running | x | | JAS Updating | OK | | Beam In Range | OK | | JAS DeadTime | OK | | ACNET Devices | Problem | | Problems, JasDisplay | MM1 and MM2 have been in error since last night. A message has been left with the appropriate expert -- will try again later today. | | DataMonRun | YES | | Datamon Update | OK | | DataMon Green | OK | | Comments | |
Sunday, November 22, 2009 8:50:53 CST: General/Operations: 93927: Alex Himmel
DcsCheckListNear
| Date | 11/22/2009 | | Time | 8:49:40 | | Shifter | ahimmel | | at | Fermilab | | DCS webpage | x | | Check Alarms | x | | HV monitor | x | | RPS daemon | x | | RPS Warnings | | | RPS Alarms | | | Env Monitor | x | | Env Temp South | 79.1 | | Humdity | 19.3 | | Pressure | 29.8 | | Max MASTER Temp Crate | M6 | | Max MASTER Temp | 91.8 | | Max MINDER Temp Crate | V9t | | Max MINDER Temp | 87.9 | | Magnet Monitor | x | | polarity | Reverse | | Current | 4971 | | LCW Resistivity | 8.3 | | LCW Temp | 74.3 | | Pump 2 | x | | ND Timing Status | x | | GPS Live | Yes | | MCC Connected | Ok | | Goblin Status | Ok | | ND GPS Error | 200.0 | | GPS Last Spill | 55.9 ms ago | | DCS Comments | |
Sunday, November 22, 2009 8:52:21 CST: General/Operations: 93928: Alex Himmel
DcsCheckListFar
| Date | 11/22/2009 | | Time | 8:50:59 | | Shifter | ahimmel | | at | Fermilab | | DCS webpage | x | | Check Alarms | x | | HV monitor SM1 | x | | HV monitor SM2 | x | | RPS daemon | x | | Env Monitor | x | | Env Temp South | 69.7 | | Env Temp North | 68.7 | | Magnet Monitor | x | | Current, SM1 | 80.0 | | Voltage, SM1 | 247.6 | | Polarity, SM1 | REVERSE | | Current, SM2 | 79.9 | | Voltage, SM2 | 230.7 | | Polarity, SM2 | REVERSE | | T max, SM1 | 142.8 | | T max, SM2 | 146.9 | | Chiller Monitor | x | | Cold Water T, return | 57.0 | | Cold Water T, supply | 61.3 | | FD Timing Status | x | | GPS Updating | Yes | | TCU Status | Ok | | #Satellites seen | 8 | | Goblin Status | Ok | | FD GPS Error | 200.0 | | #Spills Served | 27 | | DCS Comments | |
Sunday, November 22, 2009 9:06:15 CST: General/Operations: 93929: Alex Himmel
Gabriel Nathan Perdue 9511V
Howard S Budd 1744V
Have keys 23 and 25 to work on Minerva.
**Comment by Alex Himmel on Sunday, November 22, 2009 9:06:27 AM CST
There are now 2 people underground.
Sunday, November 22, 2009 9:18:00 CST: General/Operations: 93930: Alex Himmel
Laura just called in. It appears that the problem with the muon monitors started right when they started drawing from new gas bottles, so it is likely there is some bad gas in the system.
The signals are coming down so the problem may just fix itself. If it doesn't, the solution is to change out the bottles, but there won't be anyone to do that until tomorrow in any case. So, if the problem persists until tomorrow Laura will see to fixing it.
Sunday, November 22, 2009 10:29:26 CST: General/Operations: 93931: Alex Himmel
E:MTGTDS had a beam profiles out of range error, but after a reset the error has not returned.
Sunday, November 22, 2009 10:38:57 CST: General/Operations: 93932: Alex Himmel
Keys 23 and 25 have been returned. There is now no one underground.
Sunday, November 22, 2009 15:59:46 CST: General: 93933: Justin Evans
The FD run just restarted. Upon restart, the DAQ produced a single yellow error saying
|TP0|tpTrigger|Crate 4 has 0 Sparsifier and 1 ETC errors in TF-32
(This is the beginning of run (45077/0.)
There are no other errors: data-taking looks fine.
Sunday, November 22, 2009 16:18:52 CST: General: 93934: Justin Evans
Start_Shift
| Date | 11/22/2009 | | Time | 16:16:00 | | Shifter | Justin Evans | | At | Fermilab | | Review recent CRL entries | x | | Review CRL Memopad | x | | ND Start Run Control | x | | FD Start Run Control | x | | ND Request control | x | | FD Request control | x | | ND Check Run Sequence | x | | ND Run/Subrun | 17222/6 | | FD Check Run Sequence | x | | FD Run/Subrun | 45077/0 | | ND DCS Status | x | | FD DCS Status | x | | ND Timing Status | x | | FD Timing Status | x | | MINOS Access Review | x | | TRAIN Webpage | x | | Keys in the box | 20 | | Keys out | 6 | | Key checksum | x | | Understand who is Underground | x | | Comments | The beam is on.
The muon monitors are still in error; we're waiting to see if the problem is still there in the morning. |
Sunday, November 22, 2009 16:33:47 CST: General: 93935: Justin Evans
End_Shift
| Date | 11/22/2009 | | Time | 16:32:06 | | Shifter | ahimmel | | At | Fermilab | | ND First Run/Subrun | 17219/22 | | FD First Run/Subrun | 45074/16 | | ND Last Run/Subrun | 17222/6 | | FD Last Run/Subrun | 45077/0 | | Keys in the box | 20 | | Keys out | 6 | | Key checksum | x | | Understand who is Underground | x | | Shift Summary | Quiet shift with good beam | | Problems Found | Muon monitors are in error. The appropriate experts are aware and will look into them tomorrow. | | ND Release Control | x | | FD Release Control | x |
Sunday, November 22, 2009 16:45:22 CST: General: 93936: Justin Evans
ND DAQ just showed a single orange warning message:
|tSupervisor| sntpClockUpdate SNTP update failed due to timeout, attempting retry.
(This was run 17222/6.)
|