The run control isn't showing any FD timing problems, so we're sure the timing is working. It's just the status web page that we can't see...

End_Shift

Date	11/22/2009
Time	0:21:36
Shifter	Justin
At	Fermilab
ND First Run/Subrun	17219/6
FD First Run/Subrun	45074/0
ND Last Run/Subrun	17219/14
FD Last Run/Subrun	45074/8
Keys in the box	20
Keys out	6
Key checksum	x
Understand who is Underground	x
Shift Summary	Good beam. Muon monitors went into error half way through. Day shifter should try to get hold of Laura. Cannot see FD timing webpage.
Problems Found
ND Release Control	x
FD Release Control	x

Start_Shift

Date	11/22/2009
Time	0:27:51
Shifter	cherdack
At	Fermilab
Review recent CRL entries	x
Review CRL Memopad	x
ND Start Run Control	x
FD Start Run Control	x
ND Request control	x
FD Request control	x
ND Check Run Sequence	x
ND Run/Subrun	17219/14
FD Check Run Sequence	x
FD Run/Subrun	45074/8
ND DCS Status	x
FD DCS Status	x
ND Timing Status	x
FD Timing Status	x
MINOS Access Review	x
TRAIN Webpage	x
Keys in the box	20
Keys out	6
Key checksum	x
Understand who is Underground	x
Comments

the FD timing page is back

DcsCheckListFar

Date	11/22/2009
Time	0:30:30
Shifter	cherdack
at	Fermilab
DCS webpage	x
Check Alarms	x
HV monitor SM1	x
HV monitor SM2	x
RPS daemon	x
Env Monitor	x
Env Temp South	69.7
Env Temp North	68.7
Magnet Monitor	x
Current, SM1	-80.0
Voltage, SM1	-247.6
Polarity, SM1	REVERSE
Current, SM2	-79.9
Voltage, SM2	-230.6
Polarity, SM2	REVERSE
T max, SM1	142.8
T max, SM2	146.9
Chiller Monitor	x
Cold Water T, return	57.1
Cold Water T, supply	61.3
FD Timing Status	x
GPS Updating	Yes
TCU Status	Ok
#Satellites seen	7
Goblin Status	Ok
FD GPS Error	200.0
#Spills Served	Last 60s: 27 spills recieved, 27 served, 0 missed
DCS Comments

DcsCheckListNear

Date	11/22/2009
Time	0:32:19
Shifter	cherdack
at	Fermilab
DCS webpage	x
Check Alarms	x
HV monitor	x
RPS daemon	x
RPS Warnings
RPS Alarms
Env Monitor	x
Env Temp South	79.0
Humdity	19.4
Pressure	29.7
Max MASTER Temp Crate	M6
Max MASTER Temp	91.9
Max MINDER Temp Crate	V9t
Max MINDER Temp	87.8
Magnet Monitor	x
polarity	Reverse
Current	-4973.7
LCW Resistivity	8.3
LCW Temp	74.2
Pump 2	x
ND Timing Status	x
GPS Live	Yes
MCC Connected	Ok
Goblin Status	Ok
ND GPS Error	200.0
GPS Last Spill	22/11/09 00:31:4.000000.159826307 (63.6 ms ago)
DCS Comments

FD DCS: Pump P5 is OFF

I as was calling the FD oncall number things returned to normal

OmCheckListFar

Shifter	cherdack
at	Fermilab
Start OM Viewer	x
OM Status	x
Run	45074/13
ROP temperatures	OK
Rogue crate entries	0
TRC - PPS Time	OK
TRC - Status Bit	OK
Spars Error Code	OK
Etc Error Code	OK
Problems, Crate Monitor
Problems, Rogue Crates
Flat CI entries	0
Problems, CI
Gain Curve Running	No
Singles rate/Crate	Problem
Singles rate/VARC	Problem
Hot Chips	0
Problems, Singles	Still seeing effects of LI gain
Problems, Singles
Planes	OK
Hits, post-trigger	Problem
Hits, pre-trigger	Problem
Problems, Raw Digits	post: 7 above 0.12 and 1 below 0.04 pre: still seeing effects of LI gain
LI East Dead	9
LI East Low Eff	535
LI West Dead	2
LI West Low Eff	292
Problems, LI
Rogue Pedestals	1
Pedestals, Mean	OK
Pedestals, RMS	OK
Problems, Pedestals	15-1-4-1-0 @0
Shield, post-trigger	OK
Shield, pre-trigger	OK
Problems, Veto Shield

OmCheckListNear

Date	11/22/2009
Time	5:21:49
Shifter	cherdack
at	Fermilab
Start OM Viewer	x
OM Status	x
Run	17219/19
CAPID	Problem
MISCOUNT	OK
PARITY	OK
Problems, QIE Errors	CAPID: 3-9-2-7 @10
Gain Curve Running	No
Current Singles	OK
Max Singles	OK
Mean Singles	OK
Min Singles	OK
Singles Rate per crate	OK
Problems, Singles
Hit Maps, COSMIC	OK
Hit Maps, SGATE	OK
Priority Truncate	OK
QIE Digits, COSMIC	OK
QIE Digits, SGATE	OK
QIE Digits, Wrong datatype	Problem
Problems, Raw Digits	0-16-2,3, and 6 are all full
LightInjection	OK
LI Hit Map	OK
LI Gain Map	OK
Problems, LI
Pedestal Mean	OK
Pedestal RMS	OK
Rogue Pedestals	OK
Problems, Pedestals
ROP temperatures	Problem
Problems, CC	3-MEM is at 52C
Rogue CheckCal	OK
Problems, CC
Beam in SGATE	OK
Crates SGATE	OK
Problems, SGATE Timing
Comments

BeamCheckList

Date	11/22/2009
Time	6:13:12
Shifter	cherdack
at	Fermilab
Intensity	38e12
Configuration	RHC
Made Plots	x
Plots in CRL	x
Plots in Elog	x
JAS Running	x
JAS Updating	OK
Beam In Range	OK
JAS DeadTime	OK
ACNET Devices	Problem
Problems, JasDisplay	The muon monitors (MMA1DS and MMA2DS) are in error.
DataMonRun	YES
Datamon Update	OK
DataMon Green	OK
Comments

End_Shift

Date	11/22/2009
Time	8:08:23
Shifter	cherdack
At	Fermilab
ND First Run/Subrun	17219/14
FD First Run/Subrun	45074/8
ND Last Run/Subrun	17219/22
FD Last Run/Subrun	45074/16
Keys in the box	20
Keys out	6
Key checksum	x
Understand who is Underground	x
Shift Summary	Beam at 38e12 most of the night. The hadron monitors have been in error all night. Waiting on Laura L. to get back to us on what to do.
Problems Found
ND Release Control	x
FD Release Control	x

Start_Shift

Date	11/22/2009
Time	8:14:20
Shifter	ahimmel
At	Fermilab
Review recent CRL entries	x
Review CRL Memopad	x
ND Start Run Control	x
FD Start Run Control	x
ND Request control	x
FD Request control	x
ND Check Run Sequence	x
ND Run/Subrun	17219/22
FD Check Run Sequence	x
FD Run/Subrun	45074/16
ND DCS Status	x
FD DCS Status	x
ND Timing Status	x
FD Timing Status	x
MINOS Access Review	x
TRAIN Webpage	x
Keys in the box	20
Keys out	6
Key checksum	x
Understand who is Underground	x
Comments	Muon monitors in error. The consensus among contacted experts is to wait for Laura. If we don't hear back from her this morning I will try calling again.

OmCheckListNear

Date	11/22/2009
Time	8:21:10
Shifter	ahimmel
at	Fermilab
Start OM Viewer	x
OM Status	x
Run	17219/22
CAPID	Problem
MISCOUNT	OK
PARITY	OK
Problems, QIE Errors	CAPID: 3-9-2-7 (18)
Gain Curve Running	No
Current Singles	OK
Max Singles	Problem
Mean Singles	Problem
Min Singles	Problem
Singles Rate per crate	OK
Problems, Singles	3-20-(0,1,2,3) still low.
Hit Maps, COSMIC	OK
Hit Maps, SGATE	OK
Priority Truncate	Problem
QIE Digits, COSMIC	OK
QIE Digits, SGATE	OK
QIE Digits, Wrong datatype	Problem
Problems, Raw Digits	There are a lot of Priority Truncate (117) and Wrong Datatype (233) errors. They are mostly in MENU 0 of many different crates (see images in next post).
LightInjection	OK
LI Hit Map	OK
LI Gain Map	OK
Problems, LI
Pedestal Mean	OK
Pedestal RMS	OK
Rogue Pedestals	OK
Problems, Pedestals
ROP temperatures	Problem
Problems, CC	MEM3 is a little high (52). It's been stable for a while so presumably this is due to the ongoing ND sump problems.
Rogue CheckCal	OK
Problems, CC
Beam in SGATE	OK
Crates SGATE	OK
Problems, SGATE Timing
Comments