NOTE: If cooling is required, the compressors will have to be run manually. Make sure to switch it off again when the water has reached an acceptable temperature.

The staging did not work properly this morning. Dave Morris have been contacted and will look into it.

 See work permit for details

 A copper bar jumper (ITD0488) was installed on the TGHT, TBHT and COIL conductors on the taregt hall side for TCS testing.

 TCS:WPV1 does not open when staging is enabled. Multiple attempts have been made, but the valve remains closed.

Measurement taken at 14:25. IG2 at ~7.7E-6 T

Anders Mjos wrote:

TCS:WPV1 does not open when staging is enabled. Multiple attempts have been made, but the valve remains closed.

 Dave Morris looked at the PLC controls and found that the code was not writing to the output after the PLC migration. He corrected it.

Monday, December 08, 2014, 14:00: Dan M and Anders connected the water supply to circuit D and installed the module cover.

Monday, December 08, 2014, 14:50: Circulating water on circuit D. IG1 vacuum stable at 3.1E-7 T. No response on mass 18 on RGA

Monday, December 08, 2014, 15:30: Test TGHT and TBHT PS. Can be switched on, but set points need to be corrected.

Monday, December 08, 2014, 16:11: Started CHILLCP2

Monday, December 08, 2014, 16:26: Stopped CHILLCP2

Tuesday, December 09, 2014, 09:02: Started CHILLCP1. TS5 at 31.5 C

Tuesday, December 09, 2014, 09:33: Stopped CHILLCP1. TS5 at 17. 1 C

Tuesday, December 09, 2014, 14:54: Tested TGHT to 600 A and 2.05 V (local read back). EPICS read back and set point is not correct. Circuit resistance ~ 3.4 mOhm.

Tuesday, December 09, 2014, 15:14: Tested TBHT to 272 A and 0.97 V (local read back). EPICS read back and set point is not correct. Circuit resistance ~ 3.6 mOhm.

Tuesday, December 09, 2014, 16:01: TGHT and TBHT switched off.

Wednesday, December 10, 2014, 08:30: TGHT and TBHT power supplies cannot be run with TS5 > 25. Bypasses/Forces not implemented. Waiting for controls.

Wednesday, December 10, 2014, 10:44: Water is stable on RGA, however N, O and Ar shows repeated short term spikes of ~4x magnitude. Spikes are also visible on IG1

Vacuum stable over night.

Thursday, December 11, 2014, 08:22: Starting CHILLCP3. TS5 at 33.1 C, TBHT at 30.2 C

Thursday, December 11, 2014, 08:58 : Staging enabled

Vacuum stable over night.

Dave M corrected scale of TGHT and TBHT.

TS5 forced

Lost water in expansion tank over the weekend. See other e-log entries regarding the water leak and fix. Vacuum stable over the weekend.

Monday, December 15, 2014, 13:49: TGHT and TBHT PS at 600 A and 270 A

Monday, December 15, 2014, 14:06: TGHT to 700 A

Monday, December 15, 2014, 18:03: Autoramping down at 5 A/15 s

Monday, December 15, 2014, 18:26: TGHT and TBHT at 0 A. TS5 is at 35 C

Vacuum stable over night

Tuesday, December 16, 2014, 08:07: TGHT and TBHT to 700 A and 270 A

Tuesday, December 16, 2014, 09:00: Stopped MP2. MP3 tripped. TGHT and TBHT tripped.

Tuesday, December 16, 2014, 09:05: started MP2, TGHT and TBHT

Tuesday, December 16, 2014, 16:21: TGHT to 600 A. Will leave both TGHT and TBHT on over night to keep the water warm.

Vacuum stable over night. TS5 at 37.5 C TBHT return at 34.5 C

Wednesday, December 17, 2014, 08:15: TGHT to 750 A

Wednesday, December 17, 2014, 08:35 : TGHT to 800 A

Wednesday, December 17, 2014, 16:09 : TGHT to 700 A. TS5 at 40 C TBHT return at 37 C

Vacuum stable over night. TS5 at 39.3 C and TBHT return at 36.2 C

Thursday, December 18, 2014, 07:54: Starting CHILLCP1

Thursday, December 18, 2014, 08:34: Stopped cHILLCP1 TS5 at 20 C

Thursday, December 18, 2014, 09:07: TGHT to 800 A

Thursday, December 18, 2014, 16:10: TGHT to 700 A

Vacuum stable over night. TS5 at 39.0 C and TBHT return at 35.9 C

Friday, December 19, 2014, 08:17: TGHT to 800 A

Friday, December 19, 2014, 11:54: TGHT to 650 A. TS5 at 39.9 C 

Vacuum stable over the weekend. TS5 at 38.4 C and TBHT return at 35.4 C

Monday, December 22, 2014, 08:31 : Started CHILLCP3

Monday, December 22, 2014, 09:30: Stopped CHILLCP3 

Monday, December 22, 2014, 10:08: TGHT to 800 A

Monday, December 22, 2014, 16:25: TGHT to 700 A

Vacuum stable over night. TS5 at 38.4 C and TBHT return at 35.3 C

Tuesday, December 23, 2014, 08:16: TGHT to 800 A

Tuesday, December 23, 2014, 13:10 : Starting CHILLCP3. TS5 at 39.5 C and TBHT return at 36.4 C

Tuesday, December 23, 2014, 13:14: TGHT and TBHt to 0 and off. 

Leak check found no leaks on Service Cap

Tuesday, December 23, 2014, 14:14 : Stopped CHILLCP3

Tuesday, December 23, 2014, 14:20: RGA filament off

Tuesday, December 23, 2014, 14:23: Stopped MP2 and MP3

 The level dropped below 15 in over the weekend. MP2 stopped, but MP3 condtinued pumping.

Anders Mjos wrote:

The level dropped below 15 in over the weekend. MP2 stopped, but MP3 condtinued pumping.

 e-fault submitted and Niel Wong has been contacted.

Niel Wong came and had a look at the system. We decided to close the circuit as the water is no longer used with the new power supplies. The circuit will be monitored, but not repaired unless it is needed again.

Anders Mjos wrote:

Anders Mjos wrote:  The level dropped below 15 in over the weekend. MP2 stopped, but MP3 condtinued pumping.  e-fault submitted and Niel Wong has been contacted. Niel Wong came and had a look at the system. We decided to close the circuit as the water is no longer used with the new power supplies. The circuit will be monitored, but not repaired unless it is needed again.

 Due to the water leak, the expansion tank needed topping up. It was filled from 14 in to 20 in. See work permit I2014-12-15-2.

Anders Mjos wrote:

Anders Mjos wrote:  The level dropped below 15 in over the weekend. MP2 stopped, but MP3 condtinued pumping.  e-fault submitted and Niel Wong has been contacted. Niel Wong came and had a look at the system. We decided to close the circuit as the water is no longer used with the new power supplies. The circuit will be monitored, but not repaired unless it is needed again.

The valved off water circuit has been valved off and  TCS:WFB2:BIASSW1 and TCS:TCM2:BIASSW1 have been removed from the power supply interlock chain by Dave Morris.

The RGA showed no response to He-spray on the Service Cap. He stable at 3.5E-9 T partial pressure, water at 1.3E-6 T. IG1 at 9.9E-8 T

 by "enable staging" button. MP3 has to be turned off-on to open WPV1

No leak detected on either He-detector (connected directly to Service Cap) or on RGA. See attached screen shots.

A vacuum increase (air only on RGA) was seen when de-pressurizing circuit I.

No Source Tray installed. Loop on cooling circuit D. All other circuits blanked off.

Voltages stated below are set point voltages. These corresponds reasonably well with the local read backs on the power supplies. The read back voltages in EPICS are somewhat lower.

Wednesday, January 07, 2015, 09:16: 20 / 10 kV (BIAS / EL)

Wednesday, January 07, 2015, 09:20: Vacuum responses from BIAS 27 kV. Corresponds to each increase in bias voltage.

Wednesday, January 07, 2015, 09:40: 30 / 15 kV 

Wednesday, January 07, 2015, 10:28: Sparking and vacuum responses continues with every 100 V BIAS increase. If the voltage is lowered and brought back up, no sparks are observed; the module is conditioning.

Wednesday, January 07, 2015, 12:09: 34 / 17.5 kV

 Wednesday, January 07, 2015, 13:05: 35 / 17.5 kV

Wednesday, January 07, 2015, 14:50: 37.5 / 20 kV

Wednesday, January 07, 2015, 15:40: 38.5 / 20 kV

Wednesday, January 07, 2015, 16:02: BIAS and EL power supplies off.

Thursday, January 08, 2015, 10:00: HV condtioning continues

Thursday, January 08, 2015, 10:11: 35 / 20 kV

Thursday, January 08, 2015, 10:29: 38.5 / 20 kV

Thursday, January 08, 2015, 11:43: 40 / 20 kV

about 15 sparks per hour (5 / 20 min)

Thursday, January 08, 2015, 14:41: 42.5 / 22.5 kV

Thursday, January 08, 2015, 15:08: Communication lost with RGA. Could not be recovered.

Thursday, January 08, 2015, 15:58: 45 / 22.5 kV

Thursday, January 08, 2015, 16:27: BIAS and EL power supplies off.

Friday, January 09, 2015, 08:52: 45 / 22.5 kV

Tried to recover RGA by unplugging and plugging power cord, but no success.

Friday, January 09, 2015, 10:45: Increased sparking at 48 kV - reduced to 47.5 kV

Friday, January 09, 2015, 11:53 : 50 / 25 kV

Friday, January 09, 2015, 12:28: ~ 1 spark / minute for the last 10 min

 Friday, January 09, 2015, 15:27: ~25 sparks / hour for the last 20 min

Friday, January 09, 2015, 16:18: ~18 sparks / hour for the last 20 min

Monday, January 12, 2015, 09:31: 50 / 25 kV

Monday, January 12, 2015, 10:31: No sparks for 20 min after ~30 min of conditioning.

Monday, January 12, 2015, 12:24: BIAS / EL power supplies tripped on conductivity (spark)

Monday, January 12, 2015, 13:13: 55 / 27.5 kV

Monday, January 12, 2015, 14:32: 1 spark for the last 10 min

Monday, January 12, 2015, 15:38: 57 / 30 kV

Monday, January 12, 2015, 15:48: ~60 sparks / hour for the last 10 min

Monday, January 12, 2015, 16:00: BIAS and EL power supplies off.

Tuesday, January 13, 2015, 08:45: 55 / 27.5 kV

Tuesday, January 13, 2015, 09:18: ~60 sparks / hour for the last 10 min

Tuesday, January 13, 2015, 10:17: No sparks for the last 10 min

Tuesday, January 13, 2015, 10:30: 57.5 / 30 kV

Tuesday, January 13, 2015, 11:34: 59 / 30 kV

Tuesday, January 13, 2015, 13:23: No sparks for the last 25 min 

Tuesday, January 13, 2015, 14:11: 60 / 30 kV

Tuesday, January 13, 2015, 14:42: Spark tripped TP2 and TP1S and both power supplies

Tuesday, January 13, 2015, 15:02: 60 / 30 kV (local read back 60.5 / 30 kV, 0.1 / 0.15 mA)

Tuesday, January 13, 2015, 15:38: BIAS and EL power supplies off.

Wednesday, January 14, 2015, 08:34: 60 / 30 kV

Wednesday, January 14, 2015, 10:41: 3 sparks / hour for the last 60 min

Wednesday, January 14, 2015, 13:39: 61 / 30 kV

Wednesday, January 14, 2015, 14:29: 61.5 / 30 kV (local read back 62 / 30 kV, 0.1 / 0.15 mA)

Wednesday, January 14, 2015, 15:40: ~ 6 sparks / hour for the last 20 min

Wednesday, January 14, 2015, 16:07: TP2 found to be tripped off. Restarted.

Wednesday, January 14, 2015, 16:23: 60 sparks / hour for the last 20 min

Wednesday, January 14, 2015, 16:28: BIAS and EL power supplies off.

Thursday, January 15, 2015, 08:27: 60 / 30 kV

Thursday, January 15, 2015, 11:24: ~35 sparks / hour for the last 20 min

Thursday, January 15, 2015, 14:09: 12 sparks / hour for the last 60 min

Thursday, January 15, 2015, 15:33: 58 / 30 kV

Thursday, January 15, 2015, 15:49: 56 / 30 kV

Sparks observed both at 58 and 56 kV

Thursday, January 15, 2015, 15:57: BIAS and EL power supplies off.

Monday, January 19, 2015, 09:53: 55 / 30 kV

Monday, January 19, 2015, 11:44: ~20 sparks / hour for the last 20 min

Monday, January 19, 2015, 12:53: ~10 sparks / hour for the last 20 min 

Monday, January 19, 2015, 16:30: 50 / 30 kV

Monday, January 19, 2015, 17:31: BIAS and EL power supplies off.

Tuesday, January 20, 2015, 08:54: 40 / 20 kV

Tuesday, January 20, 2015, 09:05: 50 / 25 kV

Tuesday, January 20, 2015, 13:43: 8 sparks / hour for the last 60 min

Tuesday, January 20, 2015, 16:43: 3 sparks / hour for the last 60 min

Wednesday, January 21, 2015, 09:10: 40 / 20 kV

Wednesday, January 21, 2015, 09:20: No sparks

Wednesday, January 21, 2015, 09:23: 50 / 25 kV

Wednesday, January 21, 2015, 10:33: 3 sparks / hour for the last 60 min

Wednesday, January 21, 2015, 13:43: 6 sparks / hour for the last 60 min

Wednesday, January 21, 2015, 16:07: 5 sparks / hour for the last 60 min

Wednesday, January 21, 2015, 16:09: BIAS and EL power supplies off.

Thursday, January 22, 2015, 09:11: 40 / 20 kV

Thursday, January 22, 2015, 10:14: No sparks

Thursday, January 22, 2015, 10:16: 45 / 25 kV

Thursday, January 22, 2015, 11:26: No sparks

Thursday, January 22, 2015, 16:57: No sparks

Thursday, January 22, 2015, 16:57: BIAS and EL power supplies off.

Friday, January 23, 2015, 09:28: 40 / 20 kV

Friday, January 23, 2015, 09:39: No sparks

Friday, January 23, 2015, 09:40: 50 / 25 kV 

Friday, January 23, 2015, 16:16: No sparks.

Friday, January 23, 2015, 16:17: BIAS and EL power supplies off. 

Monday, January 26, 2015, 09:17: 40 / 20 kV

Monday, January 26, 2015, 09:29: No sparks

Monday, January 26, 2015, 09:30: 50 / 25 kV

Monday, January 26, 2015, 09:52: No sparks

Monday, January 26, 2015, 09:53: 55 / 27.5 kV

Monday, January 26, 2015, 16:55: No sparks for 7 hours. BIAS and EL power supplies off. 

Tuesday, January 27, 2015, 09:10: 40 / 20 kV

Tuesday, January 27, 2015, 09:16: 50 / 25 kV  

Tuesday, January 27, 2015, 09:31: 55 / 27.5 kV

Tuesday, January 27, 2015, 09:51: No Sparks

Tuesday, January 27, 2015, 09:53: 57.5 / 30 kV (one spark while increasing BIAS voltage)

Tuesday, January 27, 2015, 10:14: No sparks

Tuesday, January 27, 2015, 10:18: 58 / 30 kV. Some sparks

Tuesday, January 27, 2015, 10:46: 59 / 30 kV. Some sparks while increasing BIAS voltage

Tuesday, January 27, 2015, 11:43: 59.5 / 30 kV. Some sparks while increasing BIAS voltage

Tuesday, January 27, 2015, 13:24: Spark

Tuesday, January 27, 2015, 13:33: 11 sparks for the last 10 min

Tuesday, January 27, 2015, 13:33: 59 / 30 kV

Tuesday, January 27, 2015, 13:35: 57.5 / 30 kV 

Tuesday, January 27, 2015, 16:14: ~3 sparks / hour for the last 60 min

Tuesday, January 27, 2015, 16:53: ~3 sparks / hour for the last 60 min

Tuesday, January 27, 2015, 16:55: BIAS and EL power supplies off. 

Wednesday, January 28, 2015, 09:11: 40 / 20 kV

Wednesday, January 28, 2015, 09:17: 50 / 25 kV 

Wednesday, January 28, 2015, 09:27: 55 / 27.5 kV 

Wednesday, January 28, 2015, 10:35: 11 sparks observed. BIAS and EL off - preparing for power outage

 Found both VFDs with OF3 fault (over voltage during constant speed operation).

Thursday, January 08, 2015, 16:37: Cycled power on the chiller to clear faults.

The copper bars was installed by David and Anders. After the measurements were completed, the copper bars were removed.

See photo and attached spread sheet.

 See e-log entry for ITE for details. The copper bars have not been removed. They can be used for testing the new power supplies.

Local measurement was done by Ray with a voltmeter. The voltmeter was consistent with EPICS readback and local readback on the power supplies. A voltage drop of 0.137 V @ 580 A was measured across the bus bar from the TGHT power supply to the cooled transmission lines.