RGA stopped working. Likely after a spark yesterday.

 See e-fault 8027 

Monday, April 13, 2015
Kevin and Graham are working on it

 by Mico, Dan and Anders

TSG:RP1 backing line pressure is >200 mT. An e-fault has been submitted to have the roughing pump replaced.

Friday, April 24, 2015, 13:13: Pump replaced by vacuum group.

Photos on DocuShare

Friday, April 24, 2015
The source tray has been installed and inspected.

Friday, April 24, 2015, 12:32: Roughing

Friday, April 24, 2015, 13:33: Starting turbos. Vacuum at 0.24 T

Friday, April 24, 2015, 13:42: Turbos at speed.

Friday, April 24, 2015, 13:43: 3.5E-5 T

Leak check performed with RGA and He pressurized on water line  incl GE line to 50 psi. Doors and ANODE line blank off He sprayed. No response.

RGA response to He confirmed with FEBIAD gas leak.

Monday, April 27, 2015, 12:00: Ge water open.

Monday, April 27, 2015, 12:03: Water open

Monday, April 27, 2015, 15:07: Electrical check completed OK. Test results attached. Tested low voltage on EZL, CB1, VCB1, CBC, EE, ANODE and BIAS

Monday, April 27, 2015, 15:15: Turbos stopped. Colimator connected to HS lines (60 kV). Should be on GND potential.

Monday, April 27, 2015, 16:00: Roughing

Monday, April 27, 2015, 16:30: Starting turbos

Monday, April 27, 2015, 16:40: Turbos at speed. Vacuum at 1.8E-5 T

 Tuesday, April 28, 2015, 09:46: Starting auto-ramping of heaters to 100 / 100 A at 2 A/min 3E-6 / 4E-6 T good/bad vacuum limits.

Tuesday, April 28, 2015, 10:38: Continue auto-ramping TGHT to 200 A

Tuesday, April 28, 2015, 11:15: Optics and steerers on.

Tuesday, April 28, 2015, 11:34: Continue auto-ramping TGHT to 250 A

Tuesday, April 28, 2015, 12:50: Continue auto-ramping TGHT/TBHT  to 300 /150 A 

Tuesday, April 28, 2015, 13:30: Continue auto-ramping TGHT/TBHT  to 400 /200 A 

Tuesday, April 28, 2015, 14:24: Continue auto-ramping TGHT/TBHT  to 500 /250 A 

 Wednesday, April 29, 2015, 06:06: Starting auto-ramp down.

Wednesday, April 29, 2015, 09:09: ANODE to 200 V. No current.

Wednesday, April 29, 2015, 09:16 : ANODE to 300 V. No current.

Wednesday, April 29, 2015, 09:16: EE to 2kV. 691 uA

Wednesday, April 29, 2015, 09:17: ANODE off. EE to 1.5 kV

Wednesday, April 29, 2015, 09:20: BIAS/EZL at 5/5 kV

Wednesday, April 29, 2015, 09:26: BIAS/EZL at 7.5/5 kV

Wednesday, April 29, 2015, 09:32 : BIAS/EZL at 10/5 kV

Wednesday, April 29, 2015, 09:47: BIAS/EZL at 15/7.5 kV

Wednesday, April 29, 2015, 10:04: BIAS/EZL at 20/10 kV

Wednesday, April 29, 2015, 10:20: BIAS/EZL at 25/12.5 kV

Wednesday, April 29, 2015, 10:48: BIAS/EZL at 30/15 kV. 2 sparks in 10 min on BIAS

Wednesday, April 29, 2015, 10:54: No sparks for 10 min

Wednesday, April 29, 2015, 12:01: BIAS/EZL at 40/20 kV

Wednesday, April 29, 2015, 12:48: No spark for the last 15 min. 3 sparks in the last 30 min

Wednesday, April 29, 2015, 13:09: BIAS/EZL at 45/22.5 kV

Wednesday, April 29, 2015, 13:45: BIAS/EZL at 50/25 kV

Wednesday, April 29, 2015, 14:53: Sparking above 50 kV. Loosing EPICS communication.

Wednesday, April 29, 2015, 15:46: BIAS/EZL at 53/27.5 kV

Wednesday, April 29, 2015, 16:11: BIAS/EZL at 53/27.5 kV. No sparks for 15 min

Wednesday, April 29, 2015, 16:19: BIAS/EZL/EE off for today

Thursday, April 30, 2015, 08:37: BIAS/EZL at 40/20 kV. EE at 1.5 kV. IG1 at 7.1E-7 T

Thursday, April 30, 2015, 08:55: BIAS/EZL at 50/25 kV

Thursday, April 30, 2015, 09:10: 1 spark in the last 15 min

Thursday, April 30, 2015, 09:32: BIAS/EZL at 53/25 kV

Thursday, April 30, 2015, 09:42: No sparks for 10 min

Thursday, April 30, 2015, 09:53: BIAS/EZL at 54/25 kV

Thursday, April 30, 2015, 10:00: Sparking caused lost EPICS communication.Manually current limiting PS

Thursday, April 30, 2015, 10:25: BIAS/EZL at 53/25 kV

Thursday, April 30, 2015, 10:31: BIAS/EZL at 54/25 kV

Thursday, April 30, 2015, 10:47: BIAS/EZL at 55/25 kV

Thursday, April 30, 2015, 10:53: BIAS/EZL at 55/27.5 kV. No sparks for 5 min

Thursday, April 30, 2015, 10:57: No sparks for 10 min.

Thursday, April 30, 2015, 11:01: BIAS/EZL at 55/30 kV

Thursday, April 30, 2015, 11:17: No sparks for 30 min.

Thursday, April 30, 2015, 11:19: BIAS at 30 kV

Thursday, April 30, 2015, 11:36: ANODE to 200 V. COIL is limited in EPICS to 0A and 0V

Thursday, April 30, 2015, 11:41: Opened isolation valve

Thursday, April 30, 2015, 11:42: Autoramping heaters to 500 / 250 A at 4/2 A/min. Good vacuum 2E-6 T, bad vacuum 3E-6 T

Thursday, April 30, 2015, 12:01: No EZL sparks for 60 min

Thursday, April 30, 2015, 12:03: EZL to 14 kV

Thursday, April 30, 2015, 13:50: Continue ramping to 580 / 300 A at 1/1 A/min

Troubleshooting FEBIAD coil power supply

Thursday, April 30, 2015, 14:10: Pumping on gas lines.

Thursday, April 30, 2015, 14:18: Tripped heaters when opening gas line to vacuum.

Thursday, April 30, 2015, 14:20: Autoramping heaters 500 / 250 A at 6/3 A/min.

A large (water?) leak opened up with target close to max temperature. Water lines were pressurized in an attempt to identify the leaky line. The test yesterday were not conclusive and was repeated this morning with no He response. The vacuum did not improve over night.

Friday, May 01, 2015, 10:08: Venting

Left coil line removed.

Friday, May 01, 2015, 11:10: Roughing

Friday, May 01, 2015, 11:41: Started turbos

With the leak detector pumping on the left coil line, a large leak could be confirmed at the soldering site.

 Power supply did not work after high voltage conditioning. On Friday May 1st John Chow replaced the power supply with a 12 V 100 A power supply temporary while the other supply is being repaired. EPICS controls have not been adjusted.

Everything shut down, while EPICS showed everyhing to be on.

Controls group (Dave Morris) has reestablished contact. System is operations.

TSG section vented for Source Tray work

Friday, May 08, 2015, 09:13: TMS turbos at speed. Vacuum at 1.2E-5 T

NOTE: COIL PS is a 100 A supply, thus actual COIL current is 0.5x COIL set point.

Changed the FEBIAD connector blocks to have copper tubes exit below the block. Extended ANODE wire to allow it to be wrapped around Cu-tubes and keep it further away from the GE lines.

Wednesday, May 13, 2015, 13:45: Roughing

Wednesday, May 13, 2015, 14:13: Starting turbos

Wednesday, May 13, 2015, 14:23: Turbos at speed. Vacuum at 4.6E-5 T

Thursday, May 14, 2015, 09:27: He pressure tested waterlines to 70 psi He. No response on the RGA. Vacuum 3.3E-6 T

Thursday, May 14, 2015, 09:39: Opened water supply. No increase on the RGA or IG

Thursday, May 14, 2015, 10:04: Tested COIL to 50 A set point (= 25 A). Returned to 0 A.

Thursday, May 14, 2015, 10:09: Auto-ramping to 400 / 200 A at 4 / 2 A/min. Good/Bad vacuum 4E-6 / 5E-6 T

Thursday, May 14, 2015, 13:59: COIL at 50 A

Thursday, May 14, 2015, 21:57 : Starting cool down.

Friday, May 15, 2015, 06:25: Stopped turbos

Friday, May 15, 2015, 07:42 : Venting

C-seals installed.

Friday, May 15, 2015, 13:56: Roughing

Friday, May 15, 2015, 14:28 : Staring turbos

Friday, May 15, 2015, 14:38: Turbos ate speed. Vacuum at 3.9E-5 T

Tuesday, May 19, 2015, 07:31: Vacuum at 7.1E-7 T. Pumping on gas lines

Tuesday, May 19, 2015, 07:35: Water lines opened. Vacuum stable at 7.1E-7 T. No response on RGA

Tuesday, May 19, 2015, 07:43: Opened gas lines (SV5)

Tuesday, May 19, 2015, 07:47: Auto-ramping to 400 / 200 A at 4 / 2 A/min. Good/Bad vacuum 2E-6 / 4E-6 T

Tuesday, May 19, 2015, 08:46: ANODE and COIL to 200 V and 50 A

Tuesday, May 19, 2015, 09:39: Auto-ramping to 500 / 250 A at 2 / 1 A/min. Good/Bad vacuum 2E-6 / 4E-6 T

Tuesday, May 19, 2015, 10:54: Opened IV4

Tuesday, May 19, 2015, 11:14: Atuo-ramping to 270 A. BIAS/EZL/EE at 30 / 15 / 1.5 kV

Tuesday, May 19, 2015, 11:42: BIAS/EZL/EE to 20 / 10 / 1.5 kV

Wednesday, May 20, 2015, 09:55:  Auto-ramping to 500 / 250 A at 4 / 2 A/min. Good/Bad vacuum 2E-6 / 4E-6 T

Wednesday, May 20, 2015, 09:57: BIAS/EZL/EE at 30 / 15 / 1.5 kV

Wednesday, May 20, 2015, 11:57: Auto-ramping to 580 / 290 A at 2 / 1 A/min.

Wednesday, May 20, 2015, 12:55: Vacuum excursion during beam tuning. Stopped turbos.

A leak was observed on the left coil conductor again. After inspecting the service cap, it was found that there was no water flow going through the left coil line due to differences in routing between the TM2 and the Test Stand source tray. A new coil line will be made and the water and electrical connections on the service cap will be reconfigured.

 Likely caused by the PLC. e-fault  8139

Wednesday, May 20, 2015

Dave Morris re-established contact with controls. (PLC IOC was down).

 The service cap has been reconfigured (colling and electric) to be compatible with the TM2 Source tray. Coil- is E & F , Coil+ is G & H.

Thursday, May 21, 2015, 17:26: Roughing

Thursday, May 21, 2015, 18:02: Turbos started

Thursday, May 21, 2015, 18:12: Turbos at speed. Vacuum at 4.7E-5 T

Friday, May 22, 2015, 08:00: Opened water. Vacuum stable at 3.4E-6 T. No response on RGA

Friday, May 22, 2015, 08:10: Pumping on gas line

Friday, May 22, 2015, 08:21: Opened gas line.

Friday, May 22, 2015, 08:30: Auto-ramping to 500 / 250 A at 4/2 A/min. Good/bad vacuum 4E-6 and 5E-6 T

Friday, May 22, 2015, 08:35: BIAS/EZL/EE to 10 / 10 / 1.5 kV. COIL 50 A, ANODE 200 V

Friday, May 22, 2015, 12:16: Opened IV4

Friday, May 22, 2015, 14:59: BIAS/EZL/EE to 30 / 15 / 1.5 kV

Friday, May 22, 2015, 15:29 : Auto-ramping to 580 / 270 A at 2/1 A/min.

Saturday May 23 15:10 TGHT: 7.51 V 580 A, TBHT: 2.23 V 270 A, ANODE 200 V 13.4 mA, FC0 1.5e-8 A, IG1 1.9e-6 T, COIL 0 V 0 A not responding, some bias sparking over last 7 hours

Monday, May 25, 2015, 09:07: EE current limiting. Started auto-cool down at 4/2 A/min. Vacuum 1.2E-6 T

Monday, May 25, 2015, 09:37: BIAS and EZL to 0

Monday, May 25, 2015, 10:34 : Closed IV4

Monday, May 25, 2015, 11:56 : Cool down complete. Stopped turbos.

Monday, May 25, 2015, 13:17: Venting

Monday, May 25, 2015, 13:25: HS cooling circuit purged.

Monday, May 25, 2015, 14:25: The EE water line was found to be touching the COIL lines on the source tray.

 A gauge and a valve was installed on the roughing line to the large turbo pump

Monday, May 25, 2015, 14:35: Rouging

Monday, May 25, 2015, 15:05: Turbos started.

Monday, May 25, 2015, 15:15: Turbos at speed. Vacuum at 2.4E-5 T

Tuesday, May 26, 2015, 07:45: Opened water circuit for HS line. Vacuum stable at 6.3E-7 T. No response on RGA

Tuesday, May 26, 2015, 07:50: Autoramping to 500/200 A at 2/1 A/min. Good vacuum 2E-6, bad vacuum 4E-6 T

Tuesday, May 26, 2015, 07:52: IV4 open

Tuesday, May 26, 2015, 13:15: Continue auto-ramping to 580 A

Tuesday, May 26, 2015, 13:48: BIAS/EZL/EE 30 / 15 / 1.5 kV

Tuesday, May 26, 2015, 17:29: ~6 sparks/hour

Wednesday, May 27, 2015, 08:14: A couple of sparks over night.

Wednesday, May 27, 2015, 09:23: Autoramping TBHT to 220 A

Wednesday, May 27, 2015, 09:41: Found FC0 and FC6 bias to be off

Wednesday, May 27, 2015, 09:42: Autoramping TBHT to 230 A

Wednesday, May 27, 2015, 10:30: EE to 2 kV

Wednesday, May 27, 2015, 10:37: Starting cool down at 4/2 A/min

Wednesday, May 27, 2015, 10:40: EE to 1.5 kV

Wednesday, May 27, 2015, 12:37 : BIAS/EZL/EE OFF

Wednesday, May 27, 2015, 12:37 : IV4 closed

Wednesday, May 27, 2015, 13:02: Stopped turbos

Wednesday, May 27, 2015, 13:41: Venting

Wednesday, May 27, 2015, 14:19: Roughing

Wednesday, May 27, 2015, 14:50: Turbos started

Wednesday, May 27, 2015, 15:00: Turbos at speed. Vacuum at 1.6e-5 T

Thursday, May 28, 2015, 08:13: Water opened on HS line. Vacuum stable at 4.3E-7 T. No response on RGA

Thursday, May 28, 2015, 08:17: Pumping on gas line.

Thursday, May 28, 2015, 08:37: Open gas lines.

Thursday, May 28, 2015, 08:50: Started auto-ramping to 500 / 250 A at 4/2 A/min.

Thursday, May 28, 2015, 08:55: ANODE 200 V, COIL 50 A

Thursday, May 28, 2015, 08:52: Opened IV4

Thursday, May 28, 2015, 09:01: BIAS/EZL/EE to 30 / 15 / 1.5 kV

Thursday, May 28, 2015, 10:56: Continue auto-ramping to 580/290 A at 2/2 A/min

Thursday, May 28, 2015, 13:01: Ramping TBHT to 300 A

Friday, May 29, 2015, 08:23: ANODE current limited. Increased limit to 125 uA

Friday, May 29, 2015, 08:25: TPS:Q1 and Q4 found to be off. Switched back on

Friday, May 29, 2015, 14:38: Starting cool down of source.

Friday, May 29, 2015, 15:34: Close IV4

Friday, May 29, 2015, 15:36: BIAS/EZL/EE, COIL and ANODE off

Monday, June 01, 2015, 08:23: Vacuum at 2.8E-7 T. BIAS/EZL to 30  / 15 kV

Monday, June 01, 2015, 08:37: BIAS/EZL to 40  / 20 kV

Monday, June 01, 2015, 09:05: BIAS/EZL to 50  / 25 kV

Monday, June 01, 2015, 09:17: BIAS/EZL to 40  / 20 kV (target hand over to RH)

Monday, June 01, 2015, 09:50: BIAS/EZL to 50  / 25 kV

Monday, June 01, 2015, 10:08: BIAS/EZL to 55  / 25 kV. No sparks so far.

Monday, June 01, 2015, 10:28: EZL to 30 kV

Monday, June 01, 2015, 11:03: 2 sparks last 30 min

Monday, June 01, 2015, 11:48: 5 BIAS sparks last 80 min 

Monday, June 01, 2015, 11:49: BIAS /EZL/ EE off

Monday, June 01, 2015, 15:38: Stopped TP1B for out-gassing measurement tomorrow.

Tuesday, June 02, 2015, 10:28: Stopped TP1A.

Tuesday, June 02, 2015, 13:57: Water lines purged. GE line closed (not purged).

Wednesday, June 03, 2015, 08:25: Venting

Wednesday, June 03, 2015, 09:35: TP6 and TP2 off

Wednesday, June 03, 2015, 10:15: Upgrade in progress.

Monday, June 15, 2015

Remaining items to do

• ANODE wire not yet attached
• FEBIAD COILS not yet reconfigured

Tuesday, June 16, 2015:

Coils reconfigured. See attached photo.

Monday, June 15, 2015, 14:05 Roughing

Monday, June 15, 2015, 14:39: Turbos started.

Monday, June 15, 2015, 14:49: Turbos at speed. Vacuum at 5.3E-5 T

Tuesday, June 16, 2015, 10:14: Water lines leak checked and water opened.

TBHT p/s did not come on yesterday after PLC upgrade. Solved this morning by Dave M.

Wednesday, June 17, 2015, 09:56: BIAS/EZL/EE to 20 / 10 / 1 kV

Wednesday, June 17, 2015, 09:58: Atuo-ramping to 500 / 170 A at 2/1 A/min. Good/Bad Vac 4E-6 / 6E-6 T

Wednesday, June 17, 2015, 23:11 : Stopped auto-ramping at 342 / 170 A. Vacuum at 4E-6 T

Thursday, June 18, 2015, 08:59: Resuming auto-ramping. Vacuum at 3.3E-6 T

Thursday, June 18, 2015, 11:25: Good/Bad Vac 6E-6 / 8E-6 T.

Thursday, June 18, 2015, 14:59: TBHT to 180 A. BIAS/EZL/EE to 30 / 14 / 1.5 kV

Friday, June 19, 2015, 08:21: Ramping TBHT to 200 A

Friday, June 19, 2015, 08:40: EZL 13.4 kV

Friday, June 19, 2015, 11:30: Atuo-ramping to 580 A

Friday, June 19, 2015, 11:48: Stopped auto-ramping at 540 A. 8.4 V

Friday, June 19, 2015, 13:30: TGHT / TBHT at 580 / 220 A

Friday, June 19, 2015, 16:12: Cool down started. at 4 / 2 A/min

Friday, June 19, 2015, 17:57: BIAS / EZL / EE off

Friday, June 19, 2015, 17:57: Closed IV4. Timed out.

Monday, June 22, 2015, 08:57 : Stopped turbos

Monday, June 22, 2015, 13:02: Venting. Had to bypass interlocks as IV4 is timed out.

No wires connected yet.

Monday, June 22, 2015, 15:48: Roughing

Tuesday, June 23, 2015, 09:05: Roughing vacuum does not go below 0.9 T. Venting to investigate.

Tuesday, June 23, 2015, 10:16: Turbos started at 0.9 T

Tuesday, June 23, 2015, 10:276: Turbos at speed. Vacuum at 7.5E-4 T

Tuesday, June 23, 2015, 10:32: Stopped turbos

Tuesday, June 23, 2015, 11:01: Venting

Tuesday, June 23, 2015, 11:22: Roughing

Tuesday, June 23, 2015, 13:37: Venting

Tuesday, June 23, 2015, 16:48: Leak found on the newly installed f/t.

Wednesday, June 24, 2015, 09:29: Venting

Replaced f/t with a blank off.Installed TM2 FEBIAD test target

Wednesday, June 24, 2015, 10:31: Roughing

Wednesday, June 24, 2015, 11:07: Started turbos.

Wednesday, June 24, 2015, 11:17: Turbos at speed. Vacuum at 3.3E-5 T

Thursday, July 09, 2015

Installed the fixed f/t.

Thursday, June 25, 2015, 09:00: Water on HS. No vacuum response.

Thursday, June 25, 2015, 11:48: Started auto ramping heaters.

Thursday, June 25, 2015, 17:14: Target at 580/275 A. BIAS/EZL/EE at 30 / 13.5 / 1.5 kV

Friday, June 26, 2015, 08:04: Stopped TP1B for outgasing measurements

Friday, June 26, 2015, 10:25: Performing outgasing measurements

Friday, June 26, 2015, 10:35: Starting TP1B.

Friday, June 26, 2015, 10:39: TP1B at speed.

Friday, June 26, 2015, 11:12: Started cool-down.

Friday, June 26, 2015, 11:47: BIAS/EZL/EE/COIL/ANODE off

Friday, June 26, 2015, 11:47: Closed IV4

Tuesday, June 30, 2015, 13:32: Venting

Tuesday, June 30, 2015, 14:51: Roughing

Tuesday, June 30, 2015, 16:14: Started turbos. CG1 at 0.075 T

Tuesday, June 30, 2015, 16:23 : Turbos at speed. Vacuum at 1.4E-5 T

Thursday, July 02, 2015, 09:05: RGA on. Opened water for HS line. Vacuum stable at 4.6E-7 T. No response on RGA

Thursday, July 02, 2015, 09:06: IV4 opened

Thursday, July 02, 2015, 09:08: Staring auto-ramping heaters to TGHT / TBHT 300 A / 100 A at 2 / 1 A/min

Thursday, July 02, 2015, 11:22 : BIAS/EZL/EE to 20 / 10  1.5 kV

Thursday, July 02, 2015, 11:46: Continue heating to 400 / 150 A

Thursday, July 02, 2015, 13:48 : BIAS/EZL to 30 / 13 kV. Heating continued from 13:05.

Thursday, July 02, 2015, 15:55: EE held at 2 kV for 10 min. Current stable at 684 uA

Thursday, July 02, 2015, 15:55: EE back to 1.5 kV at 510 uA

Thursday, July 02, 2015, 20:06 : Starting cool down

Friday, July 03, 2015, 08:31: Closed IV4

Friday, July 03, 2015, 08:33: HV and source off

Monday, July 06, 2015, 11:04: Turbos stopped

Monday, July 06, 2015, 14:01: Venting