Fault report was submitted.

Anders informed Anthony on Tuesday, Sept 6, 2016.

Fault report # 9233.

Wednesday, September 07, 2016, 15:35: Roughing

Thursday, September 08, 2016, 08:33: Turbo pumps started.

Thursday, September 08, 2016, 08:38: Ion gauge on. TP1B @ speed 42 KRPM.

Thursday, September 08, 2016, 08:41: TP1A @ speed 38 KRPM.

Thursday, September 08, 2016, 08:47: RGA on.

Thursday, September 08, 2016, 11:00: Checked and screenshots taken. Vacuum @ 1.38E-6T

DaqPro Logger HS+MSP flow checked. Connections disconnect and re-connect.

Thursday, September 08, 2016, 11:45: Waterlines opened. No response on RGA. Vacuum ok @ 1.21 E-6T

Friday, September 09, 2016, 08:51: Vacuum ok @ 3.68E-7T

Friday, September 09, 2016, 15:35: Vacuum ok @ 3.35E-7T

Monday, September 12, 2016, 08:05: Vacuum ok @ 1.97E-7T

Monday, September 12, 2016, 15:09: Vacuum ok @ 1.97E-07T

Tuesday, September 13, 2016, 08:17: Vacuum ok @ 1.79E-7T

Tuesday, September 13, 2016, 08:19: RGA off. Ion Gauge off. Turbo pumps off.

Tuesday, September 13, 2016, 08:24: Waterlines purged.

Wednesday, September 14, 2016, 11:33: Venting -AM

Friday, September 30, 2016, 10:00: Roughing.

Friday, September 30, 2016, 10:01: Roughing stopped. RP1 failure. Breaker tripped.

Friday, September 30, 2016, 11:49: Roughing continued.

Friday, September 30, 2016, 12:37: Turbos started -AM

Monday, October 03, 2016, 09:00: RGA on.

Monday, October 03, 2016, 09:05: Waterline opened. No response on RGA. Vacuum stable @1.70E-7T.

Monday, October 03, 2016, 09:20: Power/Sources on. Gas sources opened/closed.

Monday, October 03, 2016, 09:39: Optics switched on. Monitor TMS:SX2

Monday, October 03, 2016, 09:47: Anode on @ 200 V

Monday, October 03, 2016, 09:49: Coil on @ 50A

Monday, October 03, 2016, 09:50: IV4 opened.

Monday, October 03, 2016, 09:58: BIAS / EZL / EE @ 30 / 13 / 1.5 kV .

Monday, October 03, 2016, 10:08: Auto ramping TGHT / TBHT to 580 / 290 A @ 2A per min.

Monday, October 03, 2016, 10:12

 Device

Monday, October 03, 2016, 11:09: TMS:SX2 Fixed. No optics or sources affected.

Monday, October 03, 2016, 11:38: BIAS @ 30 kV. (Was actually set to 20 kV before). Ramping progress ok.

Monday, October 03, 2016, 15:56: TGHT / TBHT @ 580 / 290 A. RGA restarted.

Wednesday, October 05, 2016, 08:29: Optics found to be tripped : TMS:OCT4 , TMS:Q4 ,TMS:OCT3 ,TMS:SX3 ,TMS:Q3 ,TMS:SX2. Restarted

Wednesday, October 05, 2016, 09:20: Wire scanners reset. Emittance rig not reading properly.

Wednesday, October 05, 2016, 09:22: Auto ramping TBHT to 300 A @ 2A per min.

Thursday, October 06, 2016, 15:58: Auto-cooling TGHT / TBHT @ 2A per min.

Friday, October 07, 2016, 08:12: Source off - AM

Tuesday, October 11, 2016, 08:28: Turbos off. RGA off -AM

Tuesday, October 11, 2016, 13:38: Venting -AM

Tuesday, October 18, 2016, 13:22: Roughing.

Tuesday, October 18, 2016, 13:46: Turbo pumps started.

Tuesday, October 18, 2016, 13:52: Ion gauge on.

Tuesday, October 18, 2016, 13:54: Both turbo pumps at speed.

Tuesday, October 18, 2016, 15:05: RGA on.

Wednesday, October 19, 2016, 08:46: Power/Sources on

Wednesday, October 19, 2016, 08:49: Waterline opened. No response on RGA. Vacuum stable @4.40E-7T

Wednesday, October 19, 2016, 08:57: BIAS / EZL / EE @ 30 / 13 / 1.5 kV .

Wednesday, October 19, 2016, 08:58 : IV4 opened.

Wednesday, October 19, 2016, 09:01: Auto ramping TGHT / TBHT to 580 / 200 A @ 2A per min.

Wednesday, October 19, 2016, 11:50: TMS:FC0 moved out & TMS:RPM0B began scanning continuously on their own. Monitor.

Wednesday, October 19, 2016, 14:45: RGA Restarted.

Wednesday, October 19, 2016, 15:25: RGA Restarted (Unable to save 14:45 Startup)

Friday, October 21, 2016, 13:27: Auto Cooling @ 2A per min

Friday, October 21, 2016, 15:39: IV4 Closed

Monday, October 24, 2016, 09:10:

Monday, October 24, 2016, 09:10: Power/Sources off.

Monday, October 24, 2016, 09:20: Water lines purged.

Monday, October 24, 2016, 09:21: RGA off.

Monday, October 24, 2016, 09:23: Ion gauge & Turbo pumps off

Monday, October 24, 2016, 12:54: Venting.

Monday, October 24, 2016, 15:45: Remove metal mesh covering roughing pump exhaust.

Clean out mesh (3/4"-5/8" thick w/ layers of dust/material).

Monday, October 24, 2016, 15:52: Roughing 710.0 T.

Monday, October 24, 2016, 15:54: BV1B opened.

Monday, October 24, 2016, 16:00: Rouging 2.0 T.

Monday, October 24, 2016, 16:10: Turbo pumps available.

Tuesday, October 25, 2016, 08:08: Venting.

Tuesday, October 25, 2016, 08:40: Doors open.

Tuesday, October 25, 2016, 08:50: Roughing.

Tuesday, October 25, 2016, 08:51: Doors sealed for roughing.

Tuesday, October 25, 2016, 08:52: BV1B opened.

Tuesday, October 25, 2016, 09:10: Turbo pumps available & started.

Tuesday, October 25, 2016, 09:20: Ion gauge on.

Thursday, October 27, 2016, 08:35: Ion Gauge & Turbo pumps off.

Thursday, October 27, 2016, 11:44: Venting.

Thursday, October 27, 2016, 13:36: Roughing.

Thursday, October 27, 2016, 14:27: Turbo pumps started.

Thursday, October 27, 2016, 14:33: Ion gauge on.

Thursday, October 27, 2016, 14:35: Both Turbo pumps at speed.

Thursday, October 27, 2016, 16:00: RGA on.

Friday, October 28, 2016, 07:57: Water lines opened. No response on RGA. Vacuum stable @ 2.80e-07T.

Monday, October 31, 2016, 09:42: Power/sources on.

 Monday, October 31, 2016, 09:43: Auto-ramping TGHT to 500 A @ 2A per min.

Monday, October 31, 2016, 14:46: TGHT @ 500 A, looks ok. Auto-ramping TGHT to 580 A @ 2A per min.

Monday, October 31, 2016, 15:28: TGHT @ 580 A. 

Wednesday, November 02, 2016, 08:23: Auto-cooling TGHT @ 2A per min.

Wednesday, November 02, 2016, 13:15: Auto-cooling complete.

Thursday, November 03, 2016, 08:40: Sources/power off.

Thursday, November 03, 2016, 08:42: Water lines purged.

Monday, November 07, 2016, 08:08: RGA off. Ion gauge off. Turbo pumps off.

Tuesday, November 08, 2016, 08:07: Turbo pumps restarted. Removal not yet required.

Tuesday, November 08, 2016, 08:13: Ion gauge switched on.

Wednesday, November 16, 2016, 08:05: Ion Gauge off. Turbo pumps off.

Wednesday, November 16, 2016, 09:45: Venting.

Wednesday, November 16, 2016, 10:50: Begin roughing.

Wednesday, November 16, 2016, 11:52: Turbo pumps on.

*Note* Unusual sound noticed right at the start up of TSG : TP1B. It was first noticed prior to venting UC#18. The sound only lasts 10-15 seconds within a minute of starting the pump. An odd whine with tapping sound. Operation is otherwise normal, but will continue to monitor the pump.

Wednesday, November 16, 2016, 11:57: Ion gauge on.

Wednesday, November 16, 2016, 12:03: Both pumps are at speed

Thursday, November 24, 2016, 10:08: Ion gauge & Turbo pumps off.

Thursday, November 24, 2016, 11:07: Venting.

Thursday, November 24, 2016, 10:15: Discuss w/ Aurelia. Camera container filled with Argon. Place under Vacuum, monitor w/ RGA.

Thursday, November 24, 2016, 11:43:Pump down started. Camera and case placed near RGA.

Thursday, November 24, 2016, 12:42: Turbo pumps started

Thursday, November 24, 2016, 12:51: Turbo pumps at speed. RGA on

*Note: Nitrogen Anomaly noted on RGA and in report.*

Friday, November 25, 2016, 10:11 : Stopped turbos. RGA off. -AM

Friday, November 25, 2016, 11:10: Venting -AM

Thursday, November 24, 2016, 08:05: Whining sound (high pitch) heard from TMS:TP2

Thursday, November 24, 2016, 10:37: Sound fades in and out roughly every 3-5 minutes. Vacuum group notified. Monitor.

Thursday, November 24, 2016, 15:21: Vent tomorrow AM as per Vacuum group. Edi.

Thursday, November 24, 2016, 15:38: Turbo  pumps TMS:TP6 & TMS:TP2 were turned of. Backing valves closed. Ion gauge IG6 also off.

Thursday, November 24, 2016, 16:34: Two short vent bursts. - AM

Friday, November 25, 2016, 10:21: Venting -AM

Friday, November 25, 2016, 11:00: Pump being replaced

 Friday, November 25, 2016, 14:01: Roughing

Friday, November 25, 2016, 14:40: Turbos started.

Friday, November 25, 2016, 14:45: Turbos at speed. Vacuum at 1.9E-5 T

*** Note *** : One of the copper cooling lines was leaking. The line was fixed. Monitor.

Monday, November 28, 2016, 08:47: Turbo pump operating well. No leaks detected on cooling lines.

Monday, November 28, 2016, 15:35: Begin roughing. Monitor exhaust mesh cover. 

*Cover was found on the ground earlier today and re-attached*

 Monday, November 28, 2016, 15:55: Exhaust mesh OK. Roughing continued.

Tuesday, November 29, 2016, 14:55: Test partially vented. @ around 550 T. Roughing restarted. Test delayed until tomorrow.

Wednesday, November 30, 2016, 07:23: Venting

Wednesday, November 30, 2016, 07:23: Venting

Wednesday, November 30, 2016, 08:35: Roughing.

Wednesday, November 30, 2016, 09:01: RGA on. Turbos @ speed. Ion gauge on.

Wednesday, November 30, 2016, 09:35: RGA off. Ion gauge off. Turbo pumps off.

Wednesday, November 30, 2016, 09:47: Turbo pumps were internally vented. Venting continued.

Wednesday, November 30, 2016, 10:16: Roughing

Wednesday, November 30, 2016, 11:05: Turbo pumps on.

Wednesday, November 30, 2016, 11:13: Ion gauge on.

Thursday, December 15, 2016, 09:19: TMS : IG6 off. TSG : IG1 off.

Thursday, December 15, 2016, 09:20: TMS : BV6 & BV2 off. TSG : BV1A, & BV1B off. Turbo pumps TMS : TP6 & TP2 off. TSG : TP1B & TP1A off.

Friday, December 16, 2016, 07:59: Roughing pumps shut down. Test stand closed for the holidays.

Tuesday, January 03, 2017, 08:26: TSG : RP1 & TMS : RP2 restarted.

Wednesday, January 04, 2017, 11:18: TSG : PV1 & TMS : PV2 opened.

Wednesday, January 04, 2017, 11:19: TSG : BV1A & TSG : BV1B opened. TMS : BV2 & TMS : BV6 open.

Wednesday, January 04, 2017, 11:25: Turbo pumps TSG : TP1A & TP1B on. Monitor startup.

Wednesday, January 04, 2017, 11:31: TSG : IG1 on. TP1B @ speed.

Wednesday, January 04, 2017, 11:34: TSG : TP1A @ speed

Wednesday, January 04, 2017, 11:35: Turbo pumps TMS : TP2 & TP6 on. Monitor Startup.

Wednesday, January 04, 2017, 11:40: Both Turbo pumps @ speed. TMS : IG6 on.

Friday, January 13, 2017, 08:49: Ion gauge off, Turbos off.

Wednesday, January 18, 2017, 08:28: Venting.

Wednesday, January 18, 2017, 09:22: Roughing

Wednesday, January 18, 2017, 09:41: Turbo pumps started.

Wednesday, January 18, 2017, 11:01: Ion gauge on.

Thursday, January 19, 2017, 08:15: Water lines opened. No response on RGA. Vacuum stable @ 1.70e-07T.

Thursday, January 19, 2017, 08:55: Power/Sources on. BIAS/EZL/EE @ 30/15/1.5 kV . Coil @ 50 A . Anode @ 200 V.

Thursday, January 19, 2017, 08:59: IV4 opened. Auto ramping TGHT / TBHT to 580 / 290 A @ 2A per min.

Friday, January 20, 2017, 08:25: TSG : TP1A and TSG : BV1A were noticed to be tripped around 6am.

Friday, January 20, 2017, 08:42: Bypass to restart TSG : TP1A and TSG : BV1A. TP1A is at speed.

Friday, January 20, 2017, 11:48:  Auto ramping  TBHT to 320 A @ 2A per min.

Friday, January 20, 2017, 15:51: Coil @ 100A

Saturday, January 21, 2017, 11:00: Increased TB HT voltage limit to 2.75 V. TBHT current went back up from 313 to 319 A. -AM

Monday, January 23, 2017, 10:08: Argon Valve closed.

Monday, January 23, 2017, 10:33: Neon Valve closed.

Monday, January 23, 2017, 11:00: Auto-cooling @ 4A per min. Coil reduced from 100 A to 50 A

Monday, January 23, 2017, 13:32: Power/sources off.

Monday, January 23, 2017, 13:35: RGA off. IV4 closed. Ion gauge off. Turbo pumps off.

 Monday, January 23, 2017, 14:45: Venting

Friday, January 20, 2017, 08:25: TSG : TP1A and TSG : BV1A were noticed to be tripped around 6am.

Friday, January 20, 2017, 08:42: Bypass to restart TSG : TP1A and TSG : BV1A. TP1A is at speed.

      ------      

Continue to monitor.

Monday, January 23, 2017, 15:30: Roughing

Wednesday, January 25, 2017, 09:05: Venting

No EE. Insulators, gripper arms, and blank EE plate included

-New grounded 9 pins included in brackets

-TGHT included to out gas Heat shield

Wednesday, January 25, 2017, 09:45: Roughing

Wednesday, January 25, 2017, 10:04: Turbo pumps started.

Wednesday, January 25, 2017, 11:26: Ion gauge & RGA on.

Thursday, January 26, 2017, 08:25: RGA restarted. (Fatal communication error)

Thursday, January 26, 2017, 08:32: Water lines opened. No response on RGA. Vacuum stable @ 1.44e-07T.

Thursday, January 26, 2017, 08:35: Power/sources on.

Thursday, January 26, 2017, 08:37: Auto-ramping TGHT to 580A @ 2A per min. Vacuum @ 1.44e-07T.

Thursday, January 26, 2017, 13:11: RGA restarted. (Fatal communication error)

Thursday, January 26, 2017, 15:20: RGA restarted. (Fatal communication error)

Thursday, January 26, 2017, 15:26: RGA being shut down. (Fatal communication error)

Thursday, January 26, 2017, 15:31: RGA Restarted.

Friday, January 27, 2017, 08:06: RGA running ok.

Friday, January 27, 2017, 15:23: Auto-cooling started @ 2A per min.

Monday, January 30, 2017, 08:02: RGA off. Ion Gauge off. Turbo pumps off.

Monday, January 30, 2017, 08:05: Power/sources off. Water lines purged.

Monday, January 30, 2017, 09:09: Venting.

Target Test (Fully Cleaned vs Crystal Clean only).

For all tests:

-Start Turbo pumps & Ion gauge as soon as available on ISAC TEST STAND VACUUM Screen.

- Ensure previous test turbos are off by 8:15 and started venting by 9:15am to meet timeline.

-Start Roughing by 10:10am +/- 1 minute.

-TGHT / TBHT ramping starts @ 8:30am. 2A per min to 580A / 200A

ALL START TIMES MUST BE CONSISTENT.

***Pre-outgassed*** Heat Shield W.O# 41751-6: Includes insulators, new Al grounded 9-pin, bracket, & gripper arms. Blank/Plate. No source cup/EE.

HP-SIS Target # 42218-9: Crystal Clean only.

Monday, January 30, 2017, 09:44: HS removed from test stand. Exchange target.

Monday, January 30, 2017, 10:01: Target # 42218-9 placed into test stand. Door open for 17 minutes.

Monday, January 30, 2017, 10:10: Roughing.

Monday, January 30, 2017, 10:10: Doors sealed for roughing.

Monday, January 30, 2017, 10:11: BV1B OPEN. Opened @ 350T.

Monday, January 30, 2017, 10:29: Both Turbo pumps started.

Monday, January 30, 2017, 10:34: Ion gauge on. TP1B @ speed 42 KRPM.

Monday, January 30, 2017, 10:37: TP1A @ speed 38 KRPM.

Monday, January 30, 2017, 10:40: RGA on. Vacuum @1.24E-05T.

Monday, January 30, 2017, 15:30: Vacuum @ 4.49E-07T.

Tuesday, January 31, 2017, 08:14: Water lines opened. No response on RGA. Vacuum stable @ 1.44E-07T.

Tuesday, January 31, 2017, 08:19: Power/Sources on.

Tuesday, January 31, 2017, 08:20: DAQPro loose. re-connected.

Tuesday, January 31, 2017, 08:30: Auto ramping TGHT / TBHT to 580 / 200 A @ 2A per min.

Tuesday, January 31, 2017, 10:00: Check. Vacuum @ 7.73E-07T.

Tuesday, January 31, 2017, 11:40: Check. Vacuum @ 3.42E-07T.

Tuesday, January 31, 2017, 13:30: Check. Vacuum @ 2.34E-07T

Tuesday, January 31, 2017, 15:30: Auto-cooling started @ 2A per min.

Wednesday, February 01, 2017, 08:10: Power/sources off.

Wednesday, February 01, 2017, 08:14: Waterlines purged.

Wednesday, February 01, 2017, 08:15: RGA, Ion gauge, turbo pumps off.

Wednesday, February 01, 2017, 09:15: Venting.