*Vacuum from previous test still active, minus turbo pumps. Same target, & heat shield as well.*

Wednesday, February 15, 2017, 13:38: Both Turbo pumps started.

Wednesday, February 15, 2017, 13:43: Ion gauge on. TP1B @ speed 42 KRPM.

Wednesday, February 15, 2017, 13:51: RGA on. Vacuum @4.79E-05T.

Monitor water & vacuum with the RGA.

Thursday, February 16, 2017, 09:05: Main water supply & return shut off to the test stand. Purged. Vacuum @ 7.13E-07T.

Thursday, February 16, 2017, 09:16: Vacuum @ 3.59E-07T. Confirms water leak

Thursday, February 16, 2017, 09:17: RGA stopped.

Thursday, February 16, 2017, 09:20: RGA restarted.

Thursday, February 16, 2017, 09:30: Open main supply & return water supply. Individual valves are closed.

Thursday, February 16, 2017, 09:35: Open supply and return to FS #2. Vacuum @ 3.24E-07T. No response on RGA

Thursday, February 16, 2017, 09:40: Open supply and return to FS #3. Vacuum @ 6.76E-07T. Response on RGA. (Leak detected)

Thursday, February 16, 2017, 09:42: Close main Supply & Return. Purge & close FS #2 & FS #3 . Allow vacuum to stabilize.

Thursday, February 16, 2017, 09:50: Open main supply & return water supply. Open supply and return to FS #3. Vacuum @ 6.76E-07T. Response on RGA. (Leak confirmed)

Thursday, February 16, 2017, 09:53: Close main Supply & Return. Purge & close FS #3 . Allow vacuum to stabilize.

Thursday, February 16, 2017, 09:55: Open main supply & return. All valves are closed. Vacuum @ 3.51E-07T

Thursday, February 16, 2017, 10:00: Open supply and return to FS #4. Vacuum @3.26E-07T. No response on RGA.

Water leak confirmed in FS #3

Thursday, February 16, 2017, 10:05: Close main Supply & Return. Purge & close FS #4 . Allow vacuum to stabilize.

Thursday, February 16, 2017, 10:37: RGA off.

Thursday, February 16, 2017, 10:38: Ion gauge. Turbos off

Thursday, February 16, 2017, 11:58: Venting

Friday, February 17, 2017, 14:10: Roughing.

Friday, February 17, 2017, 14:30: Both Turbo pumps started.

Friday, February 17, 2017, 14:36: Ion gauge on.

Friday, February 17, 2017, 14:44: RGA on. Vacuum @ 2.32E-05T. Note* Waterlines FS #3 currently pressurized with 38 PSI Helium.

Monday, February 20, 2017, 08:26: Vacuum @ 2.60E-07T

Leak is apparent on RGA via Helium. He @ 20 PSI

Monday, February 20, 2017, 09:55: He in line brought up to 40 PSI. Monitor on RGA.

Monday, February 20, 2017, 10:00: No response on RGA. Connectivity gaps?. 

Monday, February 20, 2017, 10:05: RGA restarted. 

Monday, February 20, 2017, 10:39: Top cage removed from test stand. Waterlines purged of Helium. Immediate drop in RGA Helium reading.

Monday, February 20, 2017, 11:23: FS #3 (K) re-routed with return from (F). EE (K) pressurized with He @ 20-30 PSI. No significant response on RGA. Purge He

Monday, February 20, 2017, 11:36: FS #3 (K) returned back to (G). Return connected through (E). Pressurized to 20-30 PSI. No significant response on RGA. Purge He

Monday, February 20, 2017, 11:46: FS #3 (K) routed through to (H). (F) return to return. Pressurized to 20-30 PSI. Left pressurized for one hour

Monday, February 20, 2017, 12:51: No response on RGA. He Purged.

Monday, February 20, 2017, 12:55: Re-pressurize all of FS #3 with He @ 30 PSI.

Monday, February 20, 2017, 13:00: Purge Helium. Switch to water.

Monday, February 20, 2017, 13:12: Water supply/return on. No response on RGA.

Monday, February 20, 2017, 13:22: Slow response noted on RGA. Slow climb on water observed.

Monday, February 20, 2017, 13:30: Slight increase from 2.52E-07T to 3.26E-07T noted on Vacuum. Purge water lines. Reconnect/route lines & Test.

Monday, February 20, 2017, 13:40: FS #3 (K) re-routed with return from (F). EE (K). Open waterlines & observe.

Monday, February 20, 2017, 13:57: No response on RGA or Vacuum. Purge water & Re-route lines.

Monday, February 20, 2017, 14:05: FS #3 (K) returned back to (G). Return connected through (E). Open waterlines & observe.

Monday, February 20, 2017, 14:10: The water leak is apparent on (G) & (E) route. Vacuum climbed from 2.80E-07T to 3.33E-07T. RGA shows increase on water.

Monday, February 20, 2017, 14:14: Purge water lines.

Monday, February 20, 2017, 14:21: FS #3 (K) routed through to (H). (F) return to return. Waterlines opened to rule out (F) & (H) route.

Monday, February 20, 2017, 14:30: No response on RGA. Vacuum Stable. Purge water & Re-connect lines back to standard.

Monday, February 20, 2017, 15:22: Intermittent purging. Flow meter paddles pick up speed with air if purged for too long.

Tuesday, February 21, 2017, 08:34: RGA off, Ion gauge off, Turbos off.

Tuesday, February 21, 2017, 09:32: Venting.

Water leak found on water block lines (E) & (G) on FS #3.

Both lines were removed at the water blocks and the coil connection at the heat shield. They ends were blanked off.

Tuesday, February 21, 2017, 10:32: Roughing

Tuesday, February 21, 2017, 10:34: BV1B opened.

Tuesday, February 21, 2017, 10:51: Turbo pumps started.

Tuesday, February 21, 2017, 11:23: Ion gauge & RGA started. Vacuum @ 7.60E-06T.

Wednesday, February 22, 2017, 10:30: The test stand was pressurized with Air (HPA). The loop was completed through the heat shield line FS #5.

Pressurized @ 80 PSI w/ HPA. Monitor. No response on RGA or Vacuum.

Wednesday, February 22, 2017, 10:42: The test stand was pressurized with Helium. The loop was completed through the heat shield line FS #5. The air was purged from the lines using the Helium.

Pressurized @ 30 PSI w/ Helium. Monitor.

Wednesday, February 22, 2017, 11:57: De-pressurize the lines. No response on RGA.

Wednesday, February 22, 2017, 13:47: Pressurize line (G) @ 40 PSI w/ Helium directly.

Wednesday, February 22, 2017, 14:00: No response on RGA or Vacuum. Disconnect.

Wednesday, February 22, 2017, 14:03: Pressurize line (E) @ 38 PSI w/ Helium directly.

Wednesday, February 22, 2017, 14:30: No response on RGA or Vacuum. Disconnect.

Thursday, February 23, 2017, 08:11: RGA, Ion gauge, & Turbo pumps off.

Thursday, February 23, 2017, 10:21: Venting.

Thursday, February 23, 2017, 11:45 Lines (G)(E) reinstalled w/ new seals

Thursday, February 23, 2017, 11:58: Roughing.

Thursday, February 23, 2017, 13:00:  Turbos on.

Thursday, February 23, 2017, 13:05: Ion Gauge on.

Thursday, February 23, 2017, 13:10: RGA on.

Friday, February 24, 2017, 08:15: Waterlines opened on FS #3.

Friday, February 24, 2017, 08:18: RGA froze.

Friday, February 24, 2017, 08:20: Restarted RGA.

Friday, February 24, 2017, 08:48: FS #2, #4, #5 all opened.

Friday, February 24, 2017, 10:20: Vacuum & Leak appear to be stable. Vacuum @ 2.54E-07T

Friday, February 24, 2017, 10:25: Cage re-installed on top of vacuum Chamber

Friday, February 24, 2017, 10:28: Power/sources on

Friday, February 24, 2017, 10:30: Auto ramping TGHT / TBHT to 580 / 200 A @ 4A per min. Heat check.

Friday, February 24, 2017, 10:37: RGA froze (Fatal communication error message).

Friday, February 24, 2017, 10:40: RGA restarted.

Friday, February 24, 2017, 13:30: No major sign of leak detected. Standard response on Vacuum and RGA to heating.

Friday, February 24, 2017, 13:55: Vacuum and water appear leveled off with no indication of a major leak.

Friday, February 24, 2017, 14:00: Auto-cooling started @ 4A per min.

Monday, February 27, 2017, 08:12: Power/sources off. The likely cause for the leak was one of the seals within lines (G)(E). Either one of the O-rings or VCR's. Once the seals were changed, no further leaks were detected.

Wednesday, March 08, 2017, 08:40: RGA timed out. RGA off. No leak detected.

Friday, March 10, 2017, 10:05: Water lines purged.

Friday, March 10, 2017, 10:09: Ion gauge & Turbos off.

Friday, March 10, 2017, 14:24: Venting.

The vacuum behaved erratic over night with excursion up into the mid 10^-6 Torr range. To investigate the chamber was vented. With the doors open, the o-rings and sealing surfaces were cleaned. When pumping down again a vacuum leak could be heard at the front door by the lock. The chamber was vented again twice, finally the two o-rings were swapped. This removed the large leak. The door is prevented from contacting the box at the lock, which is likely the source of the leak.

A water to vacuum leak has been found on FS#3. The leak is not detected on the leak detector, but can be seen as an increase in vacuum and on partial water pressure on the RGA

Wednesday, April 12, 2017, 17:11: The leak is on circuit EG (Coil +). Confirmed with water pressure

Wednesday, April 12, 2017, 17:21: RGA off. Turbos stopped.

Wednesday, April 19, 2017, 13:00: Leak detector hooked up to TS. (Check Turbo)

Wednesday, April 19, 2017, 14:00: He to FS#3.

Wednesday, April 19, 2017, 14:31: Minimal response on leak detector. No response on RGA.

Wednesday, April 19, 2017, 14:36: Manual valve closed. Leak detector off. RGA off.

Wednesday, April 19, 2017, 14:37: FS#3 purged.

Wednesday, April 19, 2017, 14:39: Ion gauge off. Turbos off.

Wednesday, April 19, 2017, 14:44: Leak detector disconnected.

Thursday, April 20, 2017, 07:35: Venting

Thursday, April 20, 2017, 09:10: TRI-COIL CTL-FEBIAD removed.

Thursday, April 20, 2017, 09:23: Water lines (E) (G) removed w/ block. 

Thursday, April 20, 2017, 09:30: Roughing.

Thursday, April 20, 2017, 10:04: Turbos on.

Thursday, April 20, 2017, 13:15: Leak detector attached & turned on.

Thursday, April 20, 2017, 13:25: Water lines FS#5 opened to create loop. Pressurized @ 30 PSI.

Thursday, April 20, 2017, 13:45: RGA on.

Thursday, April 20, 2017, 13:58: All lines opened, purged, and re-pressurized @ 30 PSI with He.

Thursday, April 20, 2017, 14:15: Minimal response on Leak detector. No response on RGA.

Friday, April 21, 2017, 07:26: Vacuum @ 4.87E-07T. No He response on RGA. Lines still pressurized @ 30 PSI of Helium.

Friday, April 21, 2017, 10:19: Vacuum level close, but not optimal after 24 hrs. 2e-07T range is optimal.

Friday, April 21, 2017, 10:22: Adjustment of Turbo (TSG:TP1B) flanges. Stud Flange to Chamber (loose nuts found). brief vacuum spike noted.

Friday, April 21, 2017, 10:27: Turbo pump flange to Stud Flange tightened. No change on vacuum.

Friday, April 21, 2017, 10:41: Test Stand Exhaust cleaned. Clog noticed. Monitor Vacuum

Monday, April 24, 2017, 10:24: Three leaks found on FS#3. Two on the soldered ends of the VCRS (Mid-line) and one on the block. Requires repair/replacement.

Tuesday, May 02, 2017, 08:32 : RGA off.

Tuesday, May 02, 2017, 08:33: Ion gauge & Turbos off.

Tuesday, May 02, 2017, 12:55: Venting

Tuesday, April 18, 2017, 07:30: TSG : TP1B Tripped on Saturday.

Tuesday, April 18, 2017, 07:40: TSG : BV1B opened. TSG : TP1B restarted.

Tuesday, April 18, 2017, 07:48: TSG : TP1B failed to restart.Turn off.

Tuesday, April 18, 2017, 07:59: TSG : BV1B opened. TSG : TP1B restart attempt. No audible response detected.

Tuesday, April 18, 2017, 08:01: The turbo pump is off and BV1B closed. Fault report entered #9815.

Tuesday, April 18, 2017, 09:40: Ion gauge, remaining turbo pump off.

Tuesday, April 18, 2017, 13:00: Vacuum Group arrival to change TSG : TP1B.

Once the turbo pump cooling line was loosened slightly, a slight water leak occurred. Line snapped. Water leak. Valves to all turbo pump cooling closed.

***NOTE*** - From Thursday, November 24, 2016, 08:05: TMS:TP2

Friday, November 25, 2016, 14:45: Turbos at speed. Vacuum at 1.9E-5 T

*** Note *** : One of the copper cooling lines was leaking. The line was fixed. Monitor. <---- Due to this recurring issue, the decision was made to air cool the turbo pumps.

Tuesday, April 18, 2017, 14:10: Air cooling to replace water cooling. TSG : TP1A already has air cooling. Replace the cooling on the other 3 of 4 turbo pumps.

Tuesday, April 18, 2017, 15:27: All turbo pump cooling replaced with air cooling. TSG : TP1B successfully replaced.

Wednesday, April 19, 2017, 07:57: Roughing.

Wednesday, April 19, 2017, 09:01: Turbo pumps on. Bypass made on water flow (Still air cooled overall)

Wednesday, April 19, 2017, 09:15: TSG :TP1A accidentally tripped. Restarted.

Wednesday, April 19, 2017, 09:42: Both turbo pumps off. Unable to achieve proper vacuum.

Wednesday, April 19, 2017, 11:04: Roughing.

Wednesday, April 19, 2017, 11:44: TSG :TP1A on.

Wednesday, April 19, 2017, 11:51: TSG :TP1B on.

Wednesday, May 17, 2017, 10:17: Sparking around 20 kV. Will need to vent to increase gap between water lines.

Turbos stopped.

Wednesday, May 17, 2017, 10:50: Reset IV4.

Wednesday, May 17, 2017, 10:59: Venting.

Wednesday, May 17, 2017, 11:42: Increased clearance to GND electrode.

Wednesday, May 17, 2017, 11:42: Roughing

Wednesday, May 17, 2017, 12:01: Turbos started

 The Test Stand has been configured for Anode bias. John Chow changed the power supply and the electrical connections have been wired according to ISK4523D REV 6.

Wednesday, May 24, 2017, 17:37: Anode current reduce to 285 A. Anode drain current limited  to a maximum of 300 A. This will be left overnight to see if there is an increase in anode drain current. as was seen today.

Anders Mjos wrote:

The Test Stand has been configured for Anode bias. John Chow changed the power supply and the electrical connections have been wired according to ISK4523D REV 6.   Wednesday, May 24, 2017, 17:37: Anode current reduce to 285 A. Anode drain current limited  to a maximum of 300 A. This will be left overnight to see if there is an increase in anode drain current. as was seen today.

 The Test Stand has been  configured for Cathode bias. John Chow changed the power supply and the electrical connections have been wired according to ISK4563 REV 5.

 Thursday, August 03, 2017, 17:00: Restarted TPs

 The Xantrex 10V 600 A power supply for the TBHT has been moved to ITE to replace the failed TGHT power supply

Anders Mjos wrote:

The Xantrex 10V 600 A power supply for the TBHT has been moved to ITE to replace the failed TGHT power supply

 A spare EMI-EMS 10 V - 500 A power supply was installed last Friday by John Chow. Dave Morris has connected the controls today and updated EPICS. The local voltage readback on the power supply does not work.

The turbo pump will need replacement.

Turbo pump TP6 requires replacement.

Wednesday, November 15, 2017, 09:55: Turbo (TP2) off. Ion gauge off.

Wednesday, November 15, 2017, 10:55: Venting

Power outage over the weekend. Reboot PLC and systems.

Monday, December 04, 2017, 08:22: Turbo pumps TMS:TP6 & TP2 Restarted.

Monday, December 04, 2017, 08:28: Time out on turbo pump TP1B.

Monday, December 04, 2017, 09:25: Turn off/restart TSG:TP1B Maincontrol.

Monday, December 04, 2017, 09:26: TMS:IG6 Restarted.

Monday, December 04, 2017, 14:24: Multi gauge controller to TSG:IG1 burned out. Replaced. Vacuum @ 4.45e-06T. Monitor.

Tuesday, January 02, 2018

Cycled power for TCSIOC and PLCIOC

TP2 and TP6 started

TP1B does not start. TP1B controller does not start up correctly - controller will have to be replaced. E-fault submitted (10739).

Controller for PS for Q1,6 was switching constantly. Unplugged and plugged back in resolved the problem

TP1A started

(Aaron Schmidt)

Wednesday, January 03, 2018, 08:15:  TSG:TP1B Still non-responsive.

Wednesday, January 03, 2018, 08:20: Power/sources on. Add Voltage/Amp and check power supplies.

BIAS - 300V Reads 290V - OK

EE - 300V Reads 298V - OK

EZL - 300V Reads 293 V - OK

CB1 - 10V Reads 10V - OK

VCB1 - 10V Reads 10V - OK

CBC (both)  - 10V Reads 9V - OK

TBHT - 10A Reads 9.9A (009 direct off PS) - OK

TGHT - 10A Reads 9.8A (007 direct off PS) - OK

Optics Check:

Magnet ok - Some optics start, some do not respond. Submit fault report for communications issues.

Fault Report submitted - 10742

Thursday, January 04, 2018, 14:38:

Kyle and Dave were able to get all the canbus optics for ISAC test stand re-configured except one device: TMS:Q2

"We investigated and it looks like the controller board for the TMS:Q2 supply is toast. Unfortunately these boards are a very old style so we don't have a surplus of replacements on hand. Our electronics shop did have some spares but the spares are not ready for use and need to have a few components soldered on. " - Kyle

The repaired controller board should be ready for next week.

Wednesday, January 10, 2018, 13:22: TS optics all fixed. Turbo pump TP1B is still out.

Monday, February 05, 2018, 09:10: the epics program was in 'White-out'. Turbo pumps tripped.

Unplug, re-plug PLC.

Monday, February 05, 2018, 09:16: Restart Turbo pumps on chamber & beamline.

Monday, February 05, 2018, 09:21: Ion gauges on.

Tuesday, February 06, 2018, 09:00: TSG:CB1 noted to be red. Attempts to restart/reconfigure failed. Alive displays red MAJOR. Fault submitted.

Tuesday, March 20, 2018, 09:11: TMS:Q5 & TMS:Q2 controllers require repair. Unable to hold a negative voltage.

+ @ 680V

- @ 0V (Should be 680V as well)

Kyle L. & Rod N notified.

Tuesday, March 20, 2018, 12:58: The controller was fixed.

Pump found off on Tuesday morning.

Tuesday, May 22, 2018, 08:40: Starting TP1A

Tuesday, May 22, 2018, 08:47: TP1A at speed

Tuesday, May 22, 2018, 16:33: Source and optics off

Wednesday, May 23, 2018, 08:30: Stopped TP

Wednesday, May 23, 2018, 14:10: Water purged

Thursday, May 24, 2018, 08:38: TPs stopped

Thursday, May 24, 2018, 09:18: Venting

Thursday, May 24, 2018, 14:30: IG6 replaced (second attempt) by Anthony. System pumping down

Thursday, May 24, 2018: Configured coil to be (-) E&F, (+) G&H. Water should be supplied to both terminals in either configuration.