Logbooks Lab Maintenance Evaporator_1 Evaporator_2 Laser cutter Target Production Test-Stand RH-ISAC RH-Cyclotron RH-Meson Hall RH-Beamlines RH-ARIEL
  Test-Stand, Page 39 of 53  Not logged in ELOG logo
  ID Date Author Target/No.# Source Station Moduledown Target Oven W.O# Heat Shield W.O# Status Subject
  694   Tuesday, November 06, 2018, 08:52 Aaron Schmidt      In progressPump down empty chamber

Tuesday, November 06, 2018, 08:50: Roughing

Tuesday, November 06, 2018, 08:51: Doors sealed.

Tuesday, November 06, 2018, 09:51: Turbo pumps on. 


Thursday, November 08, 2018, 06:45: Ion gauge & Turbo pumps off. 

Thursday, November 08, 2018, 08:36: Venting.

  695   Thursday, November 08, 2018, 10:54 Aaron Schmidt LP-FEBIAD  395530-342752-5In progressTest FEBIAD w/ Silver bolts & sealed end caps

Silver bolts used on Coil, TGHT, & TBHT. Back panel opened for new gas bottles.

Thursday, November 08, 2018, 10:52: Roughing

Thursday, November 08, 2018, 10:53: Doors sealed.

Thursday, November 08, 2018, 14:10: Turbo pumps started.

Thursday, November 08, 2018, 14:15: Ion gauge on.

Thursday, November 08, 2018, 14:23: RGA on.


Friday, November 09, 2018, 07:38: Waterlines opened. No response on RGA. Vacuum ok @ 5.18e-07T

Friday, November 09, 2018, 07:44 : Slowly start opening gas lines. Opened / closed SV5 initially, no response. Note* Opened SV3 with SV5 closed. Massive spike seen in vacuum.

Friday, November 09, 2018, 07:55 : SV3 opened / closed in conjunction with SV5 until stable vacuum reached. Begin opening SV4 w/ SV5 closed.

Friday, November 09, 2018, 08:09 : SV3 & SV4 opened with SV5, Stable vacuum reached. Begin opening SV2/SV1 w/ SV5 closed.

Friday, November 09, 2018, 08:15: All gas lines opened. Sources on.

Friday, November 09, 2018, 08:22: BIAS / EZL / EE @ 30 / 13.5 / 1.5 kV. Anode @ 200 V. IV4 opened. Optics switched on.

Friday, November 09, 2018, 08:40: Auto-ramping TGHT / TBHT to 580 / 300 A @ 2A per min. Loop to max values, increase of 0A until vacuum gets below 1.0e-06T. Vacuum 1.12e-06T.

Friday, November 09, 2018, 10:45: The vacuum wouldn't drop below 1.12e-06T. Ramping halted and gas lines closed. Vacuum dropped to 7.48e-07T. Gas lines opened again. Vacuum stable around 1.12e-06T. Significant Argon noted on RGA.

Friday, November 09, 2018, 10:52: Auto-ramping TGHT / TBHT to 450 / 200 A @ 2A per min. Vacuum increment limit increased to 2.0e-06T


Tuesday, November 13, 2018, 08:32: Auto-ramping TGHT / TBHT to 580 / 300 A @ 2A per min.

Tuesday, November 13, 2018, 11:08: Mass scans ok. Auto-ramping TBHT to 330 A @ 2A per min.

FM

Tuesday, November 13, 2018, 16:44: The anode drain current has increased 17mA since 11:23 am, however FC0 is still decreasing. I will keep monitoring to see if the behaviour of the anode drain current continues once FC0 has stabilized. If the anode drain current keeps increasing maybe we will observe the same failure from the previous FEBIAD.


FM

Wednesday, November 14, 2018, 11:02 FC0 is stable but the anode drain current is still increasing and now is at 85 mA. It started at ~52mA. From the strip tool it seems to be a 2-hour period where the anode drain current is stable.

Wednesday, November 14, 2018, 16:14 : Magnet tune for 40Ar. TMS:MB1=101.56126 A

Coil=50 A. FC6=19.37 nA

Wednesday, November 14, 2018, 16:16 : Closing Neon valve.

Wednesday, November 14, 2018, 16:26 : FC6=13.77 nA.

Wednesday, November 14, 2018, 16:27: Closing Argon valve 

Wednesday, November 14, 2018, 17:10: 0.119 nA.

Wednesday, November 14, 2018, 17:15 Assuming the 720 nA from Brad (I will recompute this value based on the new bottles). Efficiency with both gasses open= 2.67375% . Efficiecy with Argon bottle only=1.84%. Anode drain current~87.5mA

 Wednesday, November 14, 2018, 17:53: When opening the Neon valve, the vacuum reached ~1e-5 T and the test stand tripped. Ion source off, high voltage and some of the optics as well. Leaving the test stand as is. 

Wednesday, November 14, 2018, 17:58: Note to myself: How am i gonna take an efficiency measurement if every time I turned the gas valves the vacuum will increase to 1e-5 T. 


Thursday, November 15, 2018, 08:33: Sources at zero. Bring values to 0 before restarting. Reset optics.

Thursday, November 15, 2018, 08:45: Power to sources off. Open the back & double check gas bottles. All are tight.

Thursday, November 15, 2018, 09:35: All gas bottles opened.

Thursday, November 15, 2018, 09:58: Power/sources reset/on.

Thursday, November 15, 2018, 10:04: BIAS / EZL / EE @ 30 / 13.5 / 1.5 kV. Anode @ 200 V. IV4 opened. 

Thursday, November 15, 2018, 10:05: Auto-ramping TGHT / TBHT to 580 / 300 A @ 2A per min.

Thursday, November 15, 2018, 10:07: Optics reset.

FM

 Thursday, November 15, 2018, 18:46: Coil to 50 A. 


Friday, November 16, 2018, 08:40: Emittance Rig reset & calibrated.

 FM

Friday, November 16, 2018, 11:30 : Auto-ramping  TBHT to 310 A @ 1A per min.

Friday, November 16, 2018, 16:28 Friday, November 16, 2018, 16:28 : Gain in FC0 seems off. Reading on FC0 was 2.8e-8A but reading on FC6 was 4.5e-8A. In the last mass scan, I add up the highest peaks above 1e-9A  and the values was roughly 7e-8A. Switching the gain to 94uA in FCO shows 8.32e-8 A. This seems a better reading than before.

Friday, November 16, 2018, 16:30 Changing gacin on FC0 from 1 uA to 94 uA.


FM

Monday, November 19, 2018, 09:34 : Scanning from 0-450 V and recording Anode drain current.

IG1 reading is 3.01e-6 T.

Monday, November 19, 2018, 10:01 : When Moving away FC0, the optics goes yellow. Not sure which interlock is activated.

AS

Optics tripped during FC0 removal. Vacuum spikes also detected on IG1 & IG6. No response on RGA.

Monday, November 19, 2018, 11:17: RGA providing no data. Stop, restart, multiple times. 

Monday, November 19, 2018, 11:25: RGA shut down. No response from and attempt to restart. 

Monday, November 19, 2018, 11:30: FC0 opened. Optics tripped. Vacuum increased on IG6 up to 7.9e-06T & IG1 increased to 4.4e-06T. Shut again to avoid tripping the entire system as the vacuum climbed.

Monday, November 19, 2018, 11:34: Auto-cooling @ 2A per min. Ramp down & trouble shoot after.

Monday, November 19, 2018, 14:11: Tap down HV on sources to 0V. Close & reset IV4. After closing IV4, spike in Vacuum on IG6 noted. Drop in vacuum on IG1 noted.

  696   Thursday, November 08, 2018, 14:13 Aaron Schmidt       Ar & Ne gas bottle replacement.

Thursday, November 08, 2018, 14:05: Fresh / recently calibrated Neon & Argon bottles installed.

Leak rates: Argon=2.02E-7 atm*cc/sec

                   Neon=1.75E-7 atm*cc/sec

 

Datasheet attached.

 

Attachment 1: GasLeak_Datasheet.pdf
GasLeak_Datasheet.pdf GasLeak_Datasheet.pdf
  697   Monday, November 19, 2018, 14:22 Aaron Schmidt      Problems/SolutionsVacuum issues.

1) When opening FC0 a spike occurs in the vacuum on IG6 & IG1 (though not as bad). This spike trips off the optics, and if left unchecked, will trip off the TGHT / TBHT / Sources.

2) RGA is also unresponsive

3) Leak rates also noted in the Ar gas bottle for the FEBIAD source. Previous trips had occurred in the most recent FEBIAD tests.


 

Optics tripped during FC0 removal. Vacuum spikes also detected on IG1 & IG6. No response on RGA.

Monday, November 19, 2018, 11:17: RGA providing no data. Stop, restart, multiple times. 

Monday, November 19, 2018, 11:25: RGA shut down. No response from and attempt to restart. 

Monday, November 19, 2018, 11:30: FC0 opened. Optics tripped. Vacuum increased on IG6 up to 7.9e-06T & IG1 increased to 4.4e-06T. Shut again to avoid tripping the entire system as the vacuum climbed.

Monday, November 19, 2018, 11:34: Auto-cooling @ 2A per min. Ramp down & trouble shoot after.

Monday, November 19, 2018, 14:11: Tap down HV on sources to 0V. Close & reset IV4. After closing IV4, spike in Vacuum on IG6 noted. Drop in vacuum on IG1 noted.

Monday, November 19, 2018, 14:33: FC0 opened/closed. Vacuum Spike on IG6 noted from 1.5e-06T to 1.02e-05T and back down to 1.5e-06T. IG1 unaffected with IV4 closed.


Source gas lines remain off. Setup for LD on FC0.

Tuesday, November 20, 2018, 08:30: Pump switched on. Convectron gauge @ 18.6 mTorr, spiked to 125 mTorr after opening the valve to the pump. IG1 @ 3.0e-07T.

Allow time for the small pump to pump lines down before re-opening.

Tuesday, November 20, 2018, 08:38: Small vacuum spike noticed on IG1 up to 4.0e-07T after reopening line to the small pump. Convectron gauge spiked to 1.75T.

Tuesday, November 20, 2018, 09:05: Opened valve to the small pump. Small vacuum spike noticed on IG1 up to 5.77e-07T after reopening line to the small pump. Convectron gauge spiked to 3.55 Torr from 125 mTorr.

The small leak in SV5 allows the lines to 'pump down into the mTorr range, however upon opening the line to the pump, the line pressure increases.

Tuesday, November 20, 2018, 10:44: Opened valve to the small pump. Small vacuum spike noticed on IG1 up to 5.02e-07T after reopening line to the small pump. Convectron gauge spiked to 3.25 Torr from 18.6 mTorr.

Pump ineffective at pumping out the gas lines. Replace

Tuesday, November 20, 2018, 10:48: Small pump shut off. Move forward with LD of FC0

Tuesday, November 20, 2018, 13:21 : Valve opened w/ LD connected. Base:

IG6: 1.91e-06T

Leak rate: 7.4e-09 atm-cc/sec.

Apply He around FC0 (cup in):

IG6: 1.91e-06T

Leak rate: 5.5e-05 atm-cc/sec. Wait for leak rate stablization.

Tuesday, November 20, 2018, 13:48:

Apply He around FC0 (cup out):

IG6: 2.75e-05T

Leak rate: 9.9e-05 atm-cc/sec. Wait for leak rate stabilization. Bellows specifically will max out the LD.

-Leak confirmed on the bellows of FC0 as suspected. Submitting a fault report.

-RGA scans checked and taken. No response/noted 'noise'. No error messages displayed, however we will check/swap out the filament for a new one to confirm.


Monday, November 26, 2018, 08:10: Turbos & ion gauges off.

Monday, November 26, 2018, 09:32: Quick vent shot & hold.

  698   Wednesday, December 05, 2018, 10:22 Aaron Schmidt      Problems/SolutionsRGA Filament & Ionizer replacement

RGA Ionizer & Filament replaced as per SRS RGA manual.

The ionizer was found to be dirty and the previous RGA filament was broken. Initially the  old filament appeared to have warped and looked stuck to the anode grid/cage.

Both were replaced with clean parts. the support rods were also cleaned with acetone & methanol.

 

Parts used from the Replacement Ionizer Kit - SRS# O100RI

 

Repeller Cage - SRS Part# 7-00592

Anode Grid - SRS Part# 7-00591

Focus & Plate - SRS Part# 7-00590

ThO2/Ir Filament - SRS Part# 7-00611-720

 

Wednesday, December 05, 2018, 10:16: Roughing.

Probe bake out & RGA tuning required.

Wednesday, December 05, 2018, 11:08: Turbo pump on.

Wednesday, December 05, 2018, 11:13: Ion gauge on.

Wednesday, December 05, 2018, 13:38: TSG:BV1A Randomly shut off? TP1A tripped. Restarted.

Wednesday, December 05, 2018, 13:40: RGA switched on including the filament.


Thursday, December 06, 2018, 10:17: Vacuum @ 5.68e-07T on IG1 before Degas. Begin degas cycles 200 sec each, 1 min apart, 3 times.

Thursday, December 06, 2018, 10:30: Degas complete. Minimal change in IG1 Vac @ 5.70e-07T.

 

Attachment 1: 20181205_RGA-Old_I&F.jpg
20181205_RGA-Old_I&F.jpg
Attachment 2: 20181205_RGA-Old_I&F-2.jpg
20181205_RGA-Old_I&F-2.jpg
Attachment 3: 20181205_RGA-Old_I&F-Anode_view.jpg
20181205_RGA-Old_I&F-Anode_view.jpg
Attachment 4: 20181205_RGA-OLD_I&F-Broken_Filament_&_Dirty_Anode.jpg
20181205_RGA-OLD_I&F-Broken_Filament_&_Dirty_Anode.jpg
Attachment 5: 20181205_RGA-Old_I&F-Dirty_Anode-Focus_Plate.jpg
20181205_RGA-Old_I&F-Dirty_Anode-Focus_Plate.jpg
Attachment 6: 20181205_RGA-Old_I&F-Dirty.jpg
20181205_RGA-Old_I&F-Dirty.jpg
Attachment 7: 20181205_RGA-New_A&R.jpg
20181205_RGA-New_A&R.jpg
Attachment 8: 20181205_RGA-New_Anode_&_Filament.jpg
20181205_RGA-New_Anode_&_Filament.jpg
Attachment 9: 20181205_RGA-New_Anode_&_Repeller_cages.jpg
20181205_RGA-New_Anode_&_Repeller_cages.jpg
Attachment 10: 20181205_RGA-New_Filament_&_Ionizer_assy.jpg
20181205_RGA-New_Filament_&_Ionizer_assy.jpg
Attachment 11: 20181205_RGA-New_Filament_&_Ionizer_assy-2.jpg
20181205_RGA-New_Filament_&_Ionizer_assy-2.jpg
Attachment 12: TS-2018-12-05-13-40_RGA_Check.rga
  699   Thursday, December 06, 2018, 11:02 Aaron Schmidt      Problems/SolutionsFC0 Bellows Replacement.

Thursday, December 06, 2018, 11:02: Turbo pumps (TP6 & TP2) off on beamline side. IG6 off.

Thursday, December 06, 2018, 14:06: Turbo pumps restarted. FC0 bellows replacement to occur Monday.


Monday, December 10, 2018, 11:00: Vented on beam side of IV4. Turbo pumps & backing valves closed preemptively on chamber side due to shared airlines.

Pulled FC0, disassemble, check, clean, remove / install bellows, Re-align, assemble.

Monday, December 10, 2018, 12:52: Re-installed repaired FC0. Roughing beam side. Chamber side turbos back on.

Monday, December 10, 2018, 13:48: Turbo pumps on.

Monday, December 10, 2018, 13:51: Ion gauge on. IG6 @ 5.73e-06T and still dropping.


Tuesday, December 11, 2018, 09:26: IG6 Vacuum @ 3.56e-07T. Connected cables.

Tuesday, December 11, 2018, 09:27: Drive out FC0. Vacuum @ 3.75e-07T. Ok. Setup LD & drive FC0 back in.

Tuesday, December 11, 2018, 09:32:  LD baseline before opening valve to beam line turbo & RP pumps: below 0.0e-09 T-l/sec

Tuesday, December 11, 2018, 09:36: Full open base, FC0 in:

Vacuum @ 3.56e-07T.

LD:  0.0e-09 atm-cc/sec

Spray w/ He:

No change.

Tuesday, December 11, 2018, 09:42: FC0 out:

Vacuum @ 3.60e-07T.

LD: 0.0e-09 atm-cc/sec.

Spray w/ He:

No Change. Sprayed all flanges and seals all around FC0 and it's connection to the beam line. OK.

Tuesday, December 11, 2018, 09:46: Closed FC0 & line to the turbo & RP pumps. LD off.

FC0 Bellows replacement a success.

More pictures uploaded to Docushare.

 Home  --->  ISAC Test Stand  Contains  Test Stand Refurbishing  Contains  FC0 Bellows Replacement Listing

Attachment 1: 20181206_Old_Bellows.jpg
20181206_Old_Bellows.jpg
Attachment 2: 20181210_112528.jpg
20181210_112528.jpg
Attachment 3: 20181210_115310.jpg
20181210_115310.jpg
Attachment 4: 20181211_New_Bellows_installed.jpg
20181211_New_Bellows_installed.jpg
  700   Wednesday, December 12, 2018, 13:22 Aaron Schmidt LP-FEBIAD  395530-342752-5In progressAnode leak current check.

Wednesday, December 12, 2018, 13:15: Power / Sources on.

Wednesday, December 12, 2018, 13:20: RGA on / set.

Wednesday, December 12, 2018, 13:29: BIAS / EZL / EE @ 30 / 13.5 / 1.5 kV.

Wednesday, December 12, 2018, 13:30: Auto-ramping TGHT / TBHT to 10A @ 2A per min.

Wednesday, December 12, 2018, 13:36: IV4 open.

Wednesday, December 12, 2018, 13:37: Begin Anode check

Anode: 10 V. Current: 0.000 mA

Anode: 25 V. Current: 0.000 mA

Anode: 50 V. Current: 0.000 mA

Anode: 75 V. Current: 0.000 mA

Anode: 100 V. Current: 0.000 mA

Anode: 125 V. Current: 0.000 mA

Anode: 150 V. Current: 0.000 mA

Anode: 200 V. Current: 0.000 mA

Anode: 250 V. Current: 0.000 mA

Wednesday, December 12, 2018, 13:42: Coil to 10A. Anode: 250 V. Current: 0.000 mA

Wednesday, December 12, 2018, 13:43: Coil to 25A. Anode: 250 V. Current: 0.000 mA

Wednesday, December 12, 2018, 13:56: Auto-ramping TGHT / TBHT to 150A @ 2A per min.

Wednesday, December 12, 2018, 14:09: Auto-ramping halted @ 35A. Anode to 0 V. Monitor activity on FC0. 5 minutes.

Wednesday, December 12, 2018, 14:13: No changes observed on FC0. Anode back to 250 V.

Wednesday, December 12, 2018, 14:14: Auto-ramping TGHT / TBHT to 150A @ 2A per min.

Wednesday, December 12, 2018, 14:31: Optics all reset. 


Thursday, December 13, 2018, 07:31: Auto-ramping TGHT / TBHT to 200A @ 2A per min.

Thursday, December 13, 2018, 10:04: Auto-ramping TGHT / TBHT to 250A @ 2A per min.

FM Thursday, December 13, 2018, 10:40 : Auto-ramping TGHT / TBHT to 270A @ 2A per min.

FM Thursday, December 13, 2018, 12:44: Auto-ramping TGHT / TBHT to 290A @ 2A per min. 

FM Thursday, December 13, 2018, 12:56: FC0 gain set to 33nA

FM Thursday, December 13, 2018, 16:54: Anode drain current register at 310. Value was 1 mA. The resistor calculates is 30kOhm. Which is close to what was measured on the resistor on top 34kOhm.

With this new information. I will let the TBHT@290A and the TGHT@300A overnight.

Note to Aaron: Could you please heat up the target to 580A with the current settings we have.


Friday, December 14, 2018, 07:04:  Auto-ramping TGHT 580A @ 2A per min. TBHT remains @ 290 A. FC0 back in.

Friday, December 14, 2018, 14:15: Anode @ 250 V & 12.201 mA.

Friday, December 14, 2018, 14:22: BIAS /  EZL / EE to 0 V. Anode remains unchanged.

FM Friday, December 14, 2018, 18:04: TBHT down to 50. Anode drain current is still 12.21mA.

FM Friday, December 14, 2018, 18:05 Auto-cooling. i will keep monitoring the strip tools remotely.

  701   Monday, December 17, 2018, 12:03 Aaron Schmidt LP-FEBIAD  395530-342752-5 Anode leak current check.

Monday, December 17, 2018, 12:01: Connected Multimeter through feedthroughs J & L. Blue wire removed.

To run TGHT, TBHT, Anode ONLY. HV will remain locked with yellow tape over the keyhole. Currently locked out.


Tuesday, December 18, 2018, 08:37: Power / sources on

TGHT, TBHT, Anode, Coil on. NO HV.

Tuesday, December 18, 2018, 08:40: Turn off. Anode reading before PS on?

We found a steady climb on the Anode current via the epics controls, however no reading turned up on the multimeter. Disappears once the Anode PS is switched on.

Tuesday, December 18, 2018, 08:46: Power / sources on

TGHT, TBHT, Anode, Coil on. NO HV.

Tuesday, December 18, 2018, 08:49: Auto-ramping TGHT to 580 A @ 2 A per min.

Tuesday, December 18, 2018, 08:50: Anode set to 300 V.

 FM Tuesday, December 18, 2018, 13:42: TGHT @ 580 A Anode@300 V. Epics and the power supply shows ~20 mA. However the multimeter doesn't show any reading.

FM Tuesday, December 18, 2018, 14:25: Strange behavior noted on EE while doing the anode voltage scan. Screenshot added to the word document.

FM Tuesday, December 18, 2018, 14:25: Auto-ramping TBHT to 100 A @ 2 A per min

FM Tuesday, December 18, 2018, 15:40: Auto-ramping TBHT to 150 A @ 2 A per min

FM Tuesday, December 18, 2018, 16:26: Auto-ramping TBHT to 200 A @ 2 A per min

FM Tuesday, December 18, 2018, 17:08: Auto-ramping TBHT to 250 A @ 2 A per min

FM Tuesday, December 18, 2018, 17:38: Auto-ramping TBHT to 300 A @ 2 A per min

FM Tuesday, December 18, 2018, 17:20: Auto-ramping TBHT to 250 A @ 2 A per min

FM Tuesday, December 18, 2018, 18:37 : Nothing register on the multimeter, maybe we need to connect between A-B, or B-F. Cooling down to inspect the multimeter connection tomorrow.

FM Tuesday, December 18, 2018, 18:37: Auto-cooling TBHT/TGHT@ 2 A per min


FM Wednesday, December 19, 2018, 09:29: For the lasts 10 hours, the anode drain current has shown a steady value of 10.989 mA even though both the TBHT and the TGHT are off.

FM Wednesday, December 19, 2018, 10:47: Power supplies turned off in EPICS, Anode drain current still shows 4.839 on the readback.

Wednesday, December 19, 2018, 14:25: Power / Sources on. Anode to 300 V. - AS

Wednesday, December 19, 2018, 14:26: Auto-ramping TGHT to 300 A @ 2 A per min. - AS


Thursday, December 20, 2018, 06:42: Auto-ramping TGHT to 580 A @ 2 A per min. - AS

FM Thursday, December 20, 2018, 11:12 : Auto-ramping TBHT to 200 A @ 2 A/min

Thursday, December 20, 2018, 13:05 (Roughly) Power bump due to winds. Full TS shutdown.

  702   Thursday, December 20, 2018, 13:55 Aaron Schmidt LP-FEBIAD  395530-342752-5 Holiday shut down.

High winds caused a brief power outage that completely shutoff the ISAC test stand.

Locked out the power.

RGA checked & shutoff complete

Epics failure, computer restarted.

Thursday, December 20, 2018, 13:52: Shutting ISAC test stand down for the holidays. Checking Epics & operation first.

Thursday, December 20, 2018, 13:55: Roughing pump operating. Turbos left off. Backing valves opened. Epics whiteout on TS sources & optics.

TBHT, TGHT, Anode all brought to zero on epics, although still mostly white out.

Thursday, December 20, 2018, 14:14: Waterlines shut off at the main source & the TS is purged.

Note* Small leak directly on the fittings noticed on FS#5 right after the flow meter paddle wheel on the supply end.  All water flow was briefly halted during the power bump.

Epics still whited out.


Monday, January 07, 2019, 11:13: Fault report 11981 submitted.

  703   Tuesday, January 08, 2019, 08:11 Aaron Schmidt LP-FEBIAD  395530-342752-5In progressTS restart

Tuesday, January 08, 2019, 08:00: Epics white out fixed. Ref: Fault report 11981.

Tuesday, January 08, 2019, 08:10: IV4 reset. Turbo Pumps on

TMS:IG6 & TSG:IG1 not responding. Timing out. Edi contacted

TMS:IG6 - Filament switched on controller.

TSG:IG1 - Filament switched over. Cable to ion gauge is burnt. Black wire inside the housing had melted along with the edges of the plastic. Replaced the entire cable & reconnected the ion gauge to the controller.

Tuesday, January 08, 2019, 08:48: IG6 & IG1 operation resumed. Vacuum pump down continued.

Tuesday, January 08, 2019, 08:55: FS5 waterline tightened for leak check. All lines closed.

Tuesday, January 08, 2019, 09:03: RGA restarted/on.

Tuesday, January 08, 2019, 09:05: Opening waterlines. vacuum at 2.66e-06T. Control room notified.

Tuesday, January 08, 2019, 09:10: Waterlines opened. Vacuum @ 2.57e-06T. No response on RGA.

Tuesday, January 08, 2019, 09:14: No leak noted on the FS#5 paddle wheel. Fixed with tightening.

Tuesday, January 08, 2019, 09:20: Control room noted 7.6L fill (1/4" drop approx) in DI water on this line. (Note this next year)

  704   Wednesday, January 09, 2019, 09:10 Aaron Schmidt       Cathode to Anode. PS to Positive

Wednesday, January 09, 2019, 09:09: Upper HV cage set to Anode / Positive as per dwg ISK4523D Rev 6.


Thursday, January 10, 2019, 10:00: Switch Anode PS to positive

Thursday, January 10, 2019, 11:29: Anode switched on. Short discovered. 10 V = 0 V & 100 mA.

  705   Thursday, January 10, 2019, 11:38 Aaron Schmidt       Power outtage prep

Thursday, January 10, 2019, 11:32: Power down TS. Lock out.

Thursday, January 10, 2019, 11:36: RGA switched off full.

Thursday, January 10, 2019, 11:38: All ion gauge and turbos off. BV's closed.


Friday, January 11, 2019, 07:30: Vent TS.

Friday, January 11, 2019, 08:10: Purge FS#5 waterlines and close off main supply / return.

Friday, January 11, 2019, 08:12: Closed PV1 & PV2. Shut off the roughing pumps.

  706   Monday, January 14, 2019, 09:47 Aaron Schmidt       TS restart after power outage

Monday, January 14, 2019, 09:00: Epics white out

Ref: Fault report  11993 (11981 & 11817)

Monday, January 14, 2019, 09:35: Vacuum page came back. Restarted Roughing pumps. All other pages still in whiteout state.


Wednesday, January 16, 2019, 14:05: FEBIAD installed. Turbo pumps on for Beamline side. Roughing Chamber. Vacuum contols working. All else still in 'whiteout'


Monday, January 21, 2019, 10:30: Epics whiteout state ended. IOC Power cycled by Rod N. IG6 timing out? Contact vacuum group.

  707   Monday, January 21, 2019, 10:55 Aaron Schmidt       2019 Anode tests FM-1

Monday, January 21, 2019, 10:50: RGA on.

Monday, January 21, 2019, 10:54: Waterlines opened. No response on RGA. Vacuum ok @ 8.4e-07. IG6 not responding. Ok for this test.

Monday, January 21, 2019, 11:00: Power / Sources on.

Monday, January 21, 2019, 11:03: Anode to 300 V - 0.000 mA.

Monday, January 21, 2019, 11:05: Auto-ramping TGHT to 300 A @ 2 A per min.


Tuesday, January 22, 2019, 08:10: Auto-ramping TGHT to 580 A @ 2 A per min.


FM

Tuesday, January 22, 2019, 09:43 : Lowering the voltage to turn off Anode PS in order to replace the multimeter battery.

Tuesday, January 22, 2019, 09:51: Multimeter battery replaced. Turning on Anode PS and increasing the voltage to 300 V.

Tuesday, January 22, 2019, 10:46 : Auto-ramping TBHT to 200 A @ 2 A per min. Vaccum ok @1.29e-6 T

Tuesday, January 22, 2019, 13:08 :  Auto-ramping TBHT to 270 A @ 2 A per min. Vaccum ok @1.56e-6 T

Tuesday, January 22, 2019, 15:18 : Auto-ramping TBHT to 290 A @ 2 A per min. Vaccum ok @1.67e-6 T

Tuesday, January 22, 2019, 16:00: Manually-ramping  TBHT to 295 A @ 2 A per min. Vaccum ok @1.76e-6 T


FM

Wednesday, January 23, 2019, 09:35 : Manually-ramping  TBHT to 300 A @ 2 A per min. Vaccum ok @1.21e-6 T

Wednesday, January 23, 2019, 10:49 : Auto-ramping TBHT to 310A @ 2 A per min. Vaccum ok @1.12e-6 T

Wednesday, January 23, 2019, 12:07 : Manually-cooling TBHT to 270A @ 2 A per min. Vaccum ok @1.12e-6 T

Wednesday, January 23, 2019, 14:25:   Auto-ramping TBHT to 330A @ 2 A per min. Vaccum ok @1.03e-6 T

Wednesday, January 23, 2019, 16:23: Anode drain current was in runaway situation. When decreasing the TBHT current, the increment was set to 10 instead of 1 so there was a 10 A decrease from 330 to 320 A. This large decrease was unintended

Wednesday, January 23, 2019, 16:25:  Manually-cooling TBHT to 300A @ 2 A per min. Vaccum ok @1.12e-6 T

Wednesday, January 23, 2019, 17:18 : Manually-cooling TBHT to 290A@ 2 A per min. Vaccum ok @1.12e-6 T


 FM

Thursday, January 24, 2019, 13:18:  Manually-cooling TBHT to 270A@ 2 A per min. Vaccum ok @9.02e-7 T

Thursday, January 24, 2019, 15:28 :  Manually-cooling TBHT to 250A@ 2 A per min. Vaccum ok @8.67e-7 T


FM

Friday, January 25, 2019, 14:59 : Manually-cooling TBHT to 240A@ 2 A per min. Vaccum ok @7.04e-7 T

Friday, January 25, 2019, 16:26 : Manually-cooling TBHT to 230A@ 2 A per min. Vaccum ok @5.18e-7 T


FM

Monday, January 28, 2019, 10:27:  Auto-ramping TBHT to 290A @ 2 A per min. Vaccum ok @4.91e-7 T

Monday, January 28, 2019, 11:32:   Manually-cooling TGHT to 570A@ 2 A per min. Vaccum ok @5.10e-7 T

Monday, January 28, 2019, 14:43:  Auto-ramping TBHT to 300A @ 2 A per min. Vaccum ok @5.46e-7 T

Monday, January 28, 2019, 15:57 : Manually-cooling TBHT to 290A@ 2 A per min. Vaccum ok @5.54e-7 T


FM

Tuesday, January 29, 2019, 15:42 : Manually-cooling TGHT to 560A@ 2 A per min. Vaccum ok @5.54e-7 T


FM

Wednesday, January 30, 2019, 17:23:  Manually-cooling TGHT to 550A@ 2 A per min. Vaccum ok @4.65e-7 T


FM

Friday, February 01, 2019, 14:45:   Manually-cooling TGHT to 540A@ 2 A per min. Vaccum ok @4.74e-7 T

Friday, February 01, 2019, 16:49: Auto cooling TGHT to 0A@2 A per min. 

Friday, February 01, 2019, 22:22:  Auto cooling TBHT to 0A@2 A per min. 


FM

Saturday, February 02, 2019, 10:07:   Auto-ramping TBHT to10A  and TGHT to 10A@ 2 A per min. Vacuum ok @3.13e-7 T


AS

Monday, February 04, 2019, 09:20: Restarted RGA. TGHT, TBHT, Anode, off. Prep to open gas lines.

Monday, February 04, 2019, 09:24: Open / Close SV4 only. Vacuum spike t0 5.5e-05T. Alternate between SV4 & SV5 to fully open Argon.

Monday, February 04, 2019, 09:48: Vacuum Stable @ 5.3e-07T

Monday, February 04, 2019, 09:49: Anode to 200 V. TBHT & TGHT on.

Monday, February 04, 2019, 09:51: Auto-ramping TGHT / TBHT to 580 / 290 A @ 2A per min.

FM

Tuesday, February 05, 2019, 12:01 :  Power / Sources on.

Tuesday, February 05, 2019, 12:02 : BIAS / EZL / EE @ 30 / 13.5 / 1.5 kV.

Tuesday, February 05, 2019, 12:10 : Cancelled! I need to remove first the multimeter in order to have high voltage.

Tuesday, February 05, 2019, 12:10 : Auto-cooling.


Wednesday, February 06, 2019, 07:55: Reset IV4. -AS

FERNANDO! CALL ME OR CHECK YOUR EMAIL BEFORE YOU CONTINUE.

Wednesday, February 06, 2019, 09:35: Cage off. Multimeter removed. Cage replaced.

Wednesday, February 06, 2019, 09:48: Power on. Gas lines (Ar) open

Wednesday, February 06, 2019, 10:00: Sources on.

Wednesday, February 06, 2019, 10:10: Anode 200 V. BIAS / EZL / EE @ 30 / 13 / -1.5 kV.

Wednesday, February 06, 2019, 10:11: Auto-ramping TGHT / TBHT to 580 / 290 A @ 2A per min.

Wednesday, February 06, 2019, 10:12: IV4 open. Optics on.

Wednesday, February 06, 2019, 10:16: Optics set.


FM

Thursday, February 07, 2019, 09:59 : Mass scan attempted  and nothing shows. The current needs to be inverted. This was noted also by checking previous runs and the magnetic field on the epics optics window shows a negative magnetic field, while  now is showing a positive value.

Thursday, February 07, 2019, 12:55: MB1 set from Reverse to Normal manually. Auto range 'On'  FC6. Use 'Prepare down" & 'Down' to scan. - AS

Thursday, February 07, 2019, 16:55 : Auto-ramping TBHT to 310 A @ 2A per min.


FM

Friday, February 08, 2019, 09:04: FC0 current stable. Starting measurements of ion curres as a function of coil current, anode voltage, and possibly tbht. I'll be looking argon and CO.


FM

Friday, February 15, 2019, 15:38 Auto cooling TGHT/TBHT to 0A @ 2A/min


Tuesday, February 19, 2019, 08:34: BIAS / EZL/ EE @ 0 kV. Power to HV also turned off. - AS

Tuesday, February 19, 2019, 14:36 : Starting vacuum peak tests: For this I will close the valve and wait untill the vacuum has stabilized, then I will open the valve to see the maximum vacuum peak obtained.


Thursday, February 21, 2019, 11:58: Restart RGA - AS

Thursday, February 21, 2019, 14:05: SV5 closed, then SV3 & SV4

Thursday, February 21, 2019, 14:15: Mini pump started. Vacuum ok

Thursday, February 21, 2019, 14:20: Valve from mini pump opened. Vacuum jumped to 8.30e-07T after 2 minutes.

Thursday, February 21, 2019, 14:25: SV4 & SV3 opened. Vacuum @ 9.0e-07T with mini pump running.

Thursday, February 21, 2019, 14:30: Mini pump valve closed. Mini pump off. SV5 opened.  Vacuum to 3.1e-06T

  708   Thursday, January 24, 2019, 08:42 Aaron Schmidt       IG6 fix (w/ instruction)

TMS:IG6 had continued communication errors post power outage & would not switch on. After a power loss, IG6 switches automatically to Filament 1. Filament 1 is burnt out.

Thursday, January 24, 2019, 08:14: TMS:IG6 fixed. Switched from Filament 1 to Filament 2. FIL2 runs ok.

Instructions from Edi:

-Using the + / - keys move the cursor on the control box to select FIL2. The control box is located above the beam line turbo pump control boxes / inside the black cabinets under the TS.

-Press ok to switch FL2 : ON

-Turn IG6 on with the computer (EPICS) before it times out.

-Now IG6 is connected and can be switched on / off from the computer.

  709   Friday, February 22, 2019, 11:11 Aaron Schmidt LP-FEBIAD     Gas line backing pump tests

Backing "mini pump" testing.

-Open gas lines & auto ramp (If using HV, close up the back)

-HV on

-Close SV5, SV4, SV3 when ready. Wait until stable. Take measurement (1/2 hr approx)

-Turn down HV. Interlock, leave heaters on.

-Turn on mini pump.

-Open, SV4, SV3 carefully.

-Open MP valve. Wait 15 min. Close MP valve

-Carefully open SV5. Quick open & shut. Monitor vacuum 7.0e-06T trip limit.

-Monitor / record. Carefully open & close until stable.

-Close up TS w/ interlock

-HV on again & test.

 


Friday, February 22, 2019, 11:06: Auto-ramping TGHT / TBHT to 100 / 75 A. Gas lines open.

Friday, February 22, 2019, 11:31: HV on. BIAS / EZL / EE @ 5 / 1 / 0.1 kV. Anode @ 25 V - Low settings to check for trip and practice.

Friday, February 22, 2019, 11:43: HV unstable. Bump up. BIAS / EZL / EE @ 10 / 5 / 0.2 kV. Anode @ 25 V - Low settings stable.

Friday, February 22, 2019, 12:36: SV3 closed (Neon)

Friday, February 22, 2019, 12:46: SV4 (Argon), SV5 closed.

Friday, February 22, 2019, 12:57: HV off.

Friday, February 22, 2019, 13:00: Interlock complete. Mini pump on.

Friday, February 22, 2019, 13:10: MP valve opened manually.

Friday, February 22, 2019, 13:16: SV3 open. SV4 open.

Friday, February 22, 2019, 13:19: MP valve closed. pump off. SV5 opened / closed fast & intermittent.

Friday, February 22, 2019, 13:22: SV5 open fully. Gas lines all open.

Friday, February 22, 2019, 13:24: HV on. Interlock out.

Friday, February 22, 2019, 13:27: BIAS / EZL / EE @ 10 / 5 / 0.2 kV. Anode @ 25 V - Low settings stable.

Friday, February 22, 2019, 13:30: Setting reset, including optics. TGHT / TBHT did not trip.TEST 1 SUCCESS!.


Monday, February 25, 2019, 07:36: Auto-ramping TGHT / TBHT to 580 / 290 A. Gas lines open. 

Monday, February 25, 2019, 11:04: BIAS / EZL / EE @ 30 / 13 / 1.5 kV. Anode @ 200V

Monday, February 25, 2019, 13:38 : SV3 closed.

Monday, February 25, 2019, 14:25: SV5 closed.

Monday, February 25, 2019, 14:45: HV off. 

Monday, February 25, 2019, 14:50: Mini-pump on.

Monday, February 25, 2019, 14:53: Open MP valve

Monday, February 25, 2019, 14:57: Open SV3 & SV4

Monday, February 25, 2019, 14:59: Close MP valve.

Monday, February 25, 2019, 15:00: Open / Close SV5 intermittently until stable.

Monday, February 25, 2019, 15:01: SV5 Open.

Monday, February 25, 2019, 15:04: Locked up. Power back to HV. Optics switched on. FC0 closed. Ready for HV


Wednesday, February 27, 2019, 08:11: Auto-cooling @ 2 A per min 

Wednesday, February 27, 2019, 13:23: gas lines closed.


Friday, March 01, 2019, 10:35: IV4 reset

Friday, March 01, 2019, 10:42: Ion gauge 1 & the turbo pumps off.

  710   Friday, March 01, 2019, 14:51 Aaron Schmidt LP-FEBIAD     Gas lines test & Emissions measurement prep

Friday, March 01, 2019, 14:50:

SV5 replaced with a new valve.

SV1 disconnected from the He line and linked to the mini pump line.


Tuesday, March 05, 2019, 08:05: Roughing.

Tuesday, March 05, 2019, 08:36: Turbo pumps on.

Tuesday, March 05, 2019, 10:03: Vacuum at 1.30e-05T

Open SV3 & SV4. Vacuum remains unchanged. No response on the RGA.

Tuesday, March 05, 2019, 10:05: SV1 opened & closed. Responds well.

Tuesday, March 05, 2019, 10:06: Mini-pump on. MP manual valve closed.

Tuesday, March 05, 2019, 10:17: MP manual valve opened. No response on RGA. Vacuum stable / going down @ 1.13e-05T.

Tuesday, March 05, 2019, 10:25: SV1 open. No response on RGA. Vacuum stable / going down @ 1.02e-05T.

Tuesday, March 05, 2019, 10:35: SV1, SV3, SV4 closed. SV5 opened / closed. Minor response on RGA & Vacuum.

Tuesday, March 05, 2019, 10:40: SV5 opened fully to pump down.

Tuesday, March 05, 2019, 10:42: SV3 & SV4 opened fully to pump down.

Tuesday, March 05, 2019, 12:56: SV5 closed.

Tuesday, March 05, 2019, 12:57: SV3 & SV4 closed.

Tuesday, March 05, 2019, 12:59: SV1 to mini pump opened.

Tuesday, March 05, 2019, 13:06: SV3 & SV4 opened.

Tuesday, March 05, 2019, 13:27: SV1 closed. SV5 opened / closed in 'quick bursts'

Tuesday, March 05, 2019, 13:31: SV5 fully opened.

Tuesday, March 05, 2019, 13:43: Mini pump off.


Wednesday, March 06, 2019, 07:56: Mini-pump on. TS locked up. Power on. Gas lines open.

Wednesday, March 06, 2019, 07:59: RGA reset.

Wednesday, March 06, 2019, 08:00: Sources & optics on.

Wednesday, March 06, 2019, 08:02: Auto-ramping TGHT / TBHT to 100 / 75 A @ 2A per min. 

Wednesday, March 06, 2019, 08:07: BIAS / EZL / EE @ 10 / 5 / 0.5 kV - Low settings stable.

Wednesday, March 06, 2019, 08:19: IV4 opened.

Wednesday, March 06, 2019, 11:05: SV3 closed.

Wednesday, March 06, 2019, 11:10: SV4 & SV5 closed.

Wednesday, March 06, 2019, 11:11: SV5 re-opened.

Wednesday, March 06, 2019, 11:15: SV5 closed.

Wednesday, March 06, 2019, 11:16: SV1 to mini pump (running) opened.

Wednesday, March 06, 2019, 11:22: Sv3 & SV4 opened. No response on vacuum or RGA. SV5 good.

Wednesday, March 06, 2019, 11:30: Closed SV1, SV3, & SV4. open / close SV5 until stable.

Wednesday, March 06, 2019, 11:33: SV3 & SV4 opened.

Wednesday, March 06, 2019, 11:36: SV5 fully opened. No trip.

Wednesday, March 06, 2019, 11:40: Auto-ramping TGHT / TBHT to 350 / 250 A @ 2A per min.


Thursday, March 07, 2019, 07:23: Auto-ramping TGHT / TBHT to 580 / 290 A @ 2A per min.

Thursday, March 07, 2019, 07:28: BIAS / EZL / EE @ 30 / 13 / 1.5 kV. Anode 200 V

Thursday, March 07, 2019, 07:38: Something in the BIAS went horribly wrong. The Test Stand was crackling like a fire cracker. Very loud.

BIAS / EZL / EE / Anode off. Begin auto cooling.

Optics tripped. TMS:TP6 tripped

Attachment 1: gas-lines-changes.jpg
gas-lines-changes.jpg
Attachment 2: Gas_line_backing_pump_test_2019.docx
Attachment 3: TS-2019-03-05-09-45.rga
Attachment 4: TS-2019-03-06-08-00.rga
  711   Thursday, March 07, 2019, 07:55 Aaron Schmidt LP-FEBIAD    Problems/SolutionsTS restart - Troubleshoot BIAS spark

Thursday, March 07, 2019, 07:48: IV4 reset, BV6 & TMS TP6 reset.

Turbo pump restarted.

Auto cooling @ 2A per min.

Thursday, March 07, 2019, 08:40: Speed up Auto-cooling to 4A per min.

Thursday, March 07, 2019, 11:06: Power cycled the control boxes for the turbo pumps one by one. Operation in back to normal.

Thursday, March 07, 2019, 11:09: Switched to filament 2 on IG6. Reset.

Sparks from BIAS to EZL noticed at 1 kV. A wire was moved away from insulator 'O'

Sparks from BIAS to EZL @ 3kV


Friday, March 08, 2019, 11:00: Power supplies checked with John Chow.

BIAS (V) ------------------- EZL (V)

Set@-Read-Actual-----Set@-Read-Actual

1000- 982- 816---------1000- 987- 996

1500-1480-1300-------1500-1475-1530

2000-1993-1600-------2000-1993-1997

2500-2491-2070-------10000-9993-9964

3000-2989-2500

3500-3487-2900

4000-3985-3360

5000-4982-4145

Note* Lower reading on BIAS. Check the scaling with controls group.

Friday, March 08, 2019, 11:14: RGA, Ion gauge, Turbo pumps off.

Friday, March 08, 2019, 13:01: Venting for visual inspection.

Visual & Multimeter checks appear ok.

Friday, March 08, 2019, 14:37: Roughing.

Friday, March 08, 2019, 15:00: Turbos on.


Monday, March 11, 2019, 09:00: Switch everything on & slowly increase EZL & BIAS together

Monday, March 11, 2019, 09:30: Spark at approx 12-13 kV on BIAS. TGHT to 600A? Readback.

TGHT PS readback issues. John C contacted.

Power down.

Prep for TGHT PS removal. Possible capacitive effect? Test TS w/o TGHT PS after.

Monday, March 11, 2019, 13:55: New TGHT PS installed.


Tuesday, March 12, 2019, 08:37: Power / sources on

Tuesday, March 12, 2019, 08:50: BIAS to over 3kV. EZL set to 1 kV, but charged to over 5.5 kV on its own.

Tuesday, March 12, 2019, 09:30: Electrical check in the HV cage revealed a light oxide coating on the EZL post 'O'. This appears to have insulated the nut & feed through. Will require venting & removal to clean.

Ion gauge, turbo pumps off.

Tuesday, March 12, 2019, 11:10: Venting.


Wednesday, March 13, 2019, 08:30: Roughing. The brass nut & spark cap were polished, cleaned and re-installed. Other connections & wires cleaned.

Wednesday, March 13, 2019, 09:10: Turbo pumps started. Wiring up top re-connected.


Update* EZL PS removed. Tested by John C & Tomislav. The HV enable circuit wouldn't activate. Upon further investigating into the control and voltage regulating circuits of the PS, they found that the control ICs are 40% under powered, only getting 10V instead of 15V from its voltage regulator.

EZL PS to be replaced.

Wednesday, March 20, 2019, 07:03: Turbo pumps off

Wednesday, March 20, 2019, 08:28: Venting

Attachment 1: BIAS_spark_out_issue_-_2019.docx
Attachment 2: TS-2019-03-07-07-51.rga
  712   Monday, March 11, 2019, 13:56 Aaron Schmidt      DoneTGHT PS replaced

Monday, March 11, 2019, 13:55: The TGHT PS was replaced.

Brought up to 20 A. Operation. ok.

  713   Thursday, March 21, 2019, 08:33 Aaron Schmidt       Pump down TS

Thursday, March 21, 2019, 08:32: Roughing.

ELOG V2.9.2-2455