Chad and i did a leak check on TM4 heat shield circuit with installed dummy target at SHC today. The leak detector is pumped to 0.0xE-9atm.cc/sec.Chad sprayed helium twice on each  VCR joints .There is no any response had been found on the leak detector during each 45 seconds waiting time. The TM4 heat shield circuit with dummy  target is leak tight so far.  

Helium pressure test on TM2 all water circuits is done. 70 psi helium , 10 minutes test time. Leak detector :base leak rate 0.0XE-9 atm.cc/sec, base pressure 0.0Xe-4torr. No any response on LD during the test. All TM2 water circuit are leak free.

David Wang wrote:

Helium pressure test on TM2 all water circuits is done. 70 psi helium , 10 minutes test time. Leak detector :base leak rate 0.0XE-9 atm.cc/sec, base pressure 0.0Xe-4torr. No any response on LD during the test. All TM2 water circuit are leak free.

 Thursday, March 28, 2019, 12:40: Found valve to expansion tank TCS:TK2 to be closed. Opened valve. This allow air to escape out of the system and the water system is running as expected again

Friday, March 29, 2019, 11:15: Changed EE to conditioning mode

Friday, March 29, 2019, 11:35: BIAS / EZL 20 / 10 kV

Friday, March 29, 2019, 13:47: BIAS / EZL: 25 / 12.5 kV

Friday, March 29, 2019, 16:09: BIAS / EZL: 30  / 15 kV

Friday, March 29, 2019, 17:23: No sparks for >60 min

Friday, March 29, 2019, 17:26: BIAS / EZL off

Monday, April 01, 2019, 08:13: BIAS / EZL: 30  / 15 kV

Monday, April 01, 2019, 08:33 BIAS / EZL: 35  / 17.5 kV

Monday, April 01, 2019, 09:00: Sparking at about 37.5 kV BIAS. Lowered below 20 kV to stop. Now sparking at around 20 kV

Monday, April 01, 2019, 10:00: BIAS/EZL 22 / 20 kV. Occasional sparking on BIAS as voltage is increased.

Monday, April 01, 2019, 10:05: Change of strategy. Will heat target to bake out the vacuum before continuing with HV conditioning.

Monday, April 01, 2019, 10:43:

BIAS / EZL / EE: 15 / 7.5 / 1.5 kV
COIL / ANODE: 10 A / 200 V
Ramping TGHT / TBHT at 1 A/min. Good/bad vacuum (IG2): 1E-6 / 2E-6 Torr

Monday, April 01, 2019, 19:16: TGHT / TBHT: 500 / 270 A. Vacuum increasing. IG1/2 1.2E-7 / 1.4E-6 Torr

Monday, April 08, 2019, 09:28: BIAS / EZL: 20 / 10 kV (some periods of multiple sparks)

Monday, April 08, 2019, 10:28: BIAS / EZL: 30 / 15 kV (some periods of multiple sparks)

Monday, April 08, 2019, 11:24: 3 sparks for the last 60 min

Monday, April 08, 2019, 14:43: BIAS / EZ: 40 / 20 kV (after two periods of sparking around 39 kV requiring voltage to be reduced below 30 kV to recover)

Monday, April 08, 2019, 15:57: Two sparks in 70 min

Tuesday, April 09, 2019, 12:40: BIAS / EZL 40 / 20 kV with >90 min without sparking

Tuesday, April 09, 2019, 16:00: BIAS / EZL 48 / 24 kV

Tuesday, April 09, 2019, 16:07: Sparking tripped TPs and IG1S, then power supplies.

Tuesday, April 16, 2019, 16:41: BIAS / EZL 50 / 25 kV for 1 hour without sparking.

Wednesday, April 17, 2019, 15:23 : Continued without problems to 50 kV earlier, but sparks tripped off vacuum just above 50kV. Continue later.

 Electrical of TM#2 with ZrC#8 at the south hot cell. See attached for details.

Ramped voltage on TM2 up to 30kV with no problems. Bias current is at 29uA, same as original TM2 bias current (see archiver for ITE June 15th, before protons) and similar to 31uA right after protons went off on Aug. 6.

TGHT=0A

TBHT=0A

BIAS V=30kV

BIAS current = 29uA

EZL V= 15kV

EZL current= 51uA

EE V= 1kV

EE current= 0.952mA

IG1= 8.6e-7

protons=0

This seems ok despite poor electrical checks showing 300 MOhm resistance between HV and ground. These values indicate a resistance of 1 GOhm. Let's see what happens when protons are on.

For future (optimistic) reference when testing protons:

BIAS=35kV, 35uA

EZL-17.5kV, 60uA

BIAS=38kV, 37uA

EZL=18.5kV, 63uA

Ramping up HV to ~30kV, encountered problems and had to drop back to 28kV. No response on IG1 or anything else during sparks. Lots of charging-type behaviour on the bias current. Protons at 55uA

Tuesday, September 17, 2019, 02:02 : 15 mins with only 1 spark at 30kV so increased the bias

Tuesday, September 17, 2019, 02:31 : 32kV. Current unstable

Tuesday, September 17, 2019, 02:41 : Current continues extremely unstable but not much sparking....

Tuesday, September 17, 2019, 02:53 : Proton beam trip initially settled the bias current down, but then current began climbing pretty steeply with protons still off

Tuesday, September 17, 2019, 03:28 : Protons dropped to 40uA from 55uA, Bias current is much more stable and no sparks for 25mins

Tuesday, September 17, 2019, 03:36 : Raising voltage easy to about 33.5kV then instability and sparking similar to around 31kV at 55uA p+

Tuesday, September 17, 2019, 04:45 : Lowered protons to 25uA and no sparks though the current is not stable

More things but forgot to write them down. Spreadsheet attached.

 TM#2 with ZrC#8 has been moved from the east station to the south hot cell.

 Results of the electrical check on TM#2 with ZrC#8 post beam.

ZrC#8 has been removed from TM2. Upon removal of the high current tube heater bolts it was noticed that the tube was broken. Also the 9 pin connector has an arc mark (see pictures attached).

Ta#59 has been installed with new fasteners. High current fasteners torqued to 130 in lbs.

Heat shield has been removed from ZrC#8.

 The spent ZrC#8 was moved from the south hot cell to the spent target vault. It was placed in pail 217 and the pail was placed in slot 3A of the vault, it was 205mSv/hr when removed from the hot cell. Also the pail was filled with junk stuff that included 

wire, a wire scanner, IMG guage, target bolts and a water block bolts. Also there are only two spots left in the vault.

Hello all,

TM2's first performance in the Conditioning Station with the new source tray was not great, with sparking and HV degradation beginning to occur at 30kV:
https://elog.triumf.ca/TIS/RH-ISAC/1039

This is perplexing, because the module without the source tray performed well at the TCS:
https://elog.triumf.ca/TIS/RH-ISAC/829

AND the new source tray performed well at the test stand (i.e. not inside the module):
https://elog.triumf.ca/TIS/Test-Stand/447

Upon inspection back at the Hot Cell last week after the failure, David Wang was observant enough to notice that one of the steerer coax wires (ground plane) was essentially touching one of the FEBIAD gas lines (HV plane) in the new source tray installation (photo attached).  Closer inspection by a group consisting of Anders, Alex, and myself revealed some apparent tracking and damage to the wire sheath.
https://elog.triumf.ca/TIS/RH-ISAC/1045

We believed at this point that the bad HV performance of TM2 was due to this problem.  The wires were originally arranged loose as it was believed it would be easier to install them in the Hot Cell this way.  However, it turned out to be a bad decision, as the wires at ground ended up becoming stray and touching the HV surface.

To correct the problem, the old wires were removed, and a new steere wire bundle was made using a PEEK material sheath.  This new sheath bundle was installed over the last day or so.  The penning gauge wire was kept separate from the steerer wire bundle.  You can see the new wire bundle and penning gauge wire in the attached photo, now with a healthy clearance to the FEBIAD gas lines.

Chad has been instructed to re-install the Einzel lens wire, install the new ZrC target, and replace the containment box in preparation for transport back to the TCS for another HV test.  If anybody would like to see the source tray today before ~3pm, I have asked Chad to wait for my final OK to put the containment box back on the module.

I apologize for this problem.  We are hopeful the solution we have installed will improve the HV performance.  Much work over the last 2+ years was put into building and installing this source tray by many contributors inside and outside of Remote Handling, and we want this module to succeed more than anybody!

Thanks and best regards,

Grant

New wiring was installed yesterday as well as ZrC#7 which had its high current fasteners torqued to 130 in lbs.

Thursday, August 27, 2015, 10:10: Started water system. TK2 level reduced from 24.9 to 23.5 in. 

IG2 not working. Force is ON.

EE in conditioning mode.

 Friday, August 28, 2015, 08:39: BIAS/EL 10 / 5 kV

Friday, August 28, 2015, 08:49: BIAS/EL 20 / 10 kV

Friday, August 28, 2015, 09:18 BIAS OFF. Ramping to 200/100 A at 2/1 A/min

Friday, August 28, 2015, 15:46: Target at 76 / 38 A. Changed ramping to 100/40 at 1/0.5 A/min

Friday, August 28, 2015, 22:20: Ramping down heaters.

Saturday, August 29, 2015, 09:50: RGA off. PNG1 7.85E-6 / 5.0E-6 T (EPICS / local)

Saturday, August 29, 2015, 10:11: BIAS/EL 20 / 10 kV

Saturday, August 29, 2015, 10:28: BIAS/EL 30 / 15 kV. Some sparking around 29 kV

Saturday, August 29, 2015, 10:43: 10 min w/o sparking

Saturday, August 29, 2015, 10:55: BIAS/EL 32 / 15 kV. Small vacuum responses for every 100 V increase

Saturday, August 29, 2015, 11:03: Sparking at 33 kV

Saturday, August 29, 2015, 11:12: BIAS/EL 34 / 15 kV

Saturday, August 29, 2015, 14:22: Power has returned after site-wide power outage, but no communication with IOC yet.

Saturday, August 29, 2015, 15:13: IOC restarted.

Saturday, August 29, 2015, 15:14: Starting turbos

Saturday, August 29, 2015, 15:22: Turbos at speed.

Saturday, August 29, 2015, 15:22 : MP3 not running. Investigating

Saturday, August 29, 2015, 15:47: Reset MP3 breaker (wait 5 min for capacitors to empty)

Saturday, August 29, 2015, 15:48: Water system running

Sunday, August 30, 2015, 09:38: BIAS/EL 10 / 5 kV

Sunday, August 30, 2015, 09:54: BIAS/EL 20 / 10 kV 

Sunday, August 30, 2015, 10:01: BIAS/EL 30 / 15 kV 

Sunday, August 30, 2015, 10:12: No sparking

Sunday, August 30, 2015, 10:27: BIAS/EL 35 / 15 kV 

Sunday, August 30, 2015, 10:37: No sparking

 Sunday, August 30, 2015, 10:52:  BIAS/EL 37.5 / 15 kV 

Sunday, August 30, 2015, 11:00:  BIAS/EL 37.5 / 20 kV. No sparks

Sunday, August 30, 2015, 11:22:  BIAS/EL 40 / 20 kV 

Sunday, August 30, 2015, 11:34: No sparks

Sunday, August 30, 2015, 12:00: BIAS/EL 42 / 21 kV

Sunday, August 30, 2015, 12:32: Sparking at 43.5 kV. Tripped off PS on conductivity (spark response)

Sunday, August 30, 2015, 12:44:  BIAS/EL 40 / 20 kV. ISAC Ops will monitor over lunch

Sunday, August 30, 2015, 14:20: BIAS/EL 43 / 20 kV

Sunday, August 30, 2015, 14:41: Sparking at 43.5 kV. lowered to 43 kV

Sunday, August 30, 2015, 15:56: Sparking every 5-10 min at 43.4 kV not able to increase to 43.5 kV. Sparking is causing signal response on water conductivity and drop in IG1 and IG1S readings during sparking.

Monday, August 31, 2015, 08:33: BIAS/ EL to 40 / 20 kV in 9 min w/o any sparking

Monday, August 31, 2015, 08:44: No sparking

 Monday, August 31, 2015, 08:46: BIAS/ EL to 42 / 20 kV

Monday, August 31, 2015, 08:53: BIAS/EL 43 / 20 kV. Two vacuum/current responses

Monday, August 31, 2015, 09:47: BIAS off to investigate spakring.

David observed sparking coming from under the HV cover on TM2 twice. When the cover was removed, spark marks on a rubber plug for the water lines was observed. The plug with marks and one more plug was removed from the service cap as it is not used. See attached PDF.

Monday, August 31, 2015, 10:09: BIAS/ EL to 40 / 20 kV in 8 min w/o any sparking

Monday, August 31, 2015, 10:15 BIAS/EL 43.5 / 22 kV. One small spark

Monday, August 31, 2015, 10:30: No sparks

Monday, August 31, 2015, 10:35: BIAS/EL 44 / 22 kV.

Monday, August 31, 2015, 11:00: BIAS/EL 45 / 22 kV.

Monday, August 31, 2015, 11:31: PNG1 taken out by a spark

Monday, August 31, 2015, 12:04: Reset power to PNG1 controller. PNG1 back online.

Monday, August 31, 2015, 12:25: BIAS tripped on IG1 after a spark at 47.1 kV

Monday, August 31, 2015, 12:39: BIAS/EL 47 / 24 kV. No sparks for 5 min

Monday, August 31, 2015, 12:54: PNG1 taken out by spark at 47.7 kV

Monday, August 31, 2015, 13:02: BIAS/EL 48 / 24 kV

Monday, August 31, 2015, 13:07: No sparks

Monday, August 31, 2015, 13:25: BIAS/EL 49 / 24 kV

Monday, August 31, 2015, 13:30: No sparks

Monday, August 31, 2015, 13:37: PNG1 returned after a spark

Monday, August 31, 2015, 14:06: BIAS/EL 50 / 25 kV

Monday, August 31, 2015, 14:45: No sparks.

Monday, August 31, 2015, 15:15: BIAS/EL 51 / 25 kV

Monday, August 31, 2015, 15:38: BIAS/EL 51 / 30 kV

Monday, August 31, 2015, 16:01: Tested XCB0 and YCB0 to 5 kV. Some sparking. Tested CCB0 to 4 kV. No sparking.

Monday, August 31, 2015, 16:50: No sparks for 1 hour at 51 / 30 kV.

Monday, August 31, 2015, 17:00: HV off.

 Monday, August 31, 2015, 17:07: EE at 2 kV, R= 1 MOhm

Monday, August 31, 2015, 17:08 : EE off.

Monday, August 31, 2015, 17:10: Water off.

Monday, August 31, 2015, 17:12 : Vacuum gauges off. Turbos off. Roughing pump off.

The corelation betwenn the local value on the gauge controllers and the read back valiues in EPICS was compared. Data can be found in a previous  e-log

Dan and I disconnected TM2 in ITW this morning.

Bill and I remotely removed TM2 from ITW to SHC. The move is smooth.

I did an electrical check on TM2 with ZrC #7 on it. The EE is short to 60KV bias. See attachment

ZrC#7 has been removed from TM2. Everything looks good.

The failed extraction electrode was inspected in the hot cell this morning by Anders and Chad. The following electrical measurements were taken

• EE on target assembly as recieved from TM after online operation. 14 Ohm
• EE removed from target assembly and placed on conductive flat surface. ~1 G-Ohm at 1kV
• EE installed back onto target assembly (fasteners not tightened).~ 0.8 G-Ohm at 1 kV

There was some material deposited on the EE. Some of which has fallen off - possibly during removal of the electrode from the target assembly. It seems the cause of the short was material build up between plasma electrode and extraction electrode. See photos.

The heat shield lid was removed after lunch. This revealed a broken target. The target may have broken after operation (in hot cell).

Photos are available on DocuShare