TM#2 electrical check at the conditioning station. All pumps were off but the module was not vented.

 Weekly update target hall schedule.See attachment 1,2

Spring and summer run is close to the end. This will be the last update on this old schedule. See attachment3,4.    A new schedule for TH activities after mini shut down will be posted next time.

Yesterday TM2 was inspected in the SHC. Spark marks were found both on the steerer wires and on the ANODE wire. The steerer wires (GND)  were touching the gas lines (60kV). This is likely the cause of the sparking observed at the Conditioning Station (e-log).

Photos are available on DocuShare

Hello all,

TM2's first performance in the Conditioning Station with the new source tray was not great, with sparking and HV degradation beginning to occur at 30kV:
https://elog.triumf.ca/TIS/RH-ISAC/1039

This is perplexing, because the module without the source tray performed well at the TCS:
https://elog.triumf.ca/TIS/RH-ISAC/829

AND the new source tray performed well at the test stand (i.e. not inside the module):
https://elog.triumf.ca/TIS/Test-Stand/447

Upon inspection back at the Hot Cell last week after the failure, David Wang was observant enough to notice that one of the steerer coax wires (ground plane) was essentially touching one of the FEBIAD gas lines (HV plane) in the new source tray installation (photo attached).  Closer inspection by a group consisting of Anders, Alex, and myself revealed some apparent tracking and damage to the wire sheath.
https://elog.triumf.ca/TIS/RH-ISAC/1045

We believed at this point that the bad HV performance of TM2 was due to this problem.  The wires were originally arranged loose as it was believed it would be easier to install them in the Hot Cell this way.  However, it turned out to be a bad decision, as the wires at ground ended up becoming stray and touching the HV surface.

To correct the problem, the old wires were removed, and a new steere wire bundle was made using a PEEK material sheath.  This new sheath bundle was installed over the last day or so.  The penning gauge wire was kept separate from the steerer wire bundle.  You can see the new wire bundle and penning gauge wire in the attached photo, now with a healthy clearance to the FEBIAD gas lines.

Chad has been instructed to re-install the Einzel lens wire, install the new ZrC target, and replace the containment box in preparation for transport back to the TCS for another HV test.  If anybody would like to see the source tray today before ~3pm, I have asked Chad to wait for my final OK to put the containment box back on the module.

I apologize for this problem.  We are hopeful the solution we have installed will improve the HV performance.  Much work over the last 2+ years was put into building and installing this source tray by many contributors inside and outside of Remote Handling, and we want this module to succeed more than anybody!

Thanks and best regards,

Grant

Electrical check of TM#2 with ZrC #7 installed

New wiring was installed yesterday as well as ZrC#7 which had its high current fasteners torqued to 130 in lbs.

TM#2 with ZrC#7 has been moved to the conditioning station from the south hot cell.

Chad and I leak checked TM2 HS and window circuit VCR joints with ZrC target and containment box installed at SHC. No leak has been found. They will   be helium pressurized  at CS later.

Turbo-pumps are started . The pumping down is good so far.

LD base LR 0.0xE-9 atm.cc/sec , 80 psi helium 2 minutes on HS and window circuits. No leak. Also, the reinstalled(after rewiring job) TP2 and PNG1(steers) side panel have been leak checked. No leak.

Electrical check of TM#2 at the conditioning station under vacuum. The resistance value of the target to 60kV common is a bit lower then what it was at the south hot cell.

Thursday, August 27, 2015, 10:10: Started water system. TK2 level reduced from 24.9 to 23.5 in. 

IG2 not working. Force is ON.

EE in conditioning mode.

 Friday, August 28, 2015, 08:39: BIAS/EL 10 / 5 kV

Friday, August 28, 2015, 08:49: BIAS/EL 20 / 10 kV

Friday, August 28, 2015, 09:18 BIAS OFF. Ramping to 200/100 A at 2/1 A/min

Friday, August 28, 2015, 15:46: Target at 76 / 38 A. Changed ramping to 100/40 at 1/0.5 A/min

Friday, August 28, 2015, 22:20: Ramping down heaters.

Saturday, August 29, 2015, 09:50: RGA off. PNG1 7.85E-6 / 5.0E-6 T (EPICS / local)

Saturday, August 29, 2015, 10:11: BIAS/EL 20 / 10 kV

Saturday, August 29, 2015, 10:28: BIAS/EL 30 / 15 kV. Some sparking around 29 kV

Saturday, August 29, 2015, 10:43: 10 min w/o sparking

Saturday, August 29, 2015, 10:55: BIAS/EL 32 / 15 kV. Small vacuum responses for every 100 V increase

Saturday, August 29, 2015, 11:03: Sparking at 33 kV

Saturday, August 29, 2015, 11:12: BIAS/EL 34 / 15 kV

Saturday, August 29, 2015, 14:22: Power has returned after site-wide power outage, but no communication with IOC yet.

Saturday, August 29, 2015, 15:13: IOC restarted.

Saturday, August 29, 2015, 15:14: Starting turbos

Saturday, August 29, 2015, 15:22: Turbos at speed.

Saturday, August 29, 2015, 15:22 : MP3 not running. Investigating

Saturday, August 29, 2015, 15:47: Reset MP3 breaker (wait 5 min for capacitors to empty)

Saturday, August 29, 2015, 15:48: Water system running

Sunday, August 30, 2015, 09:38: BIAS/EL 10 / 5 kV

Sunday, August 30, 2015, 09:54: BIAS/EL 20 / 10 kV 

Sunday, August 30, 2015, 10:01: BIAS/EL 30 / 15 kV 

Sunday, August 30, 2015, 10:12: No sparking

Sunday, August 30, 2015, 10:27: BIAS/EL 35 / 15 kV 

Sunday, August 30, 2015, 10:37: No sparking

 Sunday, August 30, 2015, 10:52:  BIAS/EL 37.5 / 15 kV 

Sunday, August 30, 2015, 11:00:  BIAS/EL 37.5 / 20 kV. No sparks

Sunday, August 30, 2015, 11:22:  BIAS/EL 40 / 20 kV 

Sunday, August 30, 2015, 11:34: No sparks

Sunday, August 30, 2015, 12:00: BIAS/EL 42 / 21 kV

Sunday, August 30, 2015, 12:32: Sparking at 43.5 kV. Tripped off PS on conductivity (spark response)

Sunday, August 30, 2015, 12:44:  BIAS/EL 40 / 20 kV. ISAC Ops will monitor over lunch

Sunday, August 30, 2015, 14:20: BIAS/EL 43 / 20 kV

Sunday, August 30, 2015, 14:41: Sparking at 43.5 kV. lowered to 43 kV

Sunday, August 30, 2015, 15:56: Sparking every 5-10 min at 43.4 kV not able to increase to 43.5 kV. Sparking is causing signal response on water conductivity and drop in IG1 and IG1S readings during sparking.

Monday, August 31, 2015, 08:33: BIAS/ EL to 40 / 20 kV in 9 min w/o any sparking

Monday, August 31, 2015, 08:44: No sparking

 Monday, August 31, 2015, 08:46: BIAS/ EL to 42 / 20 kV

Monday, August 31, 2015, 08:53: BIAS/EL 43 / 20 kV. Two vacuum/current responses

Monday, August 31, 2015, 09:47: BIAS off to investigate spakring.

David observed sparking coming from under the HV cover on TM2 twice. When the cover was removed, spark marks on a rubber plug for the water lines was observed. The plug with marks and one more plug was removed from the service cap as it is not used. See attached PDF.

Monday, August 31, 2015, 10:09: BIAS/ EL to 40 / 20 kV in 8 min w/o any sparking

Monday, August 31, 2015, 10:15 BIAS/EL 43.5 / 22 kV. One small spark

Monday, August 31, 2015, 10:30: No sparks

Monday, August 31, 2015, 10:35: BIAS/EL 44 / 22 kV.

Monday, August 31, 2015, 11:00: BIAS/EL 45 / 22 kV.

Monday, August 31, 2015, 11:31: PNG1 taken out by a spark

Monday, August 31, 2015, 12:04: Reset power to PNG1 controller. PNG1 back online.

Monday, August 31, 2015, 12:25: BIAS tripped on IG1 after a spark at 47.1 kV

Monday, August 31, 2015, 12:39: BIAS/EL 47 / 24 kV. No sparks for 5 min

Monday, August 31, 2015, 12:54: PNG1 taken out by spark at 47.7 kV

Monday, August 31, 2015, 13:02: BIAS/EL 48 / 24 kV

Monday, August 31, 2015, 13:07: No sparks

Monday, August 31, 2015, 13:25: BIAS/EL 49 / 24 kV

Monday, August 31, 2015, 13:30: No sparks

Monday, August 31, 2015, 13:37: PNG1 returned after a spark

Monday, August 31, 2015, 14:06: BIAS/EL 50 / 25 kV

Monday, August 31, 2015, 14:45: No sparks.

Monday, August 31, 2015, 15:15: BIAS/EL 51 / 25 kV

Monday, August 31, 2015, 15:38: BIAS/EL 51 / 30 kV

Monday, August 31, 2015, 16:01: Tested XCB0 and YCB0 to 5 kV. Some sparking. Tested CCB0 to 4 kV. No sparking.

Monday, August 31, 2015, 16:50: No sparks for 1 hour at 51 / 30 kV.

Monday, August 31, 2015, 17:00: HV off.

 Monday, August 31, 2015, 17:07: EE at 2 kV, R= 1 MOhm

Monday, August 31, 2015, 17:08 : EE off.

Monday, August 31, 2015, 17:10: Water off.

Monday, August 31, 2015, 17:12 : Vacuum gauges off. Turbos off. Roughing pump off.

Argon venting TM2 at CS.

TM#2 with ZrC#7 has been moved from the conditioning station  to the west target station.

During last run， ITW dump circuit had a water leak on an adaptor below the pressure gauge. The top tank flange, slot, and O-ring were water contaminated by the leak. I removed the old o- ring, cleaned up the flange and o-ring slot, and put a new o-ring into the flange. Some  pictures will be attached in this mail later.

TM2 has been connected in ITW. During the connection, Anders and I  found the TM2  high current cables used in ITE and CS are short in ITW.  Anders and Grant found the original TM2 ITE high current cables in target hall. We replaced them. They works fine. But, a little bit longer on cable length would be easy to connect them. All other connections and HV cover in ITW work for the TM2 so far.

https://documents.triumf.ca/docushare/dsweb/View/Collection-15323

Maico and Dan moved 5 shielding blocks from ITE to ITW. The ITW is configured to take proton beam.

The corelation betwenn the local value on the gauge controllers and the read back valiues in EPICS was compared. Data can be found in a previous  e-log

Dan and I disconnected TM2 in ITW this morning.