Logbooks Lab Maintenance Evaporator_1 Evaporator_2 Laser cutter Target Production Test-Stand RH-ISAC RH-Cyclotron RH-Meson Hall RH-Beamlines RH-ARIEL
  RH-ISAC, Page 41 of 138  Not logged in ELOG logo
ID Date Author Category Type Module Target/Number Subjectdown
  2687   Monday, September 23, 2024, 11:26 David WangSouth Hot-CellStandard OperationTM3 TM3 window line has been leak checked.

TM3 window line has been leak checked after containment box removal and installation for insulator installation on water cup C.   No leak.

  453   Friday, September 13, 2013, 07:49 David WangConditioning StationDevelopmentTM3 TM3 water lines leak check at CS

I leak checked TM3 water lines at CS with 60 psi and 80psi helium. The base leak rate is 5.0xe-9 atm.cc/sec. Each circuit 3 minutes helium pressurizing for each time test. No any respose had been found on leak detector during the test. See attachment

Attachment 1: TM3_water_lines_leak_check_at_CS.pdf
TM3_water_lines_leak_check_at_CS.pdf TM3_water_lines_leak_check_at_CS.pdf TM3_water_lines_leak_check_at_CS.pdf TM3_water_lines_leak_check_at_CS.pdf TM3_water_lines_leak_check_at_CS.pdf TM3_water_lines_leak_check_at_CS.pdf
  2565   Friday, April 19, 2024, 10:44 David WangSouth Hot-CellDevelopmentTM3 TM3 water lines helium spray leak check at SHC.

TM3 water lines helium spray leak check at SHC is done. No leak has been found on all lines. seeattachment

Attachment 1: Scanned_from_a_Xerox_Multifunction_Printer_(7).pdf
Scanned_from_a_Xerox_Multifunction_Printer_(7).pdf Scanned_from_a_Xerox_Multifunction_Printer_(7).pdf
  420   Thursday, August 15, 2013, 09:32 chad fisherSouth Hot-CellRepairTM3 TM3 source tray installation status

 

The installation of the module side water block jig has been successful.
 
During initial attempts yesterday afternoon, installation of the jig proved, as expected to be extremely difficult. This was primarily due a poorly position water block from a previous repair were the soldering jig had not been used to position the block; specifically coil 1. This is the same block that contributed with the difficulties in removing the old source tray.
 
I was able to utilize the water block polishing tools as handles to reposition this water block ( as well as another slightly difficult one) into its location in the water block jig.
 
Please be aware, as the jig was very difficult to install, it will be very difficult to remove later (as it was when removing the old source tray).
 
Chad
  2190   Thursday, February 18, 2021, 12:59 David WangAssembly/Bench TestMaintenance  TM3 source tray and old resin can storage in lower cyclotron basement

TM3 old source tray, old target hall high active water resin tank, and  old 2A window RH clamp are transferred from TH to cyclotron lower vault basement 10 and 10A location for storage. They are placed beside and in front of old TM1 and TM2 source tray boxes which stored there in 2018. 

  2571   Saturday, April 27, 2024, 09:35 Carla Babcock; Alexander ShkuratoffConditioning StationDevelopmentTM3 TM3 source and service tray testing

Saturday, April 27, 2024, 09:35 :

Started ramping up HV, EE and EL together. First small spark at 20.5kV on bias, no reaction in other devices.

Note both BIAS and EL are off in their readbacks. See table below

BIAS set pt BIAS readback BIAS actual EL set pt EL readback EL actual
24 24.4 24.5 14 13.42 14
30 30.52 31 16 15.34 16
35 35.6 36 19 18.2 19
40 40.65 41.5 20 19.16 20
45 45.8 46.5 22 21 22
50 50.8 51.5 25 23.9 25
55 55.9 57 27 25.84 27
60 60.95 62.5 30 28.7  
62  63  64.5      
66 67.1 68.5      
67 68  69.5      
69 70.1 71.5      
70 71.1 ??      
70.5 71.7 73      

Saturday, April 27, 2024, 10:23 :

Spark on HV only at 25.5, couple sparks from here to 33, then at 33 starts real conditioning.

EL is reacting to some of the sparks, not sure if this is just electrical noise or not.

Saturday, April 27, 2024, 18:14 :

lots of trips above 60kV on the set pt. tripping off turbos and gauges. IG2 needed the controller reset.

 

RESULT: Got to 64.5 (actual) 62 (set point) with quite a bit of sparking over 60kV. Will go the rest of the way to 73 in the next days. Data dumped as isac/data/TM3_HVtests_Apr272024.dat

 

Sunday, April 28, 2024, 11:23 :

Ramped back up to 60kV reasonably easily, couple sparks and turbo trips.

Went up to 64kV (set point) with a lot of difficulty. Data dumped as isac/data/TM3_HVtests_Apr282024.dat

 

Monday, April 29, 2024, 14:58 :

Ramped up to set pt 62 easily, went down to 500V then 100V steps after that.

Went to set pt of 67 and left it there for ~40mins. Not perfectly stable but not too bad.

 

Tuesday, April 30, 2024, 17:12 :

After rebooting the TCS PLC to fix all the non-responsive devices, everything is working fine again.

Ramped easily to 60kV in 1kV steps.

Still got to 67 without too much trouble. Behaving pretty well...

At 70.2 (set pt, 71.3 readback) the water and vacuum gauge both tripped off and cannot be restarted. I am not sure what the real power supply reading is here but in the past it has been 70.5 set pt = 73 real value, which is as high as the power supply goes.

Stopping here since I'm not sure the water is circulating... the off pump says it is and the on pump says its not... left it at 70.2 for 40mins, still sparking going on (20:28 to 21:10)

Data dumped as isac/data/TM3_HVtests_Apr302024.dat

 

Sunday, May 05, 2024, 10:50 :

Containment box and target installed.

HV conditioning starting at 47kV.

Spark at 58kV knocked out IG1. Continuing with IG2 and IG1S.

Went up to set point of 63, readback 64. Will continue on Monday.

Data dumped: isac/data/TM3_HVtests_May52024.dat

 

Monday, May 06, 2024, 09:37 :

Ramping system back up.

First sparks at 50kv while raising the EL voltage (not sure if they are related).

AS: Voltage quickly up to 63 kV from 49 kV. Very smooth, no sparks or instabilities. Ramped at around 250 V steps every 10-20 seconds. First signs of instability at ~62.75 kV and definitely at 63 kV. I guess this is where it was conditioned to last. Let sit at 63 kV for a while while doing something else. It sparked once and turned off a turbo after half an hour. Starting ramping again.

AS: Spark at 65.75 kV killed IG1. Carla manually reset at 69 kV. Still working. A spark at 70.25 kV took out IG1 again.

AS: Maximum voltage reached at about 16:45. Setpoint 70.5 kV, readback 71.7 kV, PS itself ~73 kV. Carla reset IG1.

AS: 18:30, spent about 1.5 hours cumulatively at this maximum voltage. During this time it sparked about 15 times. Not long enough to tell if the spark frequency is decreasing. In the middle of this, Carla did something accidentally and caused the voltage to drop a bunch, so I manually set it to 0 V. She then reset TP1S, which was not staying on. Also, the EE and EL stayed at their respective voltages during this downtime (2 kV and 28.7 kV). I ramped the main BIAS voltage back up to the maximum voltage within 5 minutes and it was smooth all the way but sparked again at the maximum voltage. It seems conditioned up to or near the max voltage. Ramped down and turned off BIAS, EL, and EE.

AS: Dumped data to isac/data/TM3_HVtests_May62024_Alexander.dat

 

Tuesday, May 07, 2024, 10:02 :

Tested the EE - ramped up easily to 7kV, but then had issues maintaining the voltage. No vacuum response. Ramped down since we never use it that high anyway, though cable should be good for 10kV. More investigations later.

 

EDIT 2024-11-25, Alexander Shkuratoff:

Summary of StripTool data taken during this round of tests:

[   ] TM3_HVtests_Apr272024.dat 2024-04-27 18:56 12M
[   ] TM3_HVtests_Apr282024.dat 2024-04-28 13:16 1.4M
[   ] TM3_HVtests_Apr302024.dat 2024-04-30 21:11 9.0M
[   ] TM3_HVtests_May52024.dat 2024-05-05 13:06 5.0M
[   ] TM3_HVtests_May62024_Alexander.dat 2024-05-06 18:45 9.5M

 

  1530   Tuesday, May 09, 2017, 12:45 David WangConditioning StationRepairTM3 TM3 service tray side panel is cleaned and installed back to TM3

TM3 service tray side panel is cleaned and installed back to TM3 this morning. I visually inspected service tray insulators. Nothing is changed comparing to inspection before.Nine screws are installed on  panel to hold it onto TM3.

Attachment 1: TM3_service_tary_side_panel_005.JPG
TM3_service_tary_side_panel_005.JPG
Attachment 2: TM3_service_tary_side_panel_001.JPG
TM3_service_tary_side_panel_001.JPG
Attachment 3: TM3_service_tary_side_panel_004.JPG
TM3_service_tary_side_panel_004.JPG
  2513   Tuesday, January 02, 2024, 16:01 Carla BabcockConditioning StationDevelopmentTM3 TM3 service tray HV testing and conditioning

Tuesday, January 02, 2024, 15:58 :

Started HV ramp up on TM3 service tray about 3pm today. Had to bypass TCS:BIAS interlocks to make it work - there are some flow restrictions on the water lines that are causing the flow interlock to periodically trigger. The water flow it not very important for this test as long as the water is moving. Turned out that it was also conveninent to have all the interlocks bypassed because sparks tripped off the IG1 gauge and this did not cause the HV bias supply to turn off. Should use same setup next time.

Some sparking around 35-44kV, tripped off turbos/IG1/IG1S 3 times and so decided to ramp down.

Tried again while standing outside TH door to hear if sparking is outside the vacuum. Went to 48kV very slowy with multiple trips of the turbos, mostly TP2. Lots of sparks but easy to ramp back up to previous high point, so likely just a painful conditioning process. Current draw 167uA at 48kV. No sparks audible outside door, and vacuum response looks too large to be electrical noise.

 

Continued on Wednesday January 03 - went up to 53kV in the same way as before, lots of TP2 trips making its current a bit unstable... data was dumped as TM3_servicetray_conditioning_jan32023. Tried limiting the current on the power supply to very near the drain current to see if that reduces the number of trips. Didn't notice a significant effect.

 

Thursday, January 04, 2024, 09:57 :

Restarting conditioning, starting at 180uA at 53kV. Got up to around 60kV with many trips of the turbos, and one restart of the IG1 controller needed. Added a grounding hook to the vacuum controller rack to see if that helps reduce the trips. (doesnt appear to have).

 

Friday, January 05, 2024, 09:51 :

Continuing conditioning. Starting by sitting at 50kV for 10mins. No sparks observed during this time.

Even though we got to 60kV last time, onset of conditioning started at 58.6kV with a trip at 58.9kV... got up to 70kV.

 

Got to 72kV on Monday January 08 2024.

 

On Monday Jan. 15, tried to improve the grounding on the vacuum services rack to reduce sparking through the turbo controllers. Added two welding cables from the vacuum rack ground busbar to the copper grounding strip on the ground. If the spark is travelling from the faraday cage to the rack through conduit or grounding cables, maybe this will help. If it is coming through the turbo cable then it likely won't. Tried to add grounding straps on the turbo controller chassis (there is a brass screw which I think is for this purpose) but couldn't get either of the screws out with any resonable force. They undo a bit then get stuck...

 

 Wednesday, January 17, 2024, 20:39:

David vented TM3 with N, then opened the service cap to install new insulators. We pumped back down and Alexander and I ramped back up today - instabilities started around 55kV and we were back to slow conditioning in the high 50s. Got up to a set point of 65kV. Ray did some work on the TCS bias supply and now neither the set point or readback is correct. The PSU was reading 51.5kV at set point 50kV and 60kV at set point 58kV. Will continue later...

 

Wednesday, January 31, 2024, 16:23

Ramped up again, some slight instabiities around 56kV but could still go up pretty quick until about 65kV. Since Ray's testing of the TCS:BIAS supply both the readback and the set point are off from the powersupply display. Ran out of time and ramped down at set point 70.5.

Set point Readback PSU reading
63 64 65.5
66.5 67.5? 68
69.5 70.6 71.5
70.5 71.7 73
     
     

 

Tuesday, February 06, 2024, 14:47

Testing again after venting the module with air. First tiny spark at 48, then some vacuum reactions starting at 49 but still no issues. Bit more reactive around 53.

Set point Read back PSU reading
53 53883 55
57 57924 59
 60  61 62
 64  65 66.5
     

 stopped at 69.4

 

Wednesday, February 07, 2024, 15:28 :

Ramped easily to 60kV set point and let it sit there. Didn't spark at all then after 100mins, sparked TP2 off. Otherwise first sparking happened at set point 67.

Found at limit at around 72.5 on the PSU front output, set point 70.6. think it comes from EPICS. Will have to test the power supply.... stopped there.

 

Thursday, February 08, 2024, 15:03 :

Long term testing. ramped back up, first spark at set point 65.

Let it sit for 2hrs 20mins. Something like 6 sparks during this time. Current also dropped significantly from 0.32A to 0.27A.

Screenshot_from_2024-02-08_17-57-50.png

EDIT 2024-11-25, Alexander Shkuratoff:

All the StripTool data related to the above tests are on the server as the following below. Those without "Alexander" in the name were dumped by Carla.

[   ] TM3_servicetray_conditioning_Jan32023 2024-01-03 17:29 807K
[   ] 20240103_TM3_Service_Tray_TCS_Alexander 2024-01-03 17:31 1.2M
[   ] 20240104_TM3_Service_Tray_TCS_Alexander 2024-01-04 16:58 238K
[TXT] 20240104_TM3_Service_Tray_TCS_Alexander_2.csv 2024-01-05 07:00 13M
[TXT] 20240104_TM3_Service_Tray_TCS_Alexander_1sec.csv 2024-01-05 12:21 81
[TXT] 20240105_TM3_Service_Tray_TCS_Alexander.csv 2024-01-05 16:51 13M
[TXT] 20240105_TM3_Service_Tray_TCS_Alexander_1sec.csv 2024-01-05 16:52 2.7M
[   ] TM3_servicetray_conditioning_Jan52023 2024-01-05 21:24 8.8M
[TXT] 20240108_TM3_Service_Tray_TCS_Alexander_1sec.csv 2024-01-08 16:56 4.7M
[TXT] 20240108_TM3_Service_Tray_TCS_Alexander.csv 2024-01-08 16:56 7.1M
[   ] TM3_servicetray_conditioning_Jan172024 2024-01-17 13:29 257K
[TXT] 20240117_TM3_Service_Tray_TCS_Alexander.csv 2024-01-17 20:11 4.0M
[   ] TM3_servicetray_conditioning_Jan312024 2024-01-31 17:24 2.2M
[TXT] 20240131TM3_Service_Tray_TCS_Alexander.csv 2024-01-31 17:55 4.5M
[TXT] 20240206_TM3_Service_Tray_TCS_Alexander.csv 2024-02-06 17:58 2.6M
[   ] TM3_servicetray_conditioning_Feb62024 2024-02-06 19:29 4.6M
[   ] TM3_servicetray_conditioning_Feb82024 2024-02-08 17:55 3.1M

 And the StripTool settings:

[   ] Alexander_TCS_HV_Conditioning.stp 2024-01-17 19:57 3.7K

 

Attachment 1: Screenshot_from_2024-01-02_16-05-43.png
Screenshot_from_2024-01-02_16-05-43.png
  1095   Tuesday, October 06, 2015, 21:12 Aurelia LaxdalSouth Hot-CellRepairTM3 TM3 service cap inspection in target hall

David Wang and I did the service cap inspection in target hall: see WP I2015-10-06-10.<br>

Signs of sparking were seen underneath 3 insulators: E ("Cavity"), A ("Oven+") and B ("Oven -") at the pair water lines coming out of the  feed-through and going to the HV chase. Specifically one water line of E is very close to the feed-through insulator (2-3mm gap) and here the sparking sings are more prominent: see picture.

Attachment 1: Pic1.jpg
Pic1.jpg
  2520   Thursday, January 11, 2024, 13:54 David WangConditioning StationDevelopmentTM3 TM3 servic cap air to vacumm seals leak check.

After Tm3 service tray and service cap installation, TM3 service cap air to vacuum seals leak check has been done at TCS. TCS:IG1 and IG1S are at low E-7 torr range.  leak detector base  0.0XE-9 atm.cc/sec,  base pressure0.0X E-4 torr.  I sprayed helium to all new air to vacuum seals on service cap. No leak on seals. The leak check has been repeated  2 times with same result.   

  324   Friday, April 26, 2013, 14:31 chad fisherSouth Hot-CellRepairTM3 TM3 refurb E.O.D.

Service tray side of the waterblock jig is installed and all locking tabs enagaed save the heat shield circuit. Locking tab for heat shield circuit with be worked on Monday morning and installation of the source tray side of the waterblock jig should commence on monday as well.

Attachment 1: IMG_1039.JPG
IMG_1039.JPG
  300   Wednesday, April 17, 2013, 09:02 chad fisherSouth Hot-CellRepairTM3 TM3 ready for conditioning station

The heat shield circuit blank offs have been re-installed and front cover replaced. TM3 is ready to move to the conditioning station for testing.

  1504   Wednesday, April 26, 2017, 08:28 chad fisherSouth Hot-CellRepairTM3 TM3 progress and manipulators

containment box was re-installed onto TM3 on Monday, Left manipulator may be showing signs of eminent handle or tong cable failure.

  2562   Thursday, April 11, 2024, 06:27 David WangSouth Hot-CellDevelopmentTM3 TM3 new source tray was transferred into SHC on this Tuesday.

TM3 new source tray was transferred into SHC on this Tuesday. one hook arm of transfer jig is very close to optic tray tube when engaging the jig on transfer frame. tube side hook arm should go east side a little bit further to avoid the tube.  Also the HS tube top lines to  transfer frame beam bottom distance needs to be watched closely when hooking on the frame.Help from HC window is necessary. By watching on this details, Source tray are successfully moved into SHC with crane controlled locally in TH.Transfer frame was retrieved back to TH. It was cleaned, bagged and stored in TH.

  427   Monday, August 26, 2013, 18:26 Grant MinorConditioning StationStandard OperationTM3 TM3 moved from Hot Cell to Conditioning Station

Target Module 3 with no target, and a partially-installed Rev-3 source tray (no steerers connected, no IMG connected, entrance window lines blanked off on module side and not connected to containment box) was transported successfully to the Conditioning Station by Travis Cave and David Wang at around 4pm today.  David attached the vacuum system for start of pump-down to prepare for leak checking.

  2720   Monday, November 25, 2024, 09:56 Adam NewsomeSouth Hot-CellStandard OperationTM3 TM3 move - silo to SHC

TM3 was moved from silo to SHC with no target. Move successful.

  2727   Tuesday, December 03, 2024, 12:28 Adam NewsomeSouth Hot-CellStandard OperationTM2 TM3 move - TCS to ITE

TM3 was moved with UCx#47 from TCS to ITE. The move was smooth.

  2722   Tuesday, November 26, 2024, 13:54 Adam NewsomeConditioning StationStandard OperationTM3 TM3 move - SHC to TCS

TM3 was moved from SHC to TCS with UCx#47. The move was smooth.

  423   Wednesday, August 21, 2013, 20:36 Grant MinorSouth Hot-CellRepairTM3 TM3 module-side water block sealing surface inspection (post polishing)

The water block sealing surfaces on the module-side of TM3 were polished this week by Chad Fisher, using his air-ratchet controlled rotating head tools (single and double-surface polishing tools).

Photos of the polishing tools in-use are attached (from August 16 - 21, 2013)

Scotch-brite pads were used, followed by 2000 grit sandpaper, then white felt with isopropanol, then lint-free dry polishing pads, each on detachable heads that are used with the polishing tool.

The module-side water block surfaces were inspected by Grant Minor on 21 Aug 2013 using a level telescope and camera looking through the hot cell window.  Results can be viewed here, with photos indicating which block is being viewed in sequence.

https://documents.triumf.ca/docushare/dsweb/View/Collection-11251

Attachment 1: TM3_final_water_block_polishing_16-048.JPG
TM3_final_water_block_polishing_16-048.JPG
Attachment 2: TM3_final_water_block_polishing_16-031.JPG
TM3_final_water_block_polishing_16-031.JPG
  2568   Friday, April 26, 2024, 08:56 David WangConditioning StationDevelopmentTM3 TM3 module top helium spray leak test.

TM3 module top helium spray leak test was done yesterday.  No leak on TM3 module top @ LD base leak rate 0.0 x E-9 atm.cc/sec.

ELOG V2.9.2-2455