Yesterday TM3 had the TGHT current raised to 160 amps and the TBHT raised to 200 amps. At this power the TGHT showed typical results in that vacuum was affected and the increased voltage as the target increased in temperature. The tube heater on the other hand did not change voltage or show a change in vacuum. As a result it is believe there is a short somewhere in the module. I have attached a screen shot of the strip tool and the raw data.

I have compiled the e-mail comments from people involved in High-Power Conditioning of TM3 w/ the new Rev 3 source tray and NiO#2 since Bevan Moss' last log on October 2nd below:

On October 2nd at 6:35pm Friedhelm Ames wrote:
TM3 heaters have been tested already yesterday in the conditioning station. Current and voltage readings were in the normal operating range.
The heaters were kept on over the night and no changes except a slow improvement in the vacuum has been seen. Today the high voltage was started. A high bias current of up to 150 micro Amps at 10 kV and an oscillation of the current with a frequency of about 3/minutes has been seen. Going higher in voltage resulted in an erratic behavior. After a visual inspection in the target hall some water leakage on top of the module was detected. it could be traced to 2 of the water connectors. They have been replaced. After this the high voltage current was down to normal values and the oscillation disappeared. With the heaters off the voltage could be raised to 22 kV, after which sparking occurred.
Earlier with the heaters on the functioning of the source has been tested. Extracted beam could be seen on the Faraday cup and the dependance on both the anode voltage and the coils could be verified.
One of the steerer plates (bottom) appears to have a short. As there is some redundancy in the steering elements in the target station optics, I don't believe this will effect the beam delivery very much.
A full test of all the source systems is planned for tomorrow including a careful attempt to rise the high voltage to a higher value. For the acceleration of 10C we will need 20.4 kV.

On October 3rd at 9:32am Bevan Moss wrote:

FYI Module is holding 24kV with zero sparks as of yet  I will continue with updates as I go

On October 3rd at 10:18am Bevan Moss wrote:

Sparking started at ~28kV I have had to dial it back to 22kV to hold stable voltage. I will continue with updates.

On October 3rd at 11:17am Bevan Moss wrote:

Sparking has forced the voltage down to 20kV. Friedhelm has asked me to turn everything on and start ramping the heaters.

On October 3rd at 4:15pm Bevan Moss wrote:

The heaters have been brought online and the Bias raised to 25kV. It has been sitting there for the last 10 minutes with 1 spark during this time. All other PS are on and beam is being extracted.

On October 3rd at 4:37pm Bevan Moss wrote:

Sparking has just occurred and the Vacuum is now getting worse significantly faster. Voltage was lowered to 21KV where it has been stable for the last 5 minutes. I am going to turn off the HV leave the module overnight with the heaters on. Hopefully we will have good Vacuum again in the morning.

On October 4th at 2:20pm Bevan Moss wrote:

I have finished completing another complete leak test on the module and it is leak tight. Once the heaters were turned off the vacuum did improve it is currently sitting at 9.3 x 10^{^-7} Torr in the service cap, 5.71 x 10^{^-6} Torr in the diagnostics box and 4.0 x 10^{^-6} in in the secondary.  I have raise the bias voltage and it can hold 20kV for 5 minutes but did have 1 spark. At 22.5kV it appears to be doing some conditioning as the current is unstable. I would not recommend moving TM3 to ITE on Monday until we can establish that the module can hold 25kV for at least 1 hour preferably with the heaters on. I have left the turbo pumps running in case there is more testing you would like to do. If you choose to move to ITE on Monday please have someone stop the turbo pumps otherwise I must wait an hour before venting on Monday. The TCS laptop on my desk should not have the screen saver come on so TCS can be operated through it.

The high voltage was sparking several times during the night. It may be correlated with the cycling of the cooling water temperature and conductance.

vacuum levels at 11:00

IG1 7.5e-7 T

IG2 3.9e-6 T

IG1s 2.0 e-6 T

heaters have been ramped up to TGH 580 A, TBHT 250 A,

anode 100 V 5.3 mA, coil 50 A Faraday cup 50 nA bias 20 kV EL 6 kV

vacuum

IG1 7.9e-7

IG2 4.5e-6

IG1s 2.2e-6

water are supplied to both ITE and ITW. I did a general inspection on HALCW system. Two small leaks on 2" shut off valves are fixed. No other leak has been found so far. all water flow meters work fine. MP2 pump discharging pressure is ok which is just above 100 psi on local gauge reading. pump noise are low. pump body temperature is less than 45C which is good. 

HALCW system O2 sensor service and calibration were done in Sep 26th. electrolyte and membrane on rose mount sensor 499ADO were refilled and replaced. Sensor was zero and full scale calibrated. The sensor works fine after the job.

HALCW resin tank has been replaced. The old tank is stored in middle-west silo now. The field on old resin tank bottom is about 3.5 msv/ hr(on contact). By shielding it into silo and putting two lead blankets on the top cover of the silo,The general field 1 feet above this silo is 25usv/hr. And, The field around the silo area are less affected. This old tank will stay there as long as possible.  For the new resin tank during preparation, It was found that on return line side, the 1.25" pipe thread plug with return line tube  was very difficult to be installed onto the female thread adapter which is welded onto to tank body. It was jammed in half way of threading onto tank at manufacturer. This plug was removed out first and inspected. The first and second male threads were galled.  Maico repaired the thread on a lathe. The female thread on the tank was tapped. A tight spot was found during the tap. After that, the return line plug could be installed onto the tank properly.  The new tank was installed into the vessel and connected back to HALCW system. Water are refilled into new tank. During refill air were trapped into the system. This caused  pump restarting problem. By Several times of starting up the pump, stopping the pump and venting,  Most air were breathed out of  system. Finally,The system was restarted by supply water to ITW( without module) only. ITE and resin can circuits were brought back to system after that without problem.

 Before removing the old tank, We drained water out of old tank to decay tank. Since the resin tank is largely filled with  resin, and water are soaked into resin, we only can drain out less than 10 liters water out of tank. Also, The drain caused some part of return line on pumps have to been drained. This is the main reason air was trapped in system during the new resin tank water refilling. For the future replacement, we should not drain water in old tank. It does not worth to do it. 

Attach TH HALCW resin tank replacement procedure here.

2022-02-17 reload replacement procedure and draining schematic.

Two of resin tank filter cartridges(supply and return) are changed today. Old cartridges and bagged and tagged. The contact field on them are 650usv/hr. The new cartridges are fiber-glass, Triumf store item. After replacement, the field on contact with the filter case are about 10 usv/hr. But the field on contact with top resin tank  has been increased from 45usv/hr  to 225 usv/hr

 The flow rate is relatively stable before and after change. See attachment

HALCW resin can loop two filters have been replaced. no water leak on after job check.

HALCW resin can flow meter replacement is done. Less that 100 mL water was drained to a small tray during the job. RPG checked the water. Less than 20 counts. Water are dumped the high active sump.   The HALCW MP1 is started. No leak on new gauges and fittings. Old gauge is labeled , bagged, and stored in TH.

HALCW pump ITC:MP1 has been started. water are supplied to both ITE and ITW system. all water signals for individual circuits work fine. no major leak on system. Some small water seeping from small ball valve stems are found in ITW. they will be fixed soon.

HALCW pump ITC:MP1 and MP2 phase current draw measurement result: water supplied to both station. MP1: Black 17.0A, blue 16.9A, red 16.7A.   MP2: black 17.3A, blue17.8A, red 17.3A.    The results are good.  No concern on both motors.

ITW, ITE, ITW +ITE total , and low active cooling water return flow meter transmitters are inspected and calibrated.  Result:

ITW , PX-750-06Di , Calibrated to  4-20 mA for 0 to 6" H2O DP, linear.    Transmitter works fine.

ITE. PX-750-06Di, calibrated to 4- 20mA for 0 to 6" H2O DP, linear.   Transmitter works fine.

ITE+ITW total, PX-750 -30 SQDI.  It looks like electronic board for square root output is broken. It can not be calibrated  to 4mA @ 0 inch H2O DP. The transmitter is calibrated to 10.25mA - 25.25mA for 0 to30" H2O DP, linear. Transmitter works fine.

 Low active cooling water return, Px-750-30di, smart.  The transmitter is broken. The output current stuck at 44.5mA on all DP.  I tried zero and reset it by following instruction manual, but failed to bring it back. The electronic boards are broken mostly. The production is discontinued by Omega Engineering. A new Omega transmitter PX3005-25WDWBI (linear) will be ordered for its replacement.

2023-06-28: A new Omega transmitter PX3005-25WDWBI (linear) has been installed back to LALCW system in target hall. Transmitter is calibration by manufacturer @ 4-20mA output@0 to 25 in H2O DP. Control group will finish the cable connection in TH, electrical room, and reprogram   on epic page on July -11th.

2023-07-12: Cable connection, formula reprogram, and epic page reboot are done yesterday by Ray.M. New transmitter works fine. All flow rates are displayed on epic page properly with new program formulas.

HALCW flow sensors replacement job is done. All ITE/ITW(except ITE HS) return line water flow sensors including paddle wheels and coils are replaced.  After job, water interlock signal have been checked in electrical room .  Everything works fine. Visually inspections for possible water leak on HCLCW system have been done as well. one valve on ITE dump return line has a very small water seeping through valve stem. I will watch on it.  Other than that,  No major concern.

2023-03-08: leak on 1/2" ITE dump return line valve is fixed.

HALCW O2 level sensor annual maintenance is done. sensor membrane has been changed and electrolyte has been refilled. gauge is calibrated. It works normal after the job.

HALCW ITC:MP1/MP2 pump and motor temperature measurements result:

MP1: pump discharging  port: 78F,  motor rear bearing house:72F  , Motor housing 140F(60C). 6F difference between them is less than 15F manufacturer clarified up limit in instruction manual. 

MP2: pump discharging port:78F,  motor  rear bearing house:72F, Motor housing 122F(50C).

MP1 is better than MP2 on motor status. It could be seen on phase current measurements as well.

Other notes on pump performance:    total flow rate 60GPM , discharging gauge pressure  99 to 100 psi on both pumps with one station all of TM water circuits bypassed + other station  two of TM water circuits bypassed + both stations 2A beam related water circuits  on(2X5).

HALCW ITC:MP1/MP2 motor phase current measurement is done by Joel from electrician group. MP1:17.1A/17.2A/16.7A.  MP2: 17.9A/17.9A/17.3A.   19.5A is manufacturer notified on full load phase current.on operating  instruction manual. 

 Travis and I completed an electrical check on the wiring harness for the devices on the ground plane. All lines passed 500V with the megger except for PNG and the BTM steerer. Those devices had a short to ground. of ~1.4ohm.

See attached pdf and DocuShare for more photos. It may be possible to clean some of it from the Ground Electrode.

Further attempts to localize the leak were unsucessful. The circuit was pressurized with 60 psi air and snoop solution was applied to both the braze joints and the mating surface between the two halfs of the water blocks. Unfortunately, no visible bubbles could be dectected.

This was reported to Grant and Pierre and it was decided to continue with removing one of the vcr gaskets from the optics cooling lines (on the same circuit) and replacing it with a gasket with a sector cut out to allow this circuit to be pumped out and eliminate any virtual leak type response. The feedthru at the service cap will be capped.

Areas that had snoop solution on them were rinsed with methonal.

A cursory inspection of the extraction column was preformed and some pictures of the back side of the mounting plate and surrounding area were taken as there was some interesting discoloration found in the area below the back of the 9 pin connectors.

Picutres of the snoop procedure can be found at https://documents.triumf.ca/docushare/dsweb/View/Collection-9994

On Monday, March 11 the containment box was removed from TM4 and a vacuum leak check preformed in an attempt to locate the leak in the ground electrode circuit.

Following Pierre's work plain helium was sprayed was the highest joint accessible towards the lowest.

A two second spray of helium was applied to the first joint (the reducer from the service tray to the line that goes to the service tray side of the water block connection), no response from the leak detector after 1 minute.

 two second spray of helium was applied to the braze joint of the servive tray side of the waterblock connection; almost immediate response from the leak detector (see David Wand for actual values for leak rate).

The inital joint at the reducer was rechecked to insure the response was not just a risidual slow response from the reducer joint and confirmed by no response after 2 miniutes that it was not.

The braze joint at the service tray block was then tested again with a two second spray and again almost an imediated response.

A meeting was conveined and decided to pressurize this circuit with air and apply snoop solution to the suspect area to try to identify wether the leak is in the braze joint or possibly c-seal...This will take place on Tuesday, March 12th.