TM3 UCx#47 after operation electrical check  is done at SHC. The result is normal. See attachment.

 TM3 with spent target UCx#47 was disconnected in ITE and will be moved to SHC.

UC#46 was placed in pail# 301 in spot 1B and was 26.3mSv/hr when removed from the SHC. See attached PDF for vault 
details.

 SMP:MP1 is started with SMP BV1 is opened. SMP is under vacuum for TM4 storage during shut down.

ITH:MP1 is deteriorating by watching on ITH:CG1 and CG2 readings and investigation in pit. A fault 17644 has been issued. this pump will be replaced in March when general fielding in vacuum pit is reasonable for the job.

UCx#46 removed from TM4 and placed into a pail back-filled with argon. Nothing visually unusual; no issues.

ITE primary and secondary vacuum vessel leak check for 2025 shut down have been done. No leak.  The TM3 waterlines helium pressure test will be done at TCS when module is there.

 TM4 WITH UCx#46 was disconnected in 2025-01-02 in ITW. Forms attached.

 Five shielding blocks are moved from ITE to storage area ( one of them is sitting on B2 as limit of room) for target stations maintenance in 2025 winter shut down .

ITW primary and secondary vacuum vessel leak check for  2025 shut down has been done. Also,TM4 internal water line helium pressure test has been finished.  Both results are normal. There are two small old leak on EXit 1 and Exit2 module top plate  o-ring under 1Xe-8 atm.cc/sec which we knoew in past years test. resin spray on leak  area reduce the leak ratee below 5Xe-9 atm.cc/sec. No concern on these small leak.   See attachment  for detail results.

A safety walkaround was completed for the ISAC Hot Cells and Target Hall Areas.

The resulting spreadsheet can be found on DocuShare as Document-242733.

Main deficiencies identified:

• Hot Cells:
  • NHC right manipulator gripper stuck (known, repair planned)
• Target Hall:
  • 50% of overhead light bulbs burnt out (David Wang contacted Electrical Services to rectify)
  • One RH camera for target pit not working (Travis Cave notified)

Action has been taken on all deficiencies.

An informal inspection of the main Pail Handling Tool was performed today as the final one for the year. Note that the main formal annual inspection was performed June 18, 2024 for this year.

The attachment to this e-log serves as a record of all inspections for this tool throughout 2024.

The spare tool was not inspected as it was not in service this year.

Five pails were transferred from main vault to mini vault. Note that there was already one pail in the mini vault, so at present there are six pails staged for packaging into F-308s.

Nb#10, Pail 295, Tray 4A
C#4, Pail 277, Tray 4C
Ta#64, Pail 273, Tray 5C
Ta#62 with wire scanner, Pail 256, Tray 7A
TiC#5, Pail 279, Tray 3A

The target index has been updated accordingly (see attached but note that the summary does not reflect the sixth pail).

 5 Shielding Blocks have been transferred from ITW to ITE. MAA is secured after moving.

Ta#68 spent target was moved in Pail 300 to storage vault location 5A. The dose rate measured at the South Hot Cell was 429 mSv/h at 1m. The target index spreadsheet has been updated and the current vault configuration is attached to this e-log. At this time, the storage vault is getting quite full - it is planned to remove five pails in January 2025.

December 5, 2024 - Aaron Tam w/ help from Chad, Peter and Adam at the Crane  

Hot Cell Prep:

• Tools organized, working space cleared, spot for clean tool to sit placed, Air tool is open and spinning clockwise for tightening 

Loading:

• Ta#68 was loaded into pail# 300
• PEEK seal parasitic assemblies loaded (PEEK seals were removed in ID: 2724)
• Farran had some old samples that also went in (More details to come when Farran sends the info)

Lid/latching:

• This went smoothly

Bail attachment:

• Some difficulty in attaching the Lifting Bail, but went on smoothly with the help of Chad

Notes:

• One of the PEEK seal parasitic Target assembly lids was missed in the loading. This will have to be loaded next time. 
• All parasitic type targets remain in the yellow container shown in photos below. 

 Abstract:
This target has seen some irregular beam patterns 
Possibility that the beam hit the walls of the target tube or even the cooling fins
This PIE we want to investigate how the irregular beam physically affected the target 

Related ELOGS: 
ID: 2728
ID: 2698

PIE was performed by Aaron Tam, Directed by Aurelia Laxdal, Observed by Lucas Backes, Special help from Chad Fisher 

External views:

• Windows are clear of any irregularities 
• More pictures of this can be found in RH-ISAC E-log 2728

Internal Views:

• Heatshield internal
  
  • Some discolouration from heat and soot deposits.
  • This seems to be fairly clean to normal amounts - not concerning 
• Target tube
  • tube is bent with the middle higher than the sides
  • Target tube was not removed 9/64ths allen wrench could not be located for this operation 
• Target tube Exit
  • Heatshield windows were punctured to reveal the target tube entraces/exits
  • Entrance is waterline side (ITE)
• Extraction electrode parts were removed from the back off the target
  • These parts look normal
  • some of the extraction electrode would not pull out due to tight fitting parts and the investigation stopped here.

Conclusion: Target physical condition is normal as far as we could investigate 

TM2 was remotely moved from the South Hot Cell to SW Silo. Reading at SHC = 89.8 mSv/h. The move was smooth.

all water lines on TM2 have been purged. Refilled them(except HS ) with 60psi nitrogen for module silo storage before next year using. 

TM3 with new target UCx#47 was connected in ITE right after be moved from TCS. 

  Note: Ta#68 had a difficult install. See E-log ID# 2698 for more info 

First look:

• Containment box cover looks the same as previous (See:ID: 2697)
• Target shows large amount of soot-like deposits (See photos for locations)
• Deposits seem to have been left on parts of the service tray as well ie.: Multipin connector 

Removal:

• Removal was smooth
• Water-line bracket fixing bolts seemed loose even before I put a tool to them 

Eyes of sides:

• Better photos of where deposits are 
• Everything else seems normal 

TM3 was moved with UCx#47 from TCS to ITE. The move was smooth.

TM2 was moved from ITE to SHC with Ta#68 target. During the move, a railing was lightly bumped by the corner of the module - no obvious damage or issues have been observed. Otherwise, the move was smooth.

TM2 with spent target TA#68 was disconnected  in ITE and is being moved to SHC. All water lines are purged for module storage.

 November 27th, 2024 - Aaron Tam with Farran & David 

Parasitic Assembly Leak Check (Aaron, Farran, David)

-Note that the furthest upstream (right of the target) parasitic top cap screws had been loosened and retightened in error when attempting to remove it off TiC#9

-This puts this data point into question 

-Leak check starting from upstream to down stream 

-First parasitic had no leak 

-Second parasitic had some leak 

-Third parasitic was not pumping down at all

-First parasitic checked on test hose again with same success

Parasitic Dis-assembly (Aaron) 

-First parasitic had good tension in all 3 screws

-second parasitic had 2 screws with a perceptible breaking-loose of the screws, but one was imperceptible 

-Third parasitic had lower (than first parasitic), but okay tension in all 3 screws 

In an attempt to move the PEEK seal into a safe spot with tweezers, this one was accidentally sprung across the hotcell in the direction of the tool port 

A lengthy attempt to find it was conducted, but no PEEK seal was recovered 

This may effect our ability to do work during hot cell entries coming up. 

PEEK Seal extraction (Aaron, Farran) 

-A labeled bag was inserted into the hotcell via the tool port and onto an existing tray in the Hotcell

-PEEK seal placed inside bag, placed back on tray, and moved back to the tool port for extraction

-With tool port open, the draft was able to push the bag across the lift table. Changing the cross section exposed to the draft works to keep the bag from moving

-Farran used picker to extract the bag into the tool port where he wiped and placed into separate bag.

-This process was repeated for the second PEEK seal 

-Bags were wiped and swiped, put in another bag, swiped and brought over to Hot cell Service area Lab 

 November 26, 2024 - Aaron Tam 

Handover from TPO and inspection

• Completed
• Some modification to the center Inner-Outer conductor had to be made (hole enlarged as tab was slightly short)

Target Insertion:

• Successful 

Target Mounting:

•  Upon fully seating UC#47 on service tray locating pins, the gas line VCR gasket came off 
  • Operator doesn't have line-of-sight to this area, so there has to be healthy clearance (Foreshadowing) 
  • Gas line VCR gasket reinstalled using manipulators  

• 2nd seating of UC#47 on service tray locating pins, the gas line VCR gasket came off again
  • Some alignment interference with the gas line coupling is the cause of the gasket falling off during placement (photo attached)
  • Gas line on service tray was loosened, raised to highest position and fastened (Photo attached)
  • Failed to re-install VCR gasket (Plastic separated from gasket material)
• Target removed from Hot cell to reinstall gaskets and make modifications to the gas-line coupling
  • Gas line coil plastically deformed to give less of a spring action so the coupling can stay down under friction until it is time to couple
  • Target carefully inserted into hot cell without disturbing spring/friction of gas-line coupling. 
    • This had to be repeated several times. Once for the waterline gaskets coming off, and a few other times to insert the target/tray without disturbing sprung coupling
• Target mounted without issue after the above steps successfully 

Gas and Water Services:

• VCR connections coupled 
• Leak test passed
  • leak test faster today because module had been left in silo for a long time to dry out. 
• Gas line no-longer needed, so was not checked

Electrical Services:

• Conductor bolts installed
• All bolts (including mounting bolts) checked for fit with mirror
• Coil conductor bolts torqued to at least 130inch-lbs 
• Electrical test completed 

Containment box panel reinstalled 

Cleared area around module for craning out. 

TM3 was moved from SHC to TCS with UCx#47. The move was smooth.

An electrical check and leak check had been done after new target UCx47 was installed on TM3 in SHC. see attachment pls.

TM3 was moved from silo to SHC with no target. Move successful.

 Shielding blocks have been moved from ITE to ITW and MAA is secured.

 November 14, 2024 - Aaron Tam w/ Chad Fisher 

Following ID: 2716   
"Nov. 8, 2024 - Aaron Tam 
Tong cable snapped when attempting to remove multipin connector bracket"

Repair went as follows:

• weighted clip attached to tong return side to tension/keep tapes on pulleys
• Manipulator was pinned from both sides (Pinning from master side first makes it easier to position slave side)
• clamps were used to suspend all tapes and cables near the relay bracket 
• extension tube limit clamps were moved to the top to stop it from dropping when Z motion tapes disconnected
• Z motion tapes/tension adjusting screws taken off master carriage and suspended with equalizing weight ~10+ lbs)
• Extension tube limit clamps and extension tube lowered give space to expose multiplier later 
• Wrist joint and handle removed as a unit 
• extension tube to multiplier screws taken out
• Extension tube raised to expose multiplier - using extension tube to wrist joint positioning clamp to keep it in place 
• Old cable removed
• new cable installed

installation in reverse with spare master handle 

Notes:

Spare master wrist joint was missing gears that connect wrist drums 

• this had to be disassembled and installed with gears from old wrist joint

Handle ratcheting pawl spring was not oriented properly, so this had to be disassembled and reinstalled properly (in the process one spring was lost Part#: A-5800)
 

 TM4 with new target UCx#46 was moved from TCS to ITW and has been re-connected right after. see attachment pls.

 Nov. 8, 2024 - Aaron Tam 

Tong cable snapped when attempting to remove multipin connector bracket 

Assistance from Chad required for the rest of procedure 

Tic#9 was loaded into Pail#299 

• Along with fixing and conductor bolts (no other material was loaded)

November 6, 2024 - Aaron Tam 

UCx#46 Target handover from TPO 

Target insertion: successful 

Parasitic Install: All Parasitic targets left off target

• Left side In-beam array type parasitic install attempt #1 
  • Parasitic assembly is too thin/studs too tall for the socket nut to fasten onto target. Stud protrudes through the length of socket section, not allowing tool to insert 
  • previously a 3/4 spacer was used to give space for thermal couple to enter 
  • Install of 3/4 spacer was difficult because it does not hold its shape when handled (pivots around 1/2 ad 1/4 portions) 
  • With spacer installed, parasitic assembly is too thick for socket nuts to fasten onto studs. 
    • It may have been possible to back out studs to use, but left off in the interest of time UCx is exposed. 

• Right side In-beam window type parasitic install
  • Similarly to Left side, studs were too short for install, studs could be backed out, but was left off in the interest of time UCx exposed

• PEEK seal parasitic targets were left off as per schedule, and will be leak checked at another date (after tong cable has been repaired) 
  • Order of PEEK seal locations preserved and follows order as seen with target installed (Photo attached)

Target install: successful 

Leak Check: Successful 

Electrical Check: Successful 

• Initially failed due to wiring diagram being different between production wiring diagram and electrical test sheet

Containment box panel closed 

 TiC#9 was placed in Pail 299 in spot 8A of the vault and was 92.1mSv/hr when removed from the south hot cell. See attached pdf for full vault details.

TM4 with UCx46 electrical and leak check at SHC is done. Everything is good.

November 5, 2024 - Aaron Tam

TiC#9 HP-SIS removed from TM4

• Top left fixing bolt shows signs of heating on it (Comparison photos attached Bolt_profile.jfif  & Bolt_Tops.jfif)
• Location and orientation of darker bolt (Darker_bolt.jfif)

Parasitic Targets Removed

• Left target has residue left from ablation 

See photos attached for detail 

 David made electrical check right after TM4 is moved from ITW to SHC. see attachment pls.

 TM4 with spent target TiC#9 was disconnected in 29-10-2024 and it is being moved from ITW to SHC.

 On October 22 2024 the spent SIC#44 returned from CNL was repacked in a new pail it was in pail 275 and repacked into pail 298 it was 2.34mSv/hr when removed from the south hot cell.

It was placed in the very back of the mini vault. 

TCS water system has been started for functional test. System parameters including  pressure, all temperature sensors, flow rate sensors, resistivity are ok. I will watch on chiller CP1/2/3 in rest of the week and make sure chiller CP1/2/ 3 auto stage in/out work fine.

 On Friday October 11th TiC#8 and Ta#67 were place in the spent target vault in Tray 8. See attached PDF for details. 

 5 shielding blocks are transferred from ITW to ITE, Target Area is secured again after moving.

 Resolution comment / Commentaire de résolution:

     Fixed issue by changing patch cord that was connected to the switch from patch panel.

Emile V

A safety walkaround was completed for the ISAC Hot Cells and Target Hall Areas.

The resulting spreadsheet can be found on DocuShare as Document-242733.

Main deficiencies identified:

• Hot Cells:
  • Phone not working at North hot cell operator station
• Target Hall:
  • Uncertain if NHC and SHC ventilation pressure gauges have recently been inspected

Action has been taken on all deficiencies.

 Post Irradiation Examination

October 9, 2024 - Aaron Tam 

Goal: Training (First PIE by Aaron), Characterize any anomalies 

Notes:

• Overall the target looks exceedingly clean with only some discolouration on the copper behind the target tube, and multipin cable insulation. 

 Post Irradiation Examination

October 9, 2024 - Aaron Tam w/ Chad Fisher, Aurelia Laxdal, and Lucas Backes 

PIE conducted by Chad with direction from Aurelia. Aaron and Lucas observing/documenting 

Goal: Thin foil target material is somewhat novel, and we should characterize the differences if there are any. 

Photos of the pre-examined target can be seen on ELOG 2697  on Tuesday October 1, 2024, when the target was removed from TM2

Notes:

• Right most inner/outer target conductor bolts was sitting proud and had threads showing, photo attached
• Some Black deposit was found on the inside of the heatshield directly below the extraction tube, and loose in powder form inside the heatshield. 
• Target tube seems to have more of a crystalline texture than previous examinations.
• When Target tube was being removed, one of the target electrode conductors broke off
• some dimple texture was found on the target tube windows and this was further explored by prying a channel through the length of one side of the tube to get a better look

Target pieces were placed loosely back within the heatshield, and the lid loosely placed back on.

Awaiting pail loading, and move to storage vault

 TM2 with new target Ta#68 installed is connected in ITE. Pls see form attached.

Tm2 has been moved form SHC to ITE. The move is smooth.

ABCD was dead shorted to 60kv bias during the first time measurement after target installation. Target was removed and reinstalled again with new VCR seals by Ferran.  during target removal process, short disappeared when Aaron remove bolts on CD tube heaters terminal.  leak check and electrical check result are good after second time target installation. 

October 7, 2024 - Aaron Tam 

Ta#68 HP-SIS checks performed at B1 lab, moved to anteroom, and inserted into SHC via tool port w/ Aaron Schmidt. 

Ta#68 fixed to source tray with 4 mounting bolts in order of: Right manip. holding, Top left, Right manip. removed, Bottom right, Top right, bottom left. w/ Aaron Schmidt and Brady Borrmann

• Motion was smooth, no resistance when positioning onto pins

VCR fittings done up with ample force, leak check passed

Conductor bolts installed in order of: 2 Target electrode conductors (Checked washers), 3 target Inner and outer conductors.

All bolts checked for full contact with mirror and binos. 

Electrical check failed: Dead short (look for David's ELOG for more detail when available) 

Troubleshooting while David is checking resistance: w/ Ferran

• Intermittent success with heavy manipulation of water lines
  • Loosening off Waterline bracket-to-source-tray 
  • Loosening off Bracket to water line bolts 5/32 hex's 
  • Rotating bracket towards operator (effectively raising waterlines in the back upwards) seems to yield more intermittent success, but never passing megger @ 250V 
  • Tube was inadvertently dented when handling the tube in a wrenching motion with manip tong. counterclockwise
• Target removed while David is still on the multimeter (calling for any sign of success)
  • Starting to remove Target in order of: Tightening back waterline-to-bracket 5/32 hex screws, loosening off waterline bracket, loosening off VCR nuts, 2 Target electrode conductor bolts, 3 Target inner and outer conductor bolts, Fixing bolts Top left (dropped below source tray), Bottom right...
    • (At this time David called with some success with electrical check)
  • Reversing course to verify fault has passed, target was reassembled, only finger loose on the VCR nuts.
  • Faults no longer present
  • Target removed
    •  As target was being pulled off source tray locating pins, a piece of ceramic fell onto the source tray just behind window waterlines.

Target taken out of Hotcell by Ferran. New VCR gaskets installed. Target reinserted 

Target installed no issues. Used fixing bolt used to replace dropped one. 

Leak check passed, Electrical check passed

• Notably don't have a photo of reinstalled target or source tray before 2nd install attempt. 

Containment cover reinstalled 

Ceramic piece moved into Pail #285 (suspect this is a very hot piece)

TM2 ready for move to ITE

 October 1, 2024 - Aaron Tam 

Ta#67 LP-SIS removed from TM2

Ta#67 is sitting in SHC awaiting PIE 

TM2 Containment Box Cover has not been reinstalled 

Photos of target removal and module attached 

TM2 has been moved from ITE to SHC. Peter did the move with Travis on help.  The move is smooth.

 TM2 with spent target Ta#67 was disconnected in ITE. see attachment pls.

TCS water system resistivity analyzer has been repaired. Two diodes and one capacitor on PS board were broken. They were replaced. Installed analyzer back and tested it in system. it works fine. Operator closed e-fault, removed force on TS5, and enabled alarm on TS5 and TC1.

Tm3 has been moved  from SHC to silo. the move is smooth.

HALCW O2 level sensor annual maintenance is done. sensor membrane has been changed and electrolyte has been refilled. gauge is calibrated. It works normal after the job.

 5 shielding blocks have been moved from ITE to ITW.

 September 23, 2024 - C. Fisher 

• Containment box removed
• Insulator installed
• New window line VCR seals installed
• Dropped bolt from TiC#8 removed
• Containment box reinstalled

September 23, 2024 - A. Tam

• Containment box cover reinstalled 

Photos attached 

vacuum leak check on TM4 service cap in ITW was done this morning.   leak detector leak rate 0.0XE-9 atm.cc/sec. No leak on TM4 service cap module top.

10 pins lectrical check result after insulator is installed on water cap C.

pin 14 to 60kv bias has 20 Kohm @250V Megga check. The rest check on ohmmeter and megga @250 are either OLor over 25Mohm which are good.

TM3 window line has been leak checked after containment box removal and installation for insulator installation on water cup C.   No leak.

Tm3 has been moved  from silo to SHC. The move is smooth.

 TiC#8 HP FEBIAD removed from TM3

Target sitting in SHC

1 Coil Conductor bolt fell under source tray 

Photo Dump uploaded

 TM4 with target TiC#9 is connected in ITW. See attachment.

TM4 has been moved from TCS to ITW. The move is smooth.

Over the course of September 9th - September 13, 2024 a CRL manipulator technician carried out the following manipulator maintenance:

NHC operator side arm #9763 (right side installed position) - Inspection and re-tensioning of tong cable prior to re-installation (was a little too tight). Operational.

E-HD clean spare #8015 - repaired stuck manual 'Z' motion - removed one rouge 5-40 screw that had been dropped inside remote end during 'Z' motion cable run through in 2017, found that related 5-40 screws from the cable end clamp were not tight and therefore proud and also jamming. Complete tape replacement and tensioning. This manipulator is fully back to operational status other then needing some screw for the air restriction on the remote end.

E-HD "dirty" spare #7985 - inspection and evaluation of parts on the operator side require to return to operational status. Wrist and handle reassembled (all parts of wrist and handle accounted for) Ball and socket joint at and of motion lock replaced (parts were on hand already) as well as tape motion lock assembly (parts on hand already). This arm may be missing a relay or two. Remote side still bagged with unrecorded issue (suspect it is only a broken tong cable) this will be put in the maintenance schedule for earl 2025.

NHC operator side "spare" arm #9351 - Damaged 'Z' motion tape replaced. Tensioning. Operational once 'Y' motion linear actuator re-installed.

Meson hall warm cell manipulators evaluated/inspected - No issue found

On Friday, September 6, 2024 Model 'N' remote arm #9352 was removed from the NHC right side installed position to investigate  an ongoing issue with the tong motion circuit (no motion on the remote side when handle on operator side operated).

Inspection revealed that the tong cable on this arm have hopped its cable drum and rapped around the shaft of the cable drum. As well, the tong cable had hopped a lower pulley and was jammed between the pulley and casting of the pulley housing. These issues were corrected and arm#9352 was reinstalled onto the right hand position. This repair resolved an ongoing tong motion system stemming from November 2023 described below.

initial tong motion problem from November 2023 when the tong system jammed, operator side arm #9763, remote arm #9342.

Remote arm #9342 was removed and replaced with arm #9352 as it was suspected there was a hopped cable on #9342. Upon removal it was confirmed the tong cable on remote arm #9342 had indeed hopped the pulley. After installation of the "spare" remote arm #9352 that hAd not been installed since previous servicing and should have been completely operational, it was found the tong system still did not work properly.

Upon thorough inspection of operator arm # 9763 it was found that the tong cable was prematurely reaching the end of its travel on its drum causing the inability to activate the circuit. The tong cable was reset on its drum as per manufacture's specs with one full cable rap on the drum and one full pretension wrap of the tong drum spring.

Although this resolved part of the problem and allowed a full squeeze of the operator handle it did not result in transfer of motion through the system to the remote end.

Further investigation continued, separating the operator side arm from the seal tube and testing the seal tube and operator side arm independently. Both systems worked fine independently, pointing to a potential problem between the seal tube and spring loaded coupler on the remote arm.

Remote arm #9352 was removed and couplers visually inspected and end of seal tube on the hot side was inspected and found that the pin in the end of the shaft on the tong circuit was not installed symmetrically which could cause uneven pressure on the spring loaded coupler of the remote arm. This pin was adjusted and all pins on the hot side of the seal tube were dimpled and loctite applied as a precautionary measure.

This still did not remedy the tong motion problem. These led to the September 6, 2024 removal and repair of remote arm #9352. This arm had previously been serviced by a CRL technician in December of 2017 and had not been installed or used since and should have been in operational status. It is still not clear why it was not.

On 2024-09-12, CNL reported difficulty with lowering Pail 275 from F-308 flask #22 into their tile hole. The four other pails associated with this shipment were successfully emplaced. It is suspected that the issue was related to a kink in the lowering cable, causing a jam during lowering. This was observed approximately 1 year ago.

Discussions with CNL to learn more about the root case are ongoing, and this e-log will be updated when more information is learned. It is expected that this flask will be shipped back to TRIUMF and the pail will need to be repacked.

Update 2024-09-12: email from A. Swan at CNL: "4 of the 5 flask were emplaced successfully with F308 #22 SiC#44 having an unsuccessful pull test and left within the flask."
This is the extent of the information they have provided and is not sufficiently helpful to determine what the issue is.

Updated 2024-10-03: an investigation was performed (work permit C2024-09-26-10). It was determined that the root cause of the issue is attributed to an assembly error - the cable was incorrectly routed through the holder part. See attached report for full details.

Update 2024-09-12: C. Fisher confirms this is actually normal behaviour. The Y-axis motion is inhibited when X and Z are in a certain configuration, which was true when the manipulator was mounted on the wall in storage position. Non-issue. A note about this has been made in the operator manual.

It was observed today that for the spare manipulator (Model N, Serial 9351), the Y-axis motion was not functioning. X motion and Z motion are functioning as expected. Note that the Y-axis linear actuator was recently replaced and successfully tested and has not been used since the replacement (see e-log 2422).

The following information was determined from troubleshooting:

• X motion functioning correctly
• Z motion functioning correctly
• Y motion selection functioning correctly - the indicator light on the operator control box lights up to confirm Y is selected, and the relay on the main control board which selects the Y axis toggles, as expected
• Y motion motor contactors do not function as expected when toggling in either direction. Note that these contactors are shared in common with the other two motion axes, so they are functioning correctly and presumably the motor controller itself is as well, since the other axes work.
• Most likely, because of the above reasons, there is an issue with the inhibit signal that is specific to the Y axis. The inhibit signal which runs from the main control board to the motor control board is shared in common with all motion axes (same for the two direction select signals). It is suspected (not yet confirmed), that the microcontroller is not outputting the inhibit signal as it should be. This is not due to a limit switch related issue because the Y axis does not have limits. Troubleshooting this has been difficult because the schematics do not show the full extent of the circuitry.

Further troubleshooting steps:

1. Check inhibit signal functionality - is it working for Y axis?
2. Check direction control signal functionality - are they working for Y axis?
3. Swap motor select wires to "trick" the microcontroller into thinking it is running a different motor, to further isolate the issue.
4. If required, swap the entire main control board with another manipulator's, to see if the issue is related to the circuitry which is not described in the schematics.

At the time, this issue is not deemed critical because this is a spare unit.

TM4 has been moved from SHC to TCS. The move is smooth.

 TM4 with new target TiC#9 Surface installed in SHC was leak/electric checked before moving to TCS. See attached pic pls.

September 9, 2024 - Aaron Tam 

• Water from waterline found puddled on source-tray and containment box. 
• Water was wiped up as much as possible, but likely still in containment box 
• leaving to dry overnight
• Target inserted into Hotcell with nuts for the parasitic target. 4/4 socket nuts installed on upstream flange, and 3/4 installed on downstream flange

September 10, 2024 - Aaron Tam

• TiC#9 HP-SIS installed onto TM4 
• Leak check passed after retightening VCR joint
• Target Electrode Conductor screws torqued to 130 inch-lbs 
• Electrical test passed 
• Containment box cover reinstalled

Photos attached

September 5, 2024 -AT

• Plastic and clean target tray added to SHC 
• TM4 moved to SHC 
• TM4 containment box cover removed

September 6, 2024 - AT

• Ta#68(Spare) removed from TM4 onto clean tray 
  • top left mounting bolt fell under source tray in containment box - unretrievable
• Ta#68(Spare) moved out of SHC via toolport door 
  • SHC lift table was lower than tool port tunnel by 2". Target-on-Tray slipped back onto lift table when trying to drag it up to the tool port. Target bounced out of one locating pin, but stayed within boundaries of the tray 
  • Water also leaked out from the VCR fitting and on to the SHC lift table, and toolport. 
• Target-on-tray slid into a clean plastic bag, and then into a plastic box. 

 September 9, 2024 - AT

• Ta#68(Spare) taken out of plastic bag and water drained from waterlines
  • Target was rotated in every direction several times until no more water poured out from the VCR joints
• Ta#68(Spare) put back in box without the bag (to promote evaporation) 

TM4 has been moved from SMP to SHC. The move is smooth.

D. Wang reports that recently the overhead crane has been exhibiting a delayed start (approx. 1 min) when operating in local mode. This issue applies to the main hoist's up/down functionality only and does not seem to apply to other motion axes. T. Kauss briefly investigated but did not find any obvious cause.

This issue will be monitored and investigated over the following weeks and this log will be updated as more information becomes available.

Suggested troubleshooting steps:

• Isolate the issue to local or remote mode to confirm this suspicion (it appears to be present in both local and remote mode)
• With help from someone locally operating the crane, confirm at the receiver in the control room whether signals are coming through for up/down commands immediately, or whether the receipt of signals itself is delayed. At the same time, confirm whether the PLC input card is receiving the command signals from the receiver immediately or in a delayed manner. (it appears that the command signals are being received by the VFDs - the issue seems to be on the output side)
• Time the delay, and repeat to confirm if the timing is consistent every time as reported by D. Wang (it appears timing is inconsistent. After a weekend of no use, it was approximately 2 minutes. After a few hours of no use, it was around 10 seconds).
• Check if delay is present across various crane positions in the target hall (completed by D. Wang - result: yes)
• Inspect controls hardware in the cabinet in the control room, as well as the remote IO on top of the crane, for obvious issues (checked cabinet but not remote IO - nothing obvious)
• Go online with the PLC and test up/down commands to see if the program indicates any obvious issues (note: this may not actually help - seems to be an electrical issue isolated to the VFD-related electronics)
• Mechanical inspection of the motor (not likely an issue)
• Disconnect motor, repeat test of trying to command up/down motion and see if the motor itself had any effect on the delay

Update, 2024-09-09 [DW]:  Confirmed both local and remote mode have the same problem on delayed main hoist functional issue after crane was switched on. The delay time is 1 minutes 40 seconds to 2 minutes. It happens mostly when first time the crane was switched on. But if the crane was not used in the rest of day after first time switching on , the problem showed again 5 to 6 hours after in same day.

Update, 2024-09-09 [AN]: Checked again around 11:30am... tested running both hoists A and B in remote mode. Upon first attempt to lower hoist, no motion occurred. Hoist A VFD exhibited fault code 51, and Hoist B exhibited fault code 52. Both hoists appeared to receive the command from the PLC to attempt to move. Both hoists (initially) had their "ready" status as ON. When attempting to move, however, hoist B's ready status dropped out. Note also that the delay observed between the failed attempt to start, and when motion was actually possible, was only approximately 10-20 seconds. Perhaps this correlates to the fact the crane was recently operated this morning. It is suspected that the charging circuit for hoist B's DC bus voltage is faulty.
Tomorrow, another test will be performed by checking A and B independently to see if one can run but the other cannot.

Update, 2024-09-10 [AN]: Tested the crane using only Hoist A: working upon first power-up of the day. Tested using only Hoist B: not working, fault 52 re-appears. We are certain the issue lies with Hoist B. Furthermore, upon observing the motor contactors and status LEDs when attempting to energize the motor, the following is observed:

• For Hoist A (normal, working operation) - on power up K1 toggles on (in). When pressing down button, K7 toggles (in). The hoist begins to move.
• For Hoist B (non-functioning), on power up K1 toggles on (in). When pressing down button, K7 does NOT toggle. K1 toggles OFF (it should not) then comes back, then triggers the fault.

Upon further inspection it was noted that for K1 for Hoist B, there appears to be a snubber (XEB2202) wired in across the A1 and A2 terminals of the contactor. The fact that a time-dependent circuit is involved matches earlier theories about a charge-timing related issue. Suggested action: attempt to remove the snubber and test again to determine if the issue persists.

Update, 2024-09-11 [AN]: Under work permit I2024-09-10--3, the following was tested and observed:

• Run Hoist B to confirm it is not working (expected behaviour) - confirmed
• Power off crane, remove the snubber from Hoist B's contactor K1
• Power on crane, attempt to run Hoist B - the hoist did not run
• It was noticed also that Hoist A did in fact have a snubber installed as well - it was hidden. The snubber for Hoist B's capacitance was measured and confirmed to match what it should be, so it is suspected that it is working fine.
• This indicates that the snubber is not the issue. The snubber was reinstalled and the system returned back to normal state. Tested - working.

At this time the root cause remains unknown, but the snubber has been eliminated from the possibilities.

It appears that the issue can be isolated to the fact that contactor K1 momentary toggles off when attempting to operate the hoist. This short blip would explain the fault code related to insufficient line voltage. The drawings indicate the only way that K1 can turn off is if the 48 VAC supply from the transformer drops out momentarily, or if an unnamed relay located (presumably) in the VFD momentary toggles.

Further troubleshooting steps could include:

• Probe for 48VAC at A2 terminal of K1 and attempt to operate the hoist - see if it drops off briefly. If so, the issue is either the transformer or the relay contact in the VFD. Perform continuity check across the relay contact, repeat attempt to operate hoist, and determine if it is the relay contact causing the issue. This test will significantly isolate the issue.
• Check inside Hoist B's VFD circuitry and measure the DC bus voltage during attempted operation, and compare to Hoist A. There may be an issue with the charging circuit inside the inverter.

Update, 2024-09-13 [AN]: Under work permit I2024-09-10--3, the following was tested and observed:

• Probe the A2 terminal of K1 for Hoist B with respect to the transformer's 0V output upon initial power-up of the system: ~53VAC measured (should be 48VAC but 53 is acceptable)... this confirms that the appropriate relay coil voltage is present upon power-on, as expected because it is observed that the relay toggles upon power-up.
• Continue probing A2 while attempting to jog Hoist B down, with min-hold set on the multimeter to check for voltage drops: the voltage measured was approximately 24VAC during one attempt and 36VAC during another. This implies that K1's coil voltage does in fact drop out instantaneously, resulting in K1 very briefly disengaging which causes the observed VFD vault. The fact that the measured min voltage is different can be attributed to the mulitmeter's sampling rate, catching the voltage during its decline towards 0.
• Because of the aforementioned test results, it is confirmed that there is an issue associated with K1's coil voltage briefly dropping out when attempting to run the hoist. There are only two reasons this could happen: 1) the transformer power output of 48VAC actually drops, or 2) the relay contact in series with this (located inside the VFD) opens up as a result of a VFD fault. The latter is more likely.
• Upon investigating the VFD further, it was determined that another fault code was present prior to the above mentioned code 52. This fault code happened very briefly at the same time as K1 toggling, but was then covered up by code 52. This fault code is 2, which states that there's an overvoltage condition - the DC bus voltage has exceeded 911 VDC (135% of device maximum nominal voltage of 500V). This can be attributed to a supply voltage surge in which it is raised 35% above its nominal value.
• Note: line-to-line voltages were measured at the input to K1 after the "warm up period" and the issue was resolved, when the hoist was sitting idle. These were measured to be almost exactly 480VAC. This represents a reference condition.
• What seems to be happening is that when the hoist motion attempts to start, there is a line voltage surge for some reason (back-emf?) which causes this fault condition for a temporary instant, but then when the voltage dissipates the fault instantly clears. This explains why contactor K1 very briefly flickers during motion attempt - the fault is only briefly present. But then, fault code 52 takes over and remains present (because of the line voltage disruption).
• Still, the root case of this issue is unknown. It is not confirmed whether there is actually a voltage surge or not (to be measured next week), and why it seems to only happen for the first ~2 minutes of the day.
  It could be attributed to one of the following reasons:
  • Coil voltage rectifying diode partial failure inside K1... the diode may need time to "warm up"
  • Brake solenoid partial failure for Hoist B (causing additional friction which leads to overvoltage condition for the motor)... the brake may need time to "warm up"
  • Charging capacitor issue in DC bus voltage charge circuit inside the VFD

Suggested troubleshooting steps:

• Probe line-to-line voltage at input terminals to K1 during attempt to operate Hoist B in max-hold mode: check for surge, record values
• Probe DC bus voltage during the same condition, record value
• Determine if the above indicate a true overvoltage condition, and determine why this may be

Update, 2024-09-16 [AN]: Under work permit I2024-09-10--3, the following was tested and observed:

• Probe L1-L2, L2-L3, and L1-L3 line voltages on input side of contactor K1 for Hoist B with max hold set on multimeter to confirm whether there is a surge when attempting to move the hoist - no surge was observed. 480VAC constant was measured in each case.
• There may be another issue causing the DC bus overvoltage condition (an issue with the motor or an issue with the drive itself)

Suggested troubleshooting steps:

• Probe DC bus voltage during the faulted condition, record value
• Disconnect the motor from the drive and check motor winding resistances before and after the "warm up" period to see if there is a change, and also compared to Hoist A
• With the motor disconnected, attempt to run the drive - determine if fault code 2 shows up or if the drive appears to be working.. this may eliminate the motor from the list of potential issues

 Update, 2024-09-16 [AN]: Under work permit I2024-09-16--3, the following was tested and observed:

• Probed DC bus voltage on Hoist B's VFD prior to attempting to move hoist, and during the attempt to move it. In both cases it remained a constant 690 VDC. No temporary spike was observed. This is also lower than the threshold that the VFD's manual stated the fault would typically occur at (~911 V) so it casts doubt on whether this is the root cause of the problem.
• Probed DC bus voltage for Hoist A's VFD, for comparison - same measurement.

Suggested troubleshooting steps:

• Disconnect the motor from the drive and check motor winding resistances before and after the "warm up" period to see if there is a change, and also compared to Hoist A
• With the motor disconnected, attempt to run the drive - determine if fault code 2 shows up or if the drive appears to be working.. this may eliminate the motor from the list of potential issues
• Swap VFDs between Hoist A and B to determine if the problem tracks the drive
• Swap K1 between Hoist A and B

Update, 2024-09-16 [AN]: Under work permit I2024-09-16--3, the following was tested and observed:

• Measured motor winding resistance between every combination of lines for both Hoist A and B (for comparison). Note: this was done mid-day, prior to any use of the crane for the day. In each case, the resistance was measured to be 2.2 Ohms. There is no difference between the A and B. This is not likely the root cause of the issue.

Suggested troubleshooting steps:

• With the motor disconnected, attempt to run the drive - determine if fault code 2 shows up or if the drive appears to be working.. this may eliminate the motor from the list of potential issues
• Swap VFDs between Hoist A and B to determine if the problem tracks the drive
• Swap K1 between Hoist A and B

Update after email discussion with Kone service tech, 2024-09-23 [AN]:

The Kone service tech said "This is a obsolete inverter and there is not a direct replacement available or parts for repair .  It is recommended to replace inverter with a conversion panel. The conversion panel consists of new, correctly sized components including D2V inverter, to have the same functionality as original panel. All components mounted and prewired to a back panel that fits directly inside the existing enclosure. All inputs and outputs are terminated at a terminal strip. Interconnecting wiring diagrams are also provided for ease of installation. The lead time for a conversion panel is approximately 10-12 weeks after receipt of a Purchase order."

A quote will be obtained from Kone for the replacement.

Update after K7 swapping between hoist A and B with Jason, Mike, Julie, 2024-10-09 [DW]:

Contactor K7 was swapped between hoist A and B. On hoist B we saw F52 fault and K7 did not engage in properly. On hoist A we saw F51 fault which is "stop limit has be tripped" and K7 also did not engage in properly. After 2 minute wait, both hoist A and B are back to normal. The plan for tomorrow: switch to A hoist and test. right after, switch to B and test. 
UPDATE FOR PAST THREE DAYS TESTS AND PROGRESS.  DAVID WANG 2024-10-12
2024-10-09 noon. Left crane with power on for 1 hour. switched off power on crane for rest of day to Thursday morning test.
2024-10-10 morning. Set to A hoist only. Switched on main power and tested hoist A down. It was normal, no delay. Right away switched to hoist B and tested hoist B down . It was normal, no delay. Switched to A and B and tested hoist up and down. It was normal, no delay.

2024-10-10 noon.  Replaced spark quenchers on hoist B K1 and K7. Tested crane after replacement. Everything works fine. Used crane to lift up F308 around 1:30. Then switched off crane for next morning test.

2024-10-11 morning. Set to A and B. Tested crane hoist down twice 2-3 seconds each time with 3 second between. No fault. Hoist worked fine.  3 second after, tested hoist up and found  K7s were not on on both A and B. 10 seconds after tested hoist up again and it worked. Then tested all crane movements. Everything was normal. Crane was used for spent target moves to 2:30pm . Then switched off.

2024-10-12 morning: Set to A and B.  Right after power on, tested hoist up for 5 seconds. wait 3 seconds, tested hoist down for 5 seconds. Repeated same up and down test within 3 seconds.  No fault. the hoist A and B works fine. Tested N-S,E-W movement. all good.  at the last, tested hoist up and down 10 seconds each. Hoist A and B are still good. The plan for next morning test: Leave crane power off to Tuesday morning and test hoist A+B(48 hours power off). Also plan to replace spark quenchers on hoist A /K1 and K7 if any delay is found on Tuesday morning test. 
2024-10-15 morning: Set to A and B. tested hoist up and down one click on each. I saw K7 momentarily "on" then drop off symptom as before. I saw F51 on A and F52 on B. Switched to A right away and tested. A works fine. Then switched to B and tested. B works fine. The total test time from A+B to B then to A is about 30 seconds. Then i switched back to A+B for checking. everything works fine as anticipated.

2024-10-16  A-K7 snubber was replaced yesterday after morning test . Tested hoist A+B this morning after 24 hours crane power off. Hoist A+B works fine on both up and down. 

2024-10-17 Tested A+B hoist this morning after 22 hours crane power off. Hoist A+B works fine on both up and down.

2024-10-18 Tested A+B hoist this morning after 24 hours crane power off. Hoist A+B works fine on both up and down.

2024-10-21 Tested A+B hoist this morning after 72 hours crane power off. The delay issue on hoist B appeared. Hoist A is fine. B/K7 was momentarily on then dropped off. By the same time B/K1 was momentarily dropped off then on with F52 code.

2024-10-22 Tested A+B hoist from target hall this morning after 22 hours crane power off.  hoist A+B  works fine on both up and down.

2024-10-22 noon.  Swapped  hoist A/K1 and B/K1. Crane power off at 9:30am after flask/pail repacking job.

2024-10-24. Tested A+B hoist this morning after 46 hours crane power off. Hoist A+B works fine on both up and down. Crane will be left as power off for 48 hours for next test.

2024-11-21. In the past month ,I tested crane multiple times. 24 hours power off test results are good always. 48 hours or longer power off test results are not consistent. Hoist B had 15 to20 seconds delay on early checks after last e -log. But in recent  6 days power off check and 3 days power off check, the hoist B has no delay. The next step: 1, keep on multiple days power off check. 2, replace Hoist B K1 (line+auxiliary) contactors with new parts.

2024-11-25. tested hoist A+B this morning after 4 days crane power off. No delay. everything works fine. Replacement contactors for K1 have been requested. Line contactor is in 5 weeks back order status from Digikey so we will replace Hoist B K1 next year in January mostly.

2024-12-02. Tested hoist A+B this morning after 4 days crane power off. No delay. everything works fine. It looks like  no delay status is stable now by watching on past 40days morning check result. Daily and multiple days check on hoist B  will be kept on.

2025-01-02. Tested hoist A+B this morning. The last time of crane using in 2024 should be 18th Dec. No delay . Crane works fine.

TM3 has been moved from ITW to S-W silo. The move is smooth.

 TM3 is disconnected and all water lines are purged/refilled with 50psi Nitrogen. Pls see pics attached with.

 Nb#10 was placed in pail#295 and moved from the south hot cell to the spent target vault, spot 4A, it was 230uSv/hr when removed from the SHC. See attached PDF for vault details.

 TIC#7 was placed in pail #294 and then moved from the south hot cell to the spent target vault spot 4B. It was 82.3mSv/hr when removed from the SHC. See attached PDF for details.

Nb#10 never worked online - repeller had no effect on the beam and one of the RF wires was touching HVC. Max 60pA was seen on the source cup. See notes here ITW-TM2-Nb#10/#11-LP-IGLIS  (Web view)

Target was handled roughly after use - kicked around in NHC for a long time, then loaded into a pail (multipin had to be dettached for this) then moved to SHC, unloaded from pail, then plates covering the RF electrodes had to be pried off. Lots of knocking and shaking.

Theory was that the repeller wire was disconnected. But found it not obviously broken, had good continuity from the ring tongue to the end of the wire pulled out of the multipin, even after all the abuse. Same for the RF (from the end of the electrode to the end of the wire pulled out of the multipin). Did find some of the multipin wires were flaky - if moved around they showed intermittent shorts to HVC. But not clear if this is from the rough handling afterwards or not. The problem was not in the module since NB#11 ran immediately afterwards with no issues. Most likely culprit seems to be the insulation beads on the wires. Should look for more robust insulation solutions. On the other hand, the connections of the wires to the electrodes seems very good.

Still not sure why no effect of the repeller was seen. Could be a intermittent break/short, though this seems unlikely. Maybe the connection in the multipin was not good? I did not get a chance to inspect that.

TiC#7 failed after two weeks of operations - measurements in the electrical room indicated that the negative side of the CHT was broken (35kOhms to the rest of the target). This was likely due to a large number of proton trips during this target run. At every trip I could see the CHT voltage getting higher and more unstable. This cahnge in voltage was reflected in the unstable anode current and fluctuating RIB beam intensity, as a direct result of the fluctuating power on the CHT. The break was confirmed in PIE, loosening the screws caused the target container to come off without the cathode. Otherwise nothing unusual was seen. The anode wire connections seem very robust, dragging the target around with the multipin disconnected, flipping it up and down, etc and the anode wire stayed attached. Though we saw lots of outgassing on this target, things looked the normal level of dirty. There was no buildup between PE and EE.

 5 shielding blocks have been transferred from ITW to ITE, MAA has been secured after moving.

TM4 has been moved from SHC to TCS. The move is successful.

 Target Ta#68 loaded onto TM4 

-leak check passed

-Target electrode conductor screws torqued to 130 in-lbs

-electrical check passed

Containment box cover re-installed 

photo attached 

 TiC#7 Target Removed from TM4. - Photos attached 

TiC#7 Currently sitting in SHC waiting for disposal 

 New target Ta#68 is installed on TM4 and be leak/electric checked. Pls see attachment.

TM4 has been moved from  SMP to SHC. The move is smooth.

 SiC#46 (pail 293) was placed in the vault (spot 3B) on Wednesday the 14^th of August. It was 111 mSv/hr when removed from the south hot cell. See attached PDF for details.

 SiC#46 loaded into pail 293 successfully along with other hotcell waste 

Upon visual inspection of the target, a spark-sign was spotted on the perimeter of the extraction electrode. Metallic looking material also found built up between the extraction electrode and the backing plate of the target 

Photo attached 

TM2 with Ta#target has been moved from SHC to ITE. the move is smooth.

 TM2 with new target Ta#67 was connected in ITE, all TP are running at their full speed now.

 TM2 with new target Ta#67 had been electric/leak checked before moving to ITE. See attachment pls.

 Ta#67 Target loaded onto TM2

Leak check passed

Electrical test passed after loosening off target electrode conductor screws, and torqueing by feel 

With the new TiC#8 target installed on TM3, there was a ~7kOhm connection between TGHT/TBHT (A/B/C/D) and HV common. The standard electrical check on the module showed standard values, so it was assumed the problem was inside the target.

Started removing bolts/water connections one by one to see if any of them had an effect on the measurement. Found that disconnecting the multipin on the target from the mating connector on the source tray resolved the issue. Determined that the only way this could happen is if a spark cut through the insulation covering the multipin wires. Because of the way they are routed, they can touch the water lines and they are definitely touching waterline C, TBHT-. We do not typically check continuity of multipins to all water lines, just to HVC, so did not see this in the standard electrical check. Measurements verified that pin 2-4 was touching water line C, creating a short from TGHT/TBHT to HV common when the multipin connector is attached, since the pins are shorted to HVC inside the connector when they are not used.

Issue was solved by removing the target into the ante room, removing connector 1 all together since it was not used, and removing the grounding on the other pins, leaving only pin 2-2 connected for the anode.

In future we will change the IGLIS wiring so pin 2-4 is not used, and redesign the cable routing so it cannot touch the blocks. For the immediate term, we will add to the electrical check a check of each pin to TBHT/TGHT/COIL.

TM3 has been connected in ITW. See attachment for checklist.

With TiC # 8 installed, TM3 has been moved from SHc to ITW. The move is smooth.

Tm4 has been moved from ITW to SMP. the move is successful.

 TM3 with replaced target TiC#8 has been checked on SHC before moving to ITW. Pls see attachment

 TM4 with spent target TiC#7 (dead) was disconnected in ITW and ready to move to TCS.

ABCD is short to 60KV bias. Othjer are ok.  see attachment.

Found afterwards that this short was due to sparking through the multipin wire insulation where the wires pass behind the TBHT block "C". See fault 17265.

Tm3 was moved from ITE to TCS this Tuesday, then to SHC  this morning. Both moves are successful.

 TM3 with spent target SiC#46 was disconnected in ITE and ready to move to TCS soon.

 5 shielding blocks have been transferred from ITE to ITW. MAA is secured again after moving.

 The UC#45 target was moved from the south hot cell to the spent target vault. It was place in Pail#292 spot 1A of the vault, was 19.5mSv/hr. Also this pail contains the target material of UC#44. See attached PDF for more details.

A safety walkaround for July 2024 was completed for the B2 level by A. Newsome. No deficiencies to report.

Results can be found in the master spreadsheet

 TM4 with TiC#7 was connected in ITW, all TPs are running at full speed.

TM4 has been moved from TCS to ITW.  the move is smooth.

TM4 has been moved from TCS to ITW.  the move is smooth.

 SS washers were added to all slotted holes on SMP chainguard cover plate

 New spring idlers were installed onto rotational chain drive for SHC roof. Operation ran smoothly in both directions to full limit. Chain was noted to have adequate slack when not on driven side. Periodic checks to confirm operation will continue in the following months to guarantee proper operation.

An annual electrical and mechanical inspection was performed on the SMP today by Adam Newsome, Travis Cave, Riley Sykes, Maico Dalla Valle, and Jason Zhang as per Work Permit  I2024-07-10-1. The following items were checked:

• Check condition of wiring for physical/radiation/UV damage
  • OK, no signs of significant damage
• Check for cable tray debris or damage
  • There were multiple items in the cable tray which do not belong there - misc. pieces of wood and metal... these items were not disposed of but should be in the near future
• Check inside control panel: components and wiring, labeling
  • Labeling intact, components in good condition
  • Misc. random wires pulled to check... OK
• Verify camera views
  • This was not inspected in detail as it is something that would be done prior to remote operation
• Check connectors for damage
  • All connectors OK
• Check pendant for damage and verify labeling intact
  • Pendant OK
• Lid open/close test
  • Lid was opened and close multiple times - smooth operation, no concern
  • Lid close logic was checked - OK
• Vessel rotation and limit switch check
  • Both CW and CCW limits were checked, functioning
  • No concern on rotation - chain drive, rotary limit switch, and cable reel all functioning normally
• Lubricate chains
  • Not done - should be done next year
• Inspect tensioners
  • Done - OK
• Tighten fasteners
  • Not all fasteners were checked - washers will be replaced soon so this was not deemed necessary
  • Approximately 50 washers are missing for socket head screws in slotted parts. Not safety critical but they should be replaced soon.
• Visual inspection
  • All OK

Overall the inspection was successful.

ITE:EL has been tripping off due to HV sparks. Usually this also trips ITE:Q1/2. These are sitting in side-by-side racks.

The working theory is that HV sparks are returning to ground through the EL and quads, tripping them off. Possibly this is the result of a changed low impedance ground path. How this change happened could be either something we did during shutdown or the changes we made in TM3, no clear evidence yet.

The goal of these changes is to stop the EL and quads from tripping, assuming the sparks are travelling through the ground.

Possible routes through ground to the EL power supply:

1. Through controls. EL is controlled by a canbus card. Preliminary investigations by Mike Rowe make it look like the canbus reads the PSU max voltage (60kV), then the staton bit trips, then after a while of trying to talk to the power supply, the statdrv is turned off. It is not clear why the power supply is turning itself off, since it doesn't seem to have a trip or protection circuit inside. To be further investigated.
2. Through the AC ground.
3. Through the shield on the output voltage conductor that runs to the pit.
4. Through the EL wire and conductor itself.

Current attempts to mitigate the tripping:

• Add an isolation step to the AC power, in case it is coming through AC ground (option #2).
• Add ferrites on the controls lines (option #1, this was done earlier and no effect has been seen).
• Add transient voltage suppresors on the Vmon, Imon, Vprog and Iprog control cables (option #1).
• Replace grounding cable with a grounding strip where the grounding wire used to be on ITE:EL. The ground wire was a braid, so probably not too bad, so not sure if this will help.
• Improve the connection between the two grounding bars in the racks. The grounding bar for th EL supply is well connected to the copper ground strip from ITE, but only connected through a small cable to the grounding bar for the quads. A copper foil sheet was added between them and the previously used wire was disconnected on the quad side bar..

TM4 has been moved from SHC to TCS. The move is successfully.

Today (2024-07-05), five flasks were loaded in preparation for shipment with the following targets: SiC#43 (Pail 272), SiC#44 (Pail 275), Ta#63 (Pail 266), UC#40 (Pail 278), UC#38 (Pail 274).

The crimped lifting loop has been applied to each pail. The locks have not yet been applied to the flasks at the time of writing this log, but will be done next week.

The mini-storage vault is now EMPTY. Because some of the pails had contamination (200 - 1500 CPM), it is highly recommended that the mini-storage vault be cleaned or at least swiped for contamination.

The target index spreadsheet has been updated (attached).

TM4 and TiC#7 target electrical check and HS leak check at SHC after target installation have been done.  all results are good. I will attach the checklist when printer is back to work.

TM4 HS line was helium pressure tested at TCS this morning. No leak. Also i leak checked TM4 top all air to  vacuum seals at TCS. Everything is good.

TiC #7 is a febiad target.TM4 top has been configured for febiad target. checked pin 2-2 to bias, target ,and chassis at 250V. they are all OL.  

electrical check  on TM4 UCx#45 target at SHC after operation is done.   see attachment.

TM4 with spent target UCx#45 was disconnected in ITW and moved to SHC.

 TM4 move from ITW to SHC is smooth.

Initial Summary:

TM3 sparking behaviour in ITE has been very disruptive both with and without protons. Protons are at 60uA, target heater at 540A. Max voltage achieved so far is 51kV, limited by time and a current limit on the BIAS supply.

The ITE:EL trips off every couple of minutes. Just needs to be restarted. Mike investigated and found that the trip is happening inside the power supply, then a moment later the canbus is defining the supply off when it cant get it to respond. Trip frequency decreased over time but still disruptive.

All the waterflow signals, including ones controlled in the cyclotron system, were tripping off regularly. These have all been forced, then we implemented a 5s delay in the ISAC waterflow interlocks. This seems to have solved the issue.

The ITE:BIAS supply has also been limited at 500uA instead of 5mA. Probably something hardcoded into the canbus - this was fixed by Keiko and the hardcode limit was set to 20%(?) of 5mA.

TM3 has been very sparky, even at low voltages. I can't understand why. A new ground path would be explicable but the excessive sparking is difficult to understand.

Possible avenues:

1. make sure the module outer surface is connected through a copper sheet to the sheet on the wall.
2. check that special ground still grounds all the gnd power supplies in the electrical room - this I checked but some of the grounds are connected through wires instead of sheets, this can be improved.
3. try running the module with only HV hooked up and nothing else.
4. try running TM3 in ITW.
5. Search work permits and shutdown jobs for any changes made to the system that could affect this.
6. hope there is a software solution for the EL problem, or start moving towards PLC control - no software solution because the canbus card is only reacting to the power supply refusing to turn on, so it seems the issue originates in the PSU. Moving to PLC is possible but may not help and increases the risk of frying the PLC module.
7. Add a spark gap or limiting resistor to the EL somewhere. Resistor only helpful if the EL itself is sparking. Difficult to find a spot for the spark gap.
8. Get a bipolar supply that can sink the current of a spark and replace the EL supply. - Tomislav doesn't seem to think this is viable.
9. Add protection on the controls cables.

Spark recording:

60uA/50kV/540A July 3 02:30 - 05:30 : average of 50 sparks per hour. data file https://isacwserv.triumf.ca/onlylocal/isacdata/ITE_TM3_SiC46_HVConditioning_2_20240704

60uA/32kV/540A July 3 19:15 - July 3 21:45 : average of 8.4 sparks per hour. data file https://isacwserv.triumf.ca/onlylocal/isacdata/ITE_TM3_SiC46_HPSIS_HVConditioning_20240704

50uA/42.8kV/540A July 4 8pm - July 5 2pm : average of 20 sparks per hour, or if you cut out the last two hour that were very sparky, 14 sparks per hour. data file http://isacwserv.triumf.ca/onlylocal/isacdata/TM3commissioning_July4_52024.dat

50uA/42.8kV/540A July 8 00:00 - July 8 18:00 : average of 3.4 sparks per hour. data file http://isacwserv.triumf.ca/onlylocal/isacdata/TM3commissioning_July82024.dat

50uA/42.8kV/540A July 10 10am - 3pm : 3.6 sparks per hour

50uA/53kV/540A July 17 5am - 10am : 4 sparks per hour

45uA/53kV/540A July 20 8pm - July 21 6:30am : 24 sparks in 11 hrs, avg 2.2 sparks per hour.

EL trip recording (first 2 entries from the archiver, verify with ops elog):

50uA.42.8kV/540A July 4 23:00 - July 5 16:00 : 9 trips, average 0.5 trips per hour

50uA/42.8kV/540A July 6 12:00 - July 7 03:00 : 6 trips with 2.5hrs off, average 0.5 trips per hour

50uA/42.8kV/540A July 7 05:00 - July 8 18:00 : no trips in past 30hrs. Last trip July 7 at 3am.

50uA/42.8kV/540A July 10 3pm - still no EL trips

50uA/53kV/540A July 16 8pm - July 17 10am : 3 trips in 6 hrs. Note cable in EL circuit got burned so EL is running at only ~4kV

45uA/53kV/540A July 17 3pm - July 18 9:30am : 7 trips in 18hrs

45uA/53kV/540A July20 14:00 - July 21 6:30 : 5 trips in ~17hrs

2024-11-15 EDIT, Alexander Shkuratoff:

I was not involved in this run, but I have gone through all the Elogs for TM3 up to this point and summarized all the data dumps at the bottom, so I may as well do it here.

	ITE_TM3_SiC46_HPSIS_HVConditioning_20240704	2024-07-04 01:42	4.8M
	ITE_TM3_SiC46_HVConditioning_Vac_20240704	2024-07-04 01:59	5.3M
	ITE_TM3_SiC46_HVConditioning_2_20240704	2024-07-04 05:31	1.1M
	TM3commissioning_July32024.dat	2024-07-04 17:04	11M
	TM3commissioning_July4_52024.dat	2024-07-05 14:18	12M
	TM3commissioning_July82024.dat	2024-07-08 18:03	13M

 Additionally, there is no Elog entry for August 18, 2024 for which TM3 commissioning continued in ITW, but I have found the following StripTool data:

	TM3commissioning_Aug182024.dat	2024-08-18 05:37	14M
	TM3commissioning_Aug182024_2.dat	2024-08-19 06:16	14M

Tm2 has been moved from TCS to SW silo. the move is smooth.

 5 shielding blocks have been moved from ITW to ITE, MAA area has been secured.

Nb#10target has been remotely  transferred from NHC to SHC. 

Tm2 has been successfully moved from SW silo to TCS.

 TM3 with new target SiC#46 was connected in ITE.

Tm3 has been moved from TCS to ITE. the move is smooth.

Tm3 has been moved from TCS to ITE. the move is smooth.

TM3 and UCx#44 ran in ITE but issues with the cyclotron prevented proton beam delivery. Nonetheless, the target was heated and provided stable beam to TITAN as well as for tuning and some tests.

Results of inspection of TM3 module after run:

The module looked pretty good. There were no marks on the polished surface of the containment box, next to the water blocks, that were visible. But we didn't remove the box, only looked with the camera and it was visible by turning the module. So some things may have been hidden. There were some black marks on the door, near the bolts that hold in the handle (see attachment). This seems a very unlikely spot for sparking as the fields should be considerably lower than at the target handles, lower down. Maybe the spots are from oil left on the door that had a chemical reaction? There is one very faint matching spot on the top of the copper trident connector, but it doesn't look much like a spark mark. The other two marks have no corresponding mark on the source tray. There were no marks on the ground electrode, or anywhere else on the source tray. There was a scuff on one of the trapezoidal insulators, but it could have happened during installation.

Results of inspection of the target after run:

The FEBIAD target developed the same cathode short we have seen on almost every FEBIAD we run online - a high resistance short from cathode to HVC that prevents voltage on the cathode. This time the short remained after cooling the target, and David measured 208kOhms with the ohmmeter on the module top (11kOhms with the megger). We used a multimeter in the hot cell to test after the target had been dismounted and we found no short. So it must be related to either the position of the target (upright vs face down) or time (a conductive trace on an insulator oxidizes and becomes non-conductive again) or some pressure/shaking during the de-installation.

There weren't many marks on the target - a faint mark near where the faint mark on the copper trident was observed, some marks on the EE which had no counterparts on the ground electrode. See pictures.

Tm3 electrical check with SiC#46 target  and HS line helium spray check at SHC. were done. everything is good. see attachment.

TM3 has been moved  from SHC to TCS.The move is smooth.

 5 gallon spent target pail, lifting long pole and hook assembly load test was done by Rupan, Keyur ,and David.  Load in pail 101 lbs, test time 10 minutes. No deform on pail( pail OD 29.8mm is not changed before and after test.  The test passed. Also 50 lbs load test on empty tray transit frame was done. The frame is good on test.  Rupan will have a test report on this job.

The pail handling tool which is used to move 5 gallon pails around the target hall was inspected by A. Newsome. The main tool was checked, but not the spare as it is currently in a disassembled and unusable state. The tool appears to be in good, working condition. The following items were checked.

• Inspect structural integrity of long tube - check for bending, warpage, dents, cracks, rust/corrosion
• Inspect structural integrity of hook assembly - check for bending, warpage, dents, cracks, rust/corrosion
• Inspect fasteners - check all fasteners installed as per drawings, fasteners are tight (note: one fastener on crane interface subassembly was loose - all fasteners in these subassembly were tightened as a precautionary measure)
• Inspect crane interface assembly - check for damage and wear where the tool connects to the crane
• Check alignment - verify the tool connects to the crane and hangs vertically with no major misalignment (this step was not done - alignment is regularly checked during operations, and there was no concern as the tube was straight)

 Note: these tools are being inspected monthly by D. Wang and F. Song.

Photos can be found in G:\remote handling\Facilities and Projects\ISAC\Pail Handling Tool\Inspections\June 2024

IMPORTANT: the maximum load capacity and lifter tag for the tool are not present. There is a plan in place to affix these two labels in the very near future.

The annual inspection of the main storage vault will be skipped this year since extensive inspection and testing was performed during the re-alignment job in May (see this e-log for details: e-log 2584). This included successful testing of the emergency close mechanism.

The mini storage vault was informally inspected by Adam Newsome on 2024-06-18. The following was checked:

• Cabling and cable management
• Connectors (note: the strain relief for the remote control input cable was loose - it was tightened)
• Controls box - external connectors and wiring
• Limit switches - wiring, mounting
• Motor visual check
• Drive wheels visual check
• Drive track visual check (note: the track had small pieces of metal shavings on it which were wiped off)
• Bearings visual check
• Miscellaneous fasteners visual check

Photos can be found in G:\remote handling\Facilities and Projects\ISAC\Mini Storage Vault\Inspections

The inspection was generally successful. No areas of concern. Regular inspection will resume next year.

Tm3 electrical check without target is done. Everything is good including 2 x 5 pin connectors( all OL at 250 V to 60 KV and each other)  see attachment.

A new gas system for FEBIAD operation was installed in ITE to enable us to use a calibrated leak which is attached to the target heat shield. This will allow us to control the quantity and purity of the gas going into the system, and to switch quickly between gasese and pressures.

The schematic of the system is attached. The use of the ballast container is likely not needed - it was originally included in case we want to run the system at pressures greater than 1 ATM. The roughing pump inlet limit is 1ATM, so it was envisaged to used the ballast container to reduce the pressure to that level or below before opening the system to the pump. But since it has been difficult to commission the system over 1ATM and this opens the door to several concerns about gas leakage, it was deemed better to keep operation below 1 ATM. This tank will likely be removed.

The storage tank was implemented because we are not sure if irradiated gases will be pulled out of the target lines when we pump on them, and so this was devised as a way to test that. The alternative is to have the exhaust of this pump go directly into nuclear ventilation by way of a plastic tube leaving the faraday cage, however this solution is also quite some work to implement. So the consensus was to start with the storage tank and sample it several times to understand what sorts of radioactivity we are dealing with, then make a decision about future operations.

This system has been tested offline using the development target UCx#44 and appears to work well. Unfortunately there were no protons available for this beam time so the gas sampling part of the system was not tested.

The operation of the rest of the system worked reasonably well. Beam disappeared when pumping out the lines and reappeared when re-opening the gas bottle. It seems that the storage container can be used to pump out the lines about 7 times before it gets up to around atmosphere, as was estimated based on volume. The pump can get the lines down to about 250mTorr as read by the pressure gauge DG2 on the module top, given about 30mins of pumping.

We did have some issue with the gauges, HV sparks destroyed both controllers and so we were unable to monitor pressures as we would have liked. It is possible one gauge itself is broken as well, to be investigated.

It may be that the gas leak we used was too small, but the idea of changing the pressure on the module by changing the needle valve didn't seem to work. This is not sure since we didn't have a reading on the pressure, but watching the ion beam as you turn the gas back on seemed quite binary. You would see no change until you had the needle valve fully open. This may be different with a larger leak, since this leak required about 1ATM in the lines to see anything. It is still not clear why this behaviour was different than the tests at the test stand, in which 0.5ATM of upstream pressure produced about 2nA of beam.

This system is considered a prototype and is not turned over to ops for operation. Further commissioning is required.

IG1S elbow o ring seal and a blank off cap o-ring seal beside the elbow were replaced on ITE entrance module top last Friday. IG1s has a higher than normal reading so i leak checked entrance module top last Thursday and found leaks to 5x E-8 atm.cc/sec leak on one of (or both of )these two o-rings seals. they are too close to identify exactly on which one was leaking so both o rings were replaced.  other air to vacuum seal on entrance module are leak free. 

ITW has been behaving badly at higher voltages recently, even without protons on. I conditioned it up to 50kV with heaters off in the TCS and it was fine. But when I tried to do the same with heaters on in the station, it was quite sparky and it kept tripping the TGHT/TBHT. I went to 49kV where it was unstable, then lowered to 48kV where it looked fine for 30mins. But even operating at 40kV, it tripped the heaters several times. The TBHT voltage came back lower than before on the last trip, so I am getting worried about it.

I decided to make sure all the electronic spark protection was ok in the faraday cage. There is a resistor/gmov combination across the terminals of each TGHT/TBHT in which Tomislav replaced the gmovs for me because his tester did not work at those low voltages, so we couldnt see if they were broken. The electronics diagram called for 18V gmovs, the replacements are 22V because that's all we have.

We also tested and re-installed the capacitor-gdt-resistor combinations that John installed last year from TGHT/TBHT bubars to HV common. I originally removed them because we couldn't bias a FEBIAD with them on - this still has to be investigated. The measured values are 0.148uF, 90kOhms and a breakdown voltage on the gdt of 410-450V.

Hopefully this prevents sparking the power supplies off.

Sunday, June 16, 2024, 07:03 : power supplies have not tripped off since electronics repair. See data/TM4sparkingbehaviour_June152024.dat for sparking frequency over ~10hrs of protons (5-14uA). >14 sparks during this time (14 captured by PLC when voltage dropped, many more current peaks).

Tm3 has been moved form ITE to SHC. the move is smooth.

TM3 UCx#44 after operation electrical check at SHC . see attachment.

Carla: Looks like the short on the cathode observed while trying to operate the FEBIAD in cathode-bias mode is still there. Will do investigations in the hot cell during disassembly.

 TM3 with target UCx#44 was disconnected in ITE. 

  couple of E-8 to low E-7 atm.cc/sec leak were found on TM2 service cap top air to vacuum  o rings.  Replaced these leak o ring seals including o ring on IG1 and steerer service panel,o rings on MSP, EE, D blue nylon and copper feed through, and o ring on a round blank off beside MSP terminal on second row. 

2024-july-03 update: TM2 was leak checked again at TCS. no air to vacuum leak on module top. i helium pressure tested(60psi) all water cooling lines (except HS) . They are leak free.

TM2 is moved from TCS to silo this morning. The move is smooth.

 5 shielding blocks have been transferred from ITE to ITW. 

Doc # 181007

TCS water system  five filters were changed yesterday by plant group Dan.T. Service labels on filters are updated.  No water leak after job.

refilled TCS:TK2 to 27.4 inches to compensate water lost during THC filters change.

On May 30 Aaron, Chad and I removed the empty LP FEBIAD target from the SHC into the anteroom to attempt to find out the source of the cathode short observed online. The behaviour online was that a connection of several hundred ohms was preventing the cathode from being biased. The resistance was still enough to allow us to run in anode mode, which is what we did. I am not sure where the cathode short came from but there was significant sparking on this module when ops conditioned it (destroyed the gmov of the COIL power supply and the electronics for anode/cathode switching) and we have seen this cause cathode shorts before. The shorted behaviour did not go away when the target was cooled down, so I assume it was permanent damage to one of the insulators. This would be either the support insulator, the trident insulator, the gas line insulator or one of the tube retainer insulators.

Since the target didn't see protons, we decided to take it out of the hot cell and disassemble it to find which insulator was broken. Unfortunately, it appeared totally fine outside of the hot cell, no shorts could be found. We disassembled it anyway to look for issues but all we saw was a heat mark on the copper plates covering the coil, underneat the target (see attachment). We even shook the target quite a bit, and didn't produce a short.

Maybe there was a trace created on one insulator by the sparking, which oxidized when exposed to air and became insulating again? We didn't see anything obvious on the insulators, but I'm not sure if we would expect to.

No conclusions from this work.

TM2 was moved from silo to TCS yesterday morning. The move is smooth.    TCS vacuum system was started after. TCS and TM2 pumping down is ok so far.

 TM4 with new target UCx#45 was connected in ITW this morning. pls see attachment uploaded with.

Tm4 has been moved from TCS to ITW.  the move is smooth.

TCS was argon vented this morning between 6:00 and 7:30am for TM4 moving to ITW.

On Wednesday, May 22, 2024 UCx#45 was installed on TM4 in the SHC. Installation was normal other then minor issue with the multipin connector drive screw not engaging and/or driving properly. This was remedied by loosening the left guide bolt slightly (1/2 turn). After loosening the multipin drove in and seated correctly (verified by camera). High current fasteners torqued to 130 in lbs.

MCR Travis Curucz and I finished BL2A MAA ASU test per document 154779. everything works fine. Travis kept  the test document.

 the five shielding blocks have been moved from storage area to ITE and is ready for beam delivery.

submitted WP# I2024-05-22--1

actived  WP # I2024-05-23-4

electrical check and leak check were done on TM4 UCx#45 target at SHC.  everything is ok. See attachment

helium pressure test on TM4 HS line at TCS is done.   No leak.

TM4 has been moved from SHC to TCS. the move is smooth.

Tm4 has been moved from ITW to SHC. the move is smooth.

Tm4 has been disconnected in ITW per document 141576. Checklist is done.  HS line is purged.

 Targets UC#38,40 Ta#62,63 SiC#44 have been moved from the spent target vault to the mini vault in preparation for F-308 loading. See attached PDFs for details.

Tuesday, May 14, 2024, 10:26 :

Ramping up bias/EE/EL on ITE - will see if the HV cage in the pit can hold 60kV or not.

At around 50kV the bias read current starts to get jumpy. Doesn't look like its an issue for the voltage, but definitely instability increases.

Occasional sparks seem to increase the EL current significantly...

David heard some sparks in the target hall. Looks like from heat shield feed through to the top of the cage. Several sparks heard in the TH also changed the einzel lens draw current significantly. These feethroughs are not far from each other so could be related.

Apparently the sparking also tripped off all the optics and heaters in ITW, by changing the state of the water flow interlock. Interesting and not seen ever before. Will test again with the cage off, rather than risk tripping ITW again.

Tried ramping up the voltage on just the EE. Seems the limit is 7kV - at that level it gets sparky and unstable. Should be investigated (should hold 10kV) but not critical for module function.

Wednesday, May 15, 2024, 10:05 :

HV cover was removed this morning and the MAA was locked out.

Started ramping things up, was very easy until around 58kV. At 59.5kV a spark tripped off the EL. Canbus controller had to be power cycled to fix it. Bias current is much more stable in this configuration.

Ramped up again while listening from the TH to see if it was sparking outside. Went slowly to 60kV (left EL at 29kV) and didn't see any outside sparks in the first 10 mins, couple sparks in vacuum. But after 15 mins a spark seems to have fried the EL canbus card. We were not in the TH so not sure if it was on the outside or not.

After 2 hours a spark tripped off both ITE and ITW. Looks like it makes a water interlock go bad momentarily, but after the trip the interlocks seem fine.

Tuesday, May 28, 2024, 16:41

Running TM3 at any voltage in ITE produces fairly destructive sparks. There are not many but so far they have tripped off all optics in ITW, the water flow interlocks (later forced on to prevent this), the EL (generally comes back but killed the canbus card once), destroyed two vacuum gauge controllers, and may have contributed to the cathode short on ITE-TM3-UC44-LP-FEBIAD.

The conditioning process seems to go as planned, but the occassional inevitable spark still trips things, which is making it difficult to run stable.

Will continue with regular HV conditioning to see if this helps. Control over the current limit on the ITE:BIAS supply would also help, but seems a complicated thing to add according to Roberto.

TM3 sat fine at 53kV overnight and at 58kV for several hours. The EZL trips off maybe once every 2-3hrs or so, which is not ideal but liveable. This was with the TGHT and CHT power supplies forced, so not sure if we would know if they would have tripped...

CONCLUSIONS:

1. TM3 has been commissioned for beam delivery after one week of delivery of UF to TITAN using a FEBIAD ion source in anode bias mode. Cathode mode was also used, so all functionality of the target except IGLIS current/voltage delivery through the mutlipin has been tested successfully.
2. TM3 still requires commissioning at high voltage with protons to be considered fully commissioned, this will be done July 2 2024 due to problems with the cyclotron.

ITE water signal annual interlock check is done. Ed helped me on this check. Everything works normal.

Tm3 has been connected in ITE.  see attachment.

 F308 Inspection and service complete on #06, #08, #13, #15, #16, #19, #20, #21, #22.

All in good condition with new gasket material installed on #20.

Prepped for move to ISAC B3 for storage.

The ITW Faraday Cage has been cleaned, this is part of Winter Shut Down job happens in ISAC-1 Electric maintenance room annually.

The move is smooth and successful.

TCS was argon vented this morning between 7:00 to 8:30 am before module was moved to ITE.

ISAC Storage Vault Door Re-alignment (April-May 2024) 

Issue

• Rollers gouging and marking on roller supports, testing shows door shifts at least 185 thou on structural beam when fully open vs. fully closed
• door misaligned: 1/4" laterally, slight rotation (~1/16" difference across closed door gap).

Repair

• Moved left structural beam (facing front of door) inward 1/4" at post.
• Loosened drive system to shift door over via crane to average laterally (1/8" shift) towards center,
• Attempted to fix door rotation with crane, door would not settle down perfectly flush, but got slight improvement 
• Adjusted limit switches for fully open and closed (due to the adjustments made previously, needed to realign limit switches) - adjusted flag for final close back by ~1/4"; adjusted limit switch at back of vault forward ~1/4" 

Verification 

• Unloaded vault door actuation tested multiple times with no issues, door returned to same position every cycle, no interferences during travel
• Vault Door actuation tested with trays 4 and 6 engaged, no issues
• All pails accessible when open
• Tested open and closed limit switches: the open limit switches are working properly; the closing soft and hard limit switches are slightly close together, causing the door to just "bump" the vault when closing, The scale of this is OK for current operation, will be adjusted when the ISAC Target Hall Controls Overhaul is done
• Tested and reset Emergency override mechanism - works properly

Outstanding Tasks

• Will paint marks on structural supports to track if problem reoccurs - update ELog when complete 

System State: Operational

See attached file for details

Broken TM2:TP2 has been replaced otday by a new TV-1001 nav pump supplied by vacuum group. replaced pump seris number:201281. new pump series number:IT23431008. TPs replacement history sheet will be updated by Frank. I will put comment on this e fault and let operator to close it.

 The Ta#66 target was repacked after the parasitic target was removed it was place in a new pail (#290) and place back in spot 5B of the vault. See attached PDF for further details.

ITW gas lines pumped down to 2e-3Torr on leak detector with leak rate in the low e-7 atm-cc/s. Gas bottles opened at 3psi and labels in epics changed to reflect correct setup. switch box set to cathode mode, checked that anode wire was at HV common.

note ballast is removed from ITW now to be used in ITE so that line is blanked off.

After new containment box installation on TM3, Chad and I did a helium spray leak check on two VCR fittings on front side water lines. they are leak free.

Helium pressurize window water line to 70 psi for 3minutes. No response on leak detector which is 0.0xe-9 atm.cc/sec.

TM3 with UCx#44 electrical check and leak check are good. see attachment.

HS line 70 psi helium pressure test at TCS: no leak at 0.0xe-9 torr.

TM3 has been moved  from SHC to TCS by David and Frank. The move is smooth.

Annual ITW water signal interlock check has been done. Renee helped me on it. Everything works fine.

Travis and I moved TM3 from TCS to SHC this afternoon. The move is smooth.

TM4 has been connected to ITW. see attachment.

A new SST gas line with swagelock tube fittings and VCR fit is using for ITW febiad gas staion in pit. Gas line is leak checked on bench. No leak . it is installed on TM4 in ITW now,

 David Wang made E/L checking before module moving to ITW. read attachment pls.

TM4 has been moved from SHC to ITW. Peter did the move. Travis helped on him.   The move is successful.

Saturday, April 27, 2024, 09:35 :

Started ramping up HV, EE and EL together. First small spark at 20.5kV on bias, no reaction in other devices.

Note both BIAS and EL are off in their readbacks. See table below

Saturday, April 27, 2024, 10:23 :

Spark on HV only at 25.5, couple sparks from here to 33, then at 33 starts real conditioning.

EL is reacting to some of the sparks, not sure if this is just electrical noise or not.

Saturday, April 27, 2024, 18:14 :

lots of trips above 60kV on the set pt. tripping off turbos and gauges. IG2 needed the controller reset.

RESULT: Got to 64.5 (actual) 62 (set point) with quite a bit of sparking over 60kV. Will go the rest of the way to 73 in the next days. Data dumped as isac/data/TM3_HVtests_Apr272024.dat

Sunday, April 28, 2024, 11:23 :

Ramped back up to 60kV reasonably easily, couple sparks and turbo trips.

Went up to 64kV (set point) with a lot of difficulty. Data dumped as isac/data/TM3_HVtests_Apr282024.dat

Monday, April 29, 2024, 14:58 :

Ramped up to set pt 62 easily, went down to 500V then 100V steps after that.

Went to set pt of 67 and left it there for ~40mins. Not perfectly stable but not too bad.

Tuesday, April 30, 2024, 17:12 :

After rebooting the TCS PLC to fix all the non-responsive devices, everything is working fine again.

Ramped easily to 60kV in 1kV steps.

Still got to 67 without too much trouble. Behaving pretty well...

At 70.2 (set pt, 71.3 readback) the water and vacuum gauge both tripped off and cannot be restarted. I am not sure what the real power supply reading is here but in the past it has been 70.5 set pt = 73 real value, which is as high as the power supply goes.

Stopping here since I'm not sure the water is circulating... the off pump says it is and the on pump says its not... left it at 70.2 for 40mins, still sparking going on (20:28 to 21:10)

Data dumped as isac/data/TM3_HVtests_Apr302024.dat

Sunday, May 05, 2024, 10:50 :

Containment box and target installed.

HV conditioning starting at 47kV.

Spark at 58kV knocked out IG1. Continuing with IG2 and IG1S.

Went up to set point of 63, readback 64. Will continue on Monday.

Data dumped: isac/data/TM3_HVtests_May52024.dat

Monday, May 06, 2024, 09:37 :

Ramping system back up.

First sparks at 50kv while raising the EL voltage (not sure if they are related).

AS: Voltage quickly up to 63 kV from 49 kV. Very smooth, no sparks or instabilities. Ramped at around 250 V steps every 10-20 seconds. First signs of instability at ~62.75 kV and definitely at 63 kV. I guess this is where it was conditioned to last. Let sit at 63 kV for a while while doing something else. It sparked once and turned off a turbo after half an hour. Starting ramping again.

AS: Spark at 65.75 kV killed IG1. Carla manually reset at 69 kV. Still working. A spark at 70.25 kV took out IG1 again.

AS: Maximum voltage reached at about 16:45. Setpoint 70.5 kV, readback 71.7 kV, PS itself ~73 kV. Carla reset IG1.

AS: 18:30, spent about 1.5 hours cumulatively at this maximum voltage. During this time it sparked about 15 times. Not long enough to tell if the spark frequency is decreasing. In the middle of this, Carla did something accidentally and caused the voltage to drop a bunch, so I manually set it to 0 V. She then reset TP1S, which was not staying on. Also, the EE and EL stayed at their respective voltages during this downtime (2 kV and 28.7 kV). I ramped the main BIAS voltage back up to the maximum voltage within 5 minutes and it was smooth all the way but sparked again at the maximum voltage. It seems conditioned up to or near the max voltage. Ramped down and turned off BIAS, EL, and EE.

AS: Dumped data to isac/data/TM3_HVtests_May62024_Alexander.dat

Tuesday, May 07, 2024, 10:02 :

Tested the EE - ramped up easily to 7kV, but then had issues maintaining the voltage. No vacuum response. Ramped down since we never use it that high anyway, though cable should be good for 10kV. More investigations later.

EDIT 2024-11-25, Alexander Shkuratoff:

Summary of StripTool data taken during this round of tests:

	TM3_HVtests_Apr272024.dat	2024-04-27 18:56	12M
	TM3_HVtests_Apr282024.dat	2024-04-28 13:16	1.4M
	TM3_HVtests_Apr302024.dat	2024-04-30 21:11	9.0M
	TM3_HVtests_May52024.dat	2024-05-05 13:06	5.0M
	TM3_HVtests_May62024_Alexander.dat	2024-05-06 18:45	9.5M

TM4 has been moved from SMP to SHC. Adam and I did the move. the move is smooth.

TM3 helium pressure test and electrical check with new source tray at TCS were done yesterday. The results are excellent. See attachment

TM3 module top helium spray leak test was done yesterday.  No leak on TM3 module top @ LD base leak rate 0.0 x E-9 atm.cc/sec.

TM3 has been moved  from SHC to TCS. The move is smooth.

Wires were pulled in TM3 and service cap was closed up again:

Einzel lens wire (30kV kapton), routed in the pumping duct and attached with #10 ring tongue to EZL feedthrough in service cap

4 steerer wires, routed in th pumping duct and attached with push on connectors to the 4 SHV feedthroughs on the module side panel. Coax grounding sheath is cut back by about 3cm.

Multipin cable bundle #1, routed through the left cable tube in the service tray then along the heat shield water lines (with PEEK zip ties) to feedthrough A.

Multipin cable bundle #2, routed through the right cable tube in the service tray then along the heat shield water lines (with PEEK zip ties) to feedthrough B. This bundle contains the EE wire as well, which was branched out after exiting the service tray and routed along the gas lines to the EE feedthough. It was attached with a smaller (size?) ring tongue to the EE feedthrough. Do not use this wire again, very fragile. Use the Accuglass 30kV wire instead.

The multipin wires touch the back of the water blocks in the source tray (same as in MT2/4, so far no issues with that) and they also touch the COIL lines in the service cap.

The EZL and steerer wires are routed along the floor of the service cap.

Due to the difficulty of the installation, there is no metal braid over the multipin bundles in the service cap.

Photos here : https://triumfoffice365-my.sharepoint.com/:f:/g/personal/cbabcock_triumf_ca/EslWNUST-UJKh1s8jjxWG6EBpLQEnWxgV4v-NvR4ZJjlOQ?e=Mw5vvI

TM3 water lines helium spray leak check at SHC is done. No leak has been found on all lines. seeattachment

ITH:MP1S pump inside lubricant was changed today. old lubricant is dirty with dark color. they are stored in sealed waste oil jug and stored in silo area. Pump has been installed back and started. It works fine.

Monday and Tuesday, I started TCS water system and enabled the TCS chillers auto stage in/out. I saw chiller 2 in/out three times at 17C and 21.8C without issue.   TCS water system works fine. The test is finished.

TM3 new source tray was transferred into SHC on this Tuesday. one hook arm of transfer jig is very close to optic tray tube when engaging the jig on transfer frame. tube side hook arm should go east side a little bit further to avoid the tube.  Also the HS tube top lines to  transfer frame beam bottom distance needs to be watched closely when hooking on the frame.Help from HC window is necessary. By watching on this details, Source tray are successfully moved into SHC with crane controlled locally in TH.Transfer frame was retrieved back to TH. It was cleaned, bagged and stored in TH.

Tm3 was moved from silo to SHC yesterday. the move is smooth.

water are supplied to both ITE and ITW. I did a general inspection on HALCW system. Two small leaks on 2" shut off valves are fixed. No other leak has been found so far. all water flow meters work fine. MP2 pump discharging pressure is ok which is just above 100 psi on local gauge reading. pump noise are low. pump body temperature is less than 45C which is good. 

both high active pumps ITC:MP1 and MP2 are refurbished by RH group Maico and Peter. Pumps have been installed back to system with new inlet/outlet flange gaskets. high active water surging tank is refilled with water and pumps were primed. I asked operator to switch on pumps separately. Both pumps work fine. They are quiet and pumps discharging pressure is a little bit better comparing to before refurbishment. Nitrogen gas is injecting into system. O2 level is decreasing and R is going up.

2024-04-09: Joel.S checked pumps phase current draw: MP1 16.8 to 17.1A on each phase. MP2 17.0 to 17.2 A on each phase. They are normal. Pump body temperature are below 45C which is fine. 

On April 2, 2024 the wrist on the SE manipulator of the SHC (Serial # 7986) was swapped with a rebuild unit originally from SW position (serial # 8106). The "new" wrist was a wrist + tong assembled unit with the tong cable being routed if-front of the spacer A-14118 rather then behind as in all previous replacements (see attached pictures). This change was a result of a discussion with Central Research's senior repair technician who informed us that the original routing was incorrect from the factory. This can be seen when inspecting unit we have on-site that are still in the original configuration from the factory as about half are routed one way and half the other.

Tm3 has been moved  from SHC to silo. The move is smooth.

ITE entrance module top and module flange o-ing to tank have been leak checked. no leak at 0.0xe-9 atm.cc/sec. things are double checked.

Tm3 has been moved to SHC from silo. the move is smooth.

ITE entrance module has been reconnected in ITE pit per document 190510.

ITE entrance module has been moved from TCS to ITE. The move is smooth.

 Thursday, March 21, 2024, 11:33 Three channels are available now for thermocouple readouts from the Target multipin. Wiring from the PLC modules to the connection terminal blocks and labeling done.

TM3 was moved from SHC to NE silo. Cable tray was recently installed.

ITE entrance module has been moved from ITE pit to TCS. The move is smooth.ITE entrance module top tank flange and o ring slot are cleaned, and old o ring are replaced.

Alignment notes attached for the optics tray for the refurbished tm3 with the new service and source tray.

*Note: Drive screw bracket sheared off during alignment check with source tray. The drive bracket was replaced. The optics tray was re checked. The front element was .015 to left and centered u/d. The rear element remained the same. The center element could not be checked to do the assembly.

ITE entrance module has been disconnected per document 190510. Its a preparation job for next month module moving out to SHC.

100 liters of high active water from HALCW system( mostly from s-tank and pipe lines closing to pumps) are transferred to holding tank in 2A tunnel. Transfer is smooth.  it is a preparation job for ITC:MP1/MP2 refurbishment.  water sample is passed to RPG for assay.

Today (2024-02-16), three flasks were loaded in preparation for shipment with the following targets: UCx#39, UCx#41 and C#3.

Note: prior to shipping, the pails within these flasks will need to have a crimped lifting loop added to them.

The mini-storage vault is now EMPTY.

The target index spreadsheet has been updated.

ITE was set up for HV tests - this time the module plug was not in so the BIAS and EE had to be bypassed. NOTE: ITE:BIASPLC must also be bypassed for this to work. Currently it is located on the vacuum bypasses page, but may be changed to the optics page soon.

ITE was ramped to 60kV in steps of 1kV easily. It sat at 60 for about 1.5 hours with a current draw around 173uA. It was not entirely stable though, and appears to have sparked many times. None of them seemed very large, but hard to tell.

When ramping down, current dropped quickly with the first couple steps. Data saved as isac/data/ITE_HVtesting_shutdown2024

 ITW entrance module and exit 1 module leak check on module service cap/top air to vacuum seals and module to tank flange  o-rings have been done. all seals and o rings are leak free to 0.0 xE-9atm.cc/sec except one leak ( to low E-6 atm.cc/sec) on ITW RV4 KF50 o-ring was found. It caused by a cross o ring surface scratch on KF 50 flange. the scratch was sanded and polished out. on second time leak check, it is leak free.

In preparation for F-308 loading, three pails were moved from the main storage vault to the mini storage vault. The following pails were moved:

• Pail 270 (C#3)
• Pail 276 (UC#39)
• Pail 231 (UC#41)

Target Index spreadsheet updated, attached.

Spent target UCx#43 (pail 289) was moved from the South Hot Cell to the Storage Vault, placed in location 2A. Dose rate at 1m was approximately 22.6 mSv/hr.

Target index spreadsheet updated, attached.

ITW was set up for HV testing - water is running and at a high resistivity due to injected N. Einzel lens is attached to ground. Everything else is as normal. The module plug is in so no vacuum bypasses were needed. Very easy to ramp to 60kV. Sat at 60 for about 1.5hrs with maybe 1 spark (hard to say from the strip tool data). Current draw was about 176uA. Data dumped as isac/data/ITW_HVtesting_shutdown2024

Today (2024-02-09), five flasks were loaded in preparation for shipment with the following targets: SiC#41, SiC#42, Nb#9, UC#36, Ta#58.

Note: prior to shipping, the pails within these flasks will need to have a crimped lifting loop added to them.

The mini-storage vault is now EMPTY.

The target index spreadsheet has been updated.

ITW exit 1 module tank flange o ring has been replaced. the old o r-ing was completely flat in slot without elastic property.  tank flange, module flange, and o ring slot were clean by acetone and canister vacuumed. Raised up module 3 feet and pulled new o-ring over module top so new o ring could be  installed without moving module out. after new o ring installation, craned down module to flange and raised up module 2 feet again to confirm the o ring is properly sit in slot.

ITW exit 1 module was disconnected  for Exit module flange o -ring replacement yesterday. After oring replacement, the module has been reconnected.

ITE primary and secondary vacuum vessel leak check has been done. SST bellow for 2A3M19  wire scanner on entrance module top has a big leak to E-5 atm.cc/sec on tiny helium spray. The bellow will be replaced in March by probe group. The LD base leak rate is affected by this big leak so i cant keep the LD scale at 0.0Xe-9 atm.cc/sec during the leak check. Other seal are leak free to 8XE-9 atm.cc/sec. I have no big concern on ITE vacuum seals status by the result.

UCx#43 PIE was done in the SHC. As expected based on electrical measurements, the target container was broken on the right side and came off easily. Despite all the black stuff seen on the containment box and source tray, the inside of the heat shield was very clean. Checked if the Re foil was curled in and didn't see anything. Looked fine other than the broken container.

TM4 coil1, 2 and HS are all OL at 250V at SMP after module move. This week, Chad and Carl fixed short issue on coil1, 2 and HS by insert dropped ultem ring back to position at SHC.

TM4 has been moved to SMP. The move is smooth. I started SMP vacuum pump. The TM4 and SMP vessel is under vacuum now.

Chad and I did window line VCRs leak check after containment box removal/installation.  The first  pair of  VCRs have leak. Chad changed VCRs. Both VCr fittings on window lines are completely leak free to 0.0 XE-9 atm.cc/sec now.

Tom Kauss inspected target hall crane below hook attachment pins and plates ITA6550-01 yesterday. He certified the use of these pins and plates for year 2024. The inspection of these pins and plates was in Target hall crane annual check list. It was issued as a calibration index by Isaac Earle in 2022-Feb-08.  After inspection, The inspection tag  was issued and attached to pin. Tom has an inspection record on this job.

Tom Gauss inspected  two target module lifting frames ITA0494-1997-01 and ITA0494-1997-02 yesterday. He certified the use of these two frames for 2024. Inspection tags have been issued and attached to frames. He has inspection record on them. 

Tom Kauss finished TH crane annual inspection yesterday. The crane woks fine. Tom has this inspection record in his file. The crane inspection tag has been issued for 2024.

TM4 has seen significant coating of the main standoff insulators and various other components stemming from failure in UCx#43 target. See attached pictures showing coating on containment box, support frame, main standoff insulators, standoff insulators high voltage shield etc. Note tracking marks on main standoff insulators.

Wednesday, January 24, 2024, 12:54 Carla's edit:

Meggered all HV components relative to HV common and HV common relative to ground. Nothing out of the ordinary, HV common to gnd was 700MOhms at 1kV. Seems whatever got onto the insulators is non-conductive, or is not as bad as it seems.

 TM4 with spent target UCx#43 was disconnected in ITE and is ready moved to SHC. see attachment pls.

Tm4 waterlines helium pressure test and TM service cap helium leak check was done last Friday. All water lines were pressurized with 70psi helium for 3 minutes each. The 3 minutes stable leak rate on all lines are less than 4.0 X E-9atm.cc/sec. some of lines had surging leak rate to 2xE-8 atm.cc/sec at the first 10 seconds of pressurization which should be a gas hammer result at the beginning. Based on the numbers, I would say all water lines are leak free still.  I did helium spray on TM4 service cap. There could be a small leak in high E-9 atm. cc/sec on ion gauge and steer service panel o-ring.  I will replace this o-ring when module is moved out of ITE. Other seals are leak free or less than 2.5X E-9 atm.cc/sec leak rate which are good. I am pretty confirm there is a small leak on ITE entrance module top. The leak rate and location will be confirmed when the rest of leak checks in ITE pit are done.

Entrance module has been connected in ITW pit per document 190510 " entrance module disconnection and removal procedure".

ITW entrance module has been moved from SHC to ITW. A slightly bump on module shielding block bottom side corner to tank vessel side when lowed module into tank. No big concern on this slight  bumping. Otherwise the move is perfect.

On Jan. 9 we did the PIE on Ta#66. Opened the heat shield and removed the EE. The inside of the heat shield was very black with lots of flakes falling off. The target itself looked overheated, and the container looked pretty bad for a Ta target. The outside of the EE looked perfect but after removing it there was a lot of black stuff on the side and we saw that the Re foil was curled up. Jens said during the runtime that he saw something that looked like a wire in the beam path, so maybe this was it.

Ta#66 post operation electrical check was done at SHC this Monday. See attachment.

ITW entrance module has been moved from ITW to SHC. The move is smooth.  I cleaned entrance module tank flange and o r-ing slot.  entrance module tank flange o ring  is replaced .

ITW entrance module has been disconnected per document190510. It will be moved to SHC for diagnostic group tomorrow.

After Tm3 service tray and service cap installation, TM3 service cap air to vacuum seals leak check has been done at TCS. TCS:IG1 and IG1S are at low E-7 torr range.  leak detector base  0.0XE-9 atm.cc/sec,  base pressure0.0X E-4 torr.  I sprayed helium to all new air to vacuum seals on service cap. No leak on seals. The leak check has been repeated  2 times with same result.   

 To deliver stable beam to RadMol, started heating UCx#43 up again. Target was overheated during initial conditioning in Nov but then ran well for 4 weeks. During the run time, the TGHT voltage jumped around and this was reflected in the ion current, but yields seemed unaffected.

When re-heating it, the TGHT voltage was very unstable and once it got to 440A, it went into voltage limiting mode. We ramped down and it was still voltage limiting, but turning things off solved it. We ramped back up and it did about the same thing. TBHT voltage and current remained steady. Looks like a heat generated issue.

Measured the resistance in the lines from the electrical room. Resistance of the lines to ITE should be 1.19mOhms for TGHT and 1.95mOhms for TBHT. TBHT positive to negative had a resistance of 7.9mOhms from the electrical room today, and 5.7mOhms on module top when measured Nov. 8. This seems to track.

TGHT positive to negative was measured at 27.6mOhms today (and was jumping around), whereas it was 7.14m Ohms on Nov. 8.

10V @ 440A is 22.7mOhms, so it makes sense that it limited. Tried with increased voltage (up to limit of 16V) but this didn't help. Declared the target dead on Jan. 11.

David measured resistances on the module top and found (in mOhms):

A-B = 27 (TGHT)

A-C = 7.473

A-D = 6.380

B-C = 26.053

B-D = 25.569

C-D = 5.212 (TBHT)

So looks like the tube is broken on the B side.

 The spent Ta#66 was moved from the south hot cell to the spent target vault, it was placed in pail#285 and placed in spot 5B of the vault. The target was 46.2mSv/hr when removed from the south hot cell. See the attached PDF for vault details.

TM2 was moved with no target attached from the South Hot Cell to a silo.

TM2 was moved from ITW to the South Hot Cell with Ta#66 target.

ITW primary and secondary vacuum vessel leak check and TM2 water lines helium pressure test are done today. No major concern. see attachment for small air to vacuum leak we found.  TM2 water lines helium pressure test is fine.   HS and window line leak rate are 1.4Xe-8 atm.cc/sec. all other water lines are below 3.0XE-9atm.cc/sec.

TM2 has been disconnected in ITW. All water lines are nitrogen purged. Filled 60 psi argon to all Tm2 water lines for module storage in winter shut down.

Tuesday, January 02, 2024, 15:58 :

Started HV ramp up on TM3 service tray about 3pm today. Had to bypass TCS:BIAS interlocks to make it work - there are some flow restrictions on the water lines that are causing the flow interlock to periodically trigger. The water flow it not very important for this test as long as the water is moving. Turned out that it was also conveninent to have all the interlocks bypassed because sparks tripped off the IG1 gauge and this did not cause the HV bias supply to turn off. Should use same setup next time.

Some sparking around 35-44kV, tripped off turbos/IG1/IG1S 3 times and so decided to ramp down.

Tried again while standing outside TH door to hear if sparking is outside the vacuum. Went to 48kV very slowy with multiple trips of the turbos, mostly TP2. Lots of sparks but easy to ramp back up to previous high point, so likely just a painful conditioning process. Current draw 167uA at 48kV. No sparks audible outside door, and vacuum response looks too large to be electrical noise.

Continued on Wednesday January 03 - went up to 53kV in the same way as before, lots of TP2 trips making its current a bit unstable... data was dumped as TM3_servicetray_conditioning_jan32023. Tried limiting the current on the power supply to very near the drain current to see if that reduces the number of trips. Didn't notice a significant effect.

Thursday, January 04, 2024, 09:57 :

Restarting conditioning, starting at 180uA at 53kV. Got up to around 60kV with many trips of the turbos, and one restart of the IG1 controller needed. Added a grounding hook to the vacuum controller rack to see if that helps reduce the trips. (doesnt appear to have).

Friday, January 05, 2024, 09:51 :

Continuing conditioning. Starting by sitting at 50kV for 10mins. No sparks observed during this time.

Even though we got to 60kV last time, onset of conditioning started at 58.6kV with a trip at 58.9kV... got up to 70kV.

Got to 72kV on Monday January 08 2024.

On Monday Jan. 15, tried to improve the grounding on the vacuum services rack to reduce sparking through the turbo controllers. Added two welding cables from the vacuum rack ground busbar to the copper grounding strip on the ground. If the spark is travelling from the faraday cage to the rack through conduit or grounding cables, maybe this will help. If it is coming through the turbo cable then it likely won't. Tried to add grounding straps on the turbo controller chassis (there is a brass screw which I think is for this purpose) but couldn't get either of the screws out with any resonable force. They undo a bit then get stuck...

 Wednesday, January 17, 2024, 20:39:

David vented TM3 with N, then opened the service cap to install new insulators. We pumped back down and Alexander and I ramped back up today - instabilities started around 55kV and we were back to slow conditioning in the high 50s. Got up to a set point of 65kV. Ray did some work on the TCS bias supply and now neither the set point or readback is correct. The PSU was reading 51.5kV at set point 50kV and 60kV at set point 58kV. Will continue later...

Wednesday, January 31, 2024, 16:23

Ramped up again, some slight instabiities around 56kV but could still go up pretty quick until about 65kV. Since Ray's testing of the TCS:BIAS supply both the readback and the set point are off from the powersupply display. Ran out of time and ramped down at set point 70.5.

Tuesday, February 06, 2024, 14:47

Testing again after venting the module with air. First tiny spark at 48, then some vacuum reactions starting at 49 but still no issues. Bit more reactive around 53.

 stopped at 69.4

Wednesday, February 07, 2024, 15:28 :

Ramped easily to 60kV set point and let it sit there. Didn't spark at all then after 100mins, sparked TP2 off. Otherwise first sparking happened at set point 67.

Found at limit at around 72.5 on the PSU front output, set point 70.6. think it comes from EPICS. Will have to test the power supply.... stopped there.

Thursday, February 08, 2024, 15:03 :

Long term testing. ramped back up, first spark at set point 65.

Let it sit for 2hrs 20mins. Something like 6 sparks during this time. Current also dropped significantly from 0.32A to 0.27A.

EDIT 2024-11-25, Alexander Shkuratoff:

All the StripTool data related to the above tests are on the server as the following below. Those without "Alexander" in the name were dumped by Carla.

	TM3_servicetray_conditioning_Jan32023	2024-01-03 17:29	807K
	20240103_TM3_Service_Tray_TCS_Alexander	2024-01-03 17:31	1.2M
	20240104_TM3_Service_Tray_TCS_Alexander	2024-01-04 16:58	238K
	20240104_TM3_Service_Tray_TCS_Alexander_2.csv	2024-01-05 07:00	13M
	20240104_TM3_Service_Tray_TCS_Alexander_1sec.csv	2024-01-05 12:21	81
	20240105_TM3_Service_Tray_TCS_Alexander.csv	2024-01-05 16:51	13M
	20240105_TM3_Service_Tray_TCS_Alexander_1sec.csv	2024-01-05 16:52	2.7M
	TM3_servicetray_conditioning_Jan52023	2024-01-05 21:24	8.8M
	20240108_TM3_Service_Tray_TCS_Alexander_1sec.csv	2024-01-08 16:56	4.7M
	20240108_TM3_Service_Tray_TCS_Alexander.csv	2024-01-08 16:56	7.1M

	TM3_servicetray_conditioning_Jan172024	2024-01-17 13:29	257K
	20240117_TM3_Service_Tray_TCS_Alexander.csv	2024-01-17 20:11	4.0M

	TM3_servicetray_conditioning_Jan312024	2024-01-31 17:24	2.2M
	20240131TM3_Service_Tray_TCS_Alexander.csv	2024-01-31 17:55	4.5M
	20240206_TM3_Service_Tray_TCS_Alexander.csv	2024-02-06 17:58	2.6M
	TM3_servicetray_conditioning_Feb62024	2024-02-06 19:29	4.6M
	TM3_servicetray_conditioning_Feb82024	2024-02-08 17:55	3.1M

 And the StripTool settings:

Alexander_TCS_HV_Conditioning.stp

2024-01-17 19:57

3.7K

Pail 211 which contained Ta#58 spent target was repackaged into Pail 286 in the South Hot Cell.

The dose rate at approx. 1 m was 4.16 mSv/h.

Pail 286 was transferred to the mini-storage vault and placed in the outermost location. The mini-storage vault is full at this time, in preparation for the next shipment.

TM3 was moved from the SHC to the TCS (no target installed).

TM3 has been moved from the target conditioning station to the south hot cell.

Pumped down the gas lines in ITE on Tuesday Nov. 28 2023 and opened the CF4 bottle valves. Missed the small section between the regulator and SV2 though, so will probably redo it.

Pumped down again on Dec. 12 2023. Was taking a long time so might not be as good as earlier. Maybe there is a leak in there...

TM3 was moved from the Silo to South Hot Cell.

Broken tong cable on SW manipulator (serial #8106) of SHC was replaced today.

Following ISAC Hot Cell entry procedure, Document 157554, SHC was entered and wrist and tong cable were replaced with a pre-run/assembled wrist, cable and tong. It is standard to try and pre-make/load a new cable into a spare tong assembly to reduce time spent in the HC. This marks the first time a wrist has been replaced. Rationale for replacing the wrist at this time is that internal spacer A-14118 which the ting cable rides over has had grooves worn into it. This is a result of regular wear and tear but could be causing premature wear on the tong cable. Replacement is a preventative measure. This is the original wrist and spacer from the original install in 1998. The wrist that was removed will be rebuilt and swapped out with the original one on the SE manipulator (serial #7986) at a later date.

Parts replaced today are: New - Bottom half of wrist joint (CRL-13950), New - Tong cable (CRL-14230) and used tong assembly (CRL-18062)

Procedure took about 40 minutes. Dose received was ~0.046 uSv

It is reported that the crane's hook rotation is not working currently. It was working yesterday (Nov 22). Investigation to follow, and this e-log will be updated.

Edit [2023-11-23]: the issue was a result of a tripped circuit breaker. Perhaps the motor became overloaded. It is advised to monitor the rotation mechanism over the new few operations, and rotate the hook CW and CCW prior to performing any critical operation to confirm it is working.

The spent Ta#65 target was removed from the south hot cell and placed in the spent target vault. It was placed in pail #284 and placed in spot 2B. It was 41 mSv/hr at 1 m upon removal. Target index spreadsheet updated.

 3 light bulbs replaced in the ISAC South Hot Cell - North West light, South west light, and South East light bulbs. Northeast light currently still working.

The South East light is not working after bulb replacement. This bulb was tested using the wires from the Northeast light station and the bulb is working properly. Electrical services is being contacted to troubleshoot the cable issues. 

During operation today, it was observed that the main vault door had issues opening.. typically when the door was around 80-90% opened, it would stop motion. Note that this issue has allegedly been present since early 2023. It appeared that the motor was still spinning but the clutch was slipping. This issue was consistent and observed multiple times when trays 2, 5, and 6 were engaged (note these are all on the same side of the vault). It was overcome by backing the door up slightly then trying again. The door close function worked with no issue.

It is suspected that there is a problem with the clutch or potentially a piece of debris on the track. [no longer true after 2023-11-17 inspection]

Edit [2023-11-17]: Maico Dalla Valle and Adam Newsome inspected the vault on 2023-11-17. It was very clear that the door, when opening, is rubbing up against the rails. Specifically, the side rollers located on each side of the vault (red housing). There are clear wear marks on each side. The skew is obvious because on one side, the wear marks begin immediately and stop halfway through travel, whereas the other side shows the reverse wear pattern. It is therefore suspected that the skew has become so significant that the friction is too high towards the end of travel which causes the clutch to slip. The travel rails were cleaned (significant grime buildup) and the offending side was filed down slightly (a sharp burr was present from the wear). It is not advised to adjust the clutch. Next steps: open and close the vault with no trays engaged to see if the issue persists (perhaps weight distribution was the issue), and then try different combinations of weight distribution to try to replicate the issue. After this, measure separation distance between guide rails at different points and try to identify the source of the skew issue and rectify it.
 

Edit [2023-11-20]: Maico and Adam performed further investigation by opening and closing the vault door under 3 different configurations: no trays engaged, 2 trays engaged on West side, 2 trays engaged on East side. The previously observed stopping issue was not observed this time under multiple cycles with each configuration. It is noted that the door appears to slow down slightly and experience a bit of a "chugging along" motion towards the end of travel when opening. Based on these observations, it is concluded that the cleaning and filing helped enough to allow the door to fully travel open/close without getting stuck. The root cause of the issue still remains to be fixed, but for now there is no major concern. Before end of 2023, measurements and planning will be performed to develop a proper repair for the root cause. It is expected that either late 2023 or early 2024, the repair will be attempted.

Edit [2023-11-22]: during a routine spent target exchange, the issue was not observed when opening tray number 2. 

Edit [2023-11-24]: a dial indicator was set up on the vault on the right side (looking down from above), mounted on the traveling part with the tip touching the black structural member where the wear is observed. The purpose is to determine how much out of alignment the door is with respect to the structural assembly. The following was observed: approximately halfway through the travel, the indicator read approximately 185 thou of travel. This corresponds to when the wear marks start to occur and where the small red enclosure around the roller wheel interferes with the structural member (causing the wear strip). At this point, as expected, the indicator no longer changes because the roller wheel has bumped up against the structural member. This implies the gap between the structural member and the roller wheel, when the door is closed, is approx. 185 thou on the right side (and 0 on the left side). These values reverse around the midpoint of travel. It is suspected that because of this, and because there is a small observable gap between the door and the vault when it is fully close, the right and left side of the door are not parallel with respect to each other. In other words, adjusting the angle so that the starting gap is roughly 92.5 thou on each side should resolve the issue. Measurements to confirm parallel-ness between each side will be performed, and then an adjustment will be made to create even gaps between each side at the starting point. After this, a dial indicator will be set up again to confirm that, when opening the door, the gap is maintained throughout the duration of travel. Small deviations are acceptable, but in general what should be observed is a roughly constant gap, and no interference (i.e. if the gap begins at 92.5 thou, it should not drop to 0 or not exceed 185 thou, but should hover somewhere on the order of 20 to 140 thou, for example).

 

Edit [2023-11-24, 2]: a dial indicator was set up on the left side of the vault in a similar manner as described above. In this case, the indicator's reading remained roughly constant during the start of travel (starting with the door closed and opening it up), with only up to around 10-20 thou variation at first slowly, followed by a slow increase to up to approximately 135 thou. This is similar to the 185 thou observed on the other side. One suggested means of resolving the issue is: raise the entire door slightly with overhead crane, translate it sideways approximately half of door's lateral travel distance (i.e. around 90 thou) and then lowering it back down. This should, in theory, be acceptable. It may not resolve the issue of whether the door is rotated, but should give enough clearance on both sides throughout the entire range of motion to be deemed an acceptable fix. Other opinions will be gathered on the subject to determine if this could work. 

The following four pails were moved from the main storage vault to the mini storage vault, to stage for shipping in Jan. 2024:

1. Pail 260 (SiC#41), Tray 5B
2. Pail 271 (SiC#42), Tray 2B
3. Pail 246 (Nb#10), Tray 6C
4. Pail 265 (UCx#36), Tray 2A

There is current one open slot in the mini storage vault which is planned for the Ta#58 target (formerly in Pail 211, to be repacked in Dec. 2023).

Target Index spreadsheet updated.

See attached printout with mini storage status.

 TM4 with new target UCx#43 was electrical and leak checked on SHC.

TM4 with spent target Ta#65 was disconnected in ITE and moved to SHC.

TM4 with spent target Ta#65 was electrical checked right after being moved to SHC. 

 All 20 targets in the vault were measured. The target spread sheet updated. See attached PDF for details.

ITH:MP1 is replaced this morning due to its poor performance started yesterday afternoon. The general field in pit is about 260usv/hr. the contact field on pump is 2.0 msv/hr. New pump works good. Lubricant in pump will be drained next week. then motor will be removed. The pump body will be bagged and stored in silo area.

HALCW system O2 sensor service and calibration were done in Sep 26th. electrolyte and membrane on rose mount sensor 499ADO were refilled and replaced. Sensor was zero and full scale calibrated. The sensor works fine after the job.

 The spent Nb#11 target was removed from the south hot cell and place in the spent target vault. It was placed in pail #283 and place in spot 7B is was 65.7mSv/hr upon removal. see pdf for further vault details.

 TM2 with new target Ta#66 was connected in ITW. 

 TM2 with new target Ta#66 had an electrical check and leak check on SHC. 

 An electric checked right after TM2 was moved from ITW. 

 TM2 with target Nb#11 has been disconneted in ITW. The HS line was purged with Nitrogen in station. 

Upon attempting to lower Pail 211 into their tile hole, CNL encountered issues with the pail getting stuck. They shipped the pail back to TRIUMF and requested we perform an investigation. The investigation report is attached.

The pail contents must be re-packaged into a new pail.

Note: the F-308 is currently sitting in the Meson Hall warm cell at approximately 250 uSv/h at 0.5 m.

Dose for primary worker (Chad Fisher) who inspected the cable, unbolted the flask lid, and handled the pail briefly: approx. 104 uSv

Dose for secondary worker (Danka Krsmanovic) who swiped the pail and flask to check for contamination: approx. 70 uSv

More photos available upon request from Adam Newsome.

 TM4 was connected in ITE with new target Ta#65 installed. see attachment in detail.

UCx #42 moved from North Hot Cell to Storage Vault in Pail #282. Placed in slot 6B. Tray 6 is now full. Pail measured at 34.9 mSv/h at ~1 m upon removal from the hot cell. See attached updated spreadsheet. 

 TM4 with new target Ta#65 has been E/L checked at NHCPost.

 TM4 with new target Ta#65 has been E/L checked at NHCPost.

  TM4 with spent target UCx#42 has been electric checked at NHCpost right after transferred from ITE.

 TM4 with spent target UCx#42 was disconnected in ITE and has been remote moved to NHC this morning.

 Module was connected yesterday and all turbo pumps are running at their top speed. 

 TM2 with new target Nb#11 replaced has been electric checked one more time in ITW.

 TM2 with new target Nb#11 has been E/L checked sitting on NHC.

 TM2 with target Nb#10 was disconnected in ITW yesterday for beam production issue investigation.

 TiC #6 moved from north hot cell to spent target vault placed in pail #232 put in spot 6A and the field was 151mSv/hr when removed from the north hot cell. See attached PDF for details about spent target vault.

 TM2 with new target Nb#10 was moved to ITW from TCS and re-connected in pit. TPs are running at their full speed. 

PIE on TiC#6 was done in the NHC. The target assembly looked brand new when we took it out, no heating spots or deposits (pictures on docushare). Online we measured a 400kOhm connection between TGHT-TBHT-COIL to HV common (TGHT and COIL shorted in TM2 service tray) and anode was unstable above ~300V. After the module move and before the target removal David found TGHT-TBHT-COIL was a dead short to HV common and the anode was at 39kOhms to HV common.

1. Wanted to see if the TGHT-TBHT-COIL short was on the COIL. Measured with ohmmeter the COIL lines to HS and got about 700Ohms. But with the target lying down the COIL lines drop and touch the heat shield so to do this measurement Chad had to lift the lines, which could cause them to touch something else. So not sure how reliable this measurement was. It jumped around a lot, saw 0L occasionally.

2. Measured both target legs and tantalum gas line to HS, got about 5kOhms repeatedly using the ohmmeter.

3. Meggered across the gas line insulator to the gas line going into the target and got open circuit at 250V, so the gas line wasn't coated.

4. Target container looked vaguely red in the areas where the target material was, otherwise still no deposits on the inside. The container was not overly crystalized as seen on the legs and end caps.

5. Some sparking marks on the EE and some slightly asymmetric deposits

Continuing Aug. 22 2023:

6. Found what looks like a hole in the insulation on the COIL, maybe the cause of our short? Found a corresponding line mark on the copper plates that hold the coil down but not sure if it is related. Pics on docushare.

7. Grid looks perfectly new. Where was that current going?

8. Copper plates that hold coil were loose and bolts that hold coil in just fell out as well.

9. What can be seen of the anode wire looks good.

TM2 Nb#10 has been connect at TCS. TCS water system and vacuum system have been started. Everything looks ok so far. TCS Faraday cage is secured for TM2 conditioning at TCS.

Nb#10 has been installed on TM2 . electrical and leak check on HS line are good. See attachment.

TM2 TiC#6 post run electrical check has been done at TCS. See attachment

TM2 SiC#6 has been disconnected in ITW. See check list

 The cleanup of the ISAC Target Hall crane and installation of the new SICK laser which replaced the IBEO laser for the EW crane position was completed on Aug 03 2023.

The clean up tasks which were completed: (Removal of tape viewing camera, Removal of tape, Installation of extension cord, Consolidation of power supplies for the lasers and removal of old laser) 

Currently power bar is still present to act as an extension cable. This will be removed when 2m extension cord is made and put in next target exchange cycle.
   

The installation and testing of new SICK Laser:

1. Calibration points were taken at the 4 corner limits of the crane. North South and East West positions were recorded.

2. Crane was parked at the ladder access position and mounting bracket was machined and installed.

3. A new cable was made and installed for the SICK laser. Continuity test was performed from the control room and crane to ensure pinout of the laser worked with existing serial communication setup in the control room PC.

4. The feedback values from the new SICK laser and old IBEO laser were compared to determine that a calibration offset of 0.06m was needed in the Laser Position Feedback program.

5. Laser Position Feedback program was re-compiled to communicate with 2x SICK lasers with the calibration offset value included in the EW feedback position. (Laser Crane PositionDlg.cpp)

6. Calibration points were taken at the 4 corner limits of the crane again with the new Laser. North South and East West positions were recorded.

There was less than 0.1% variance between the new laser and old laser which is well within the tolerance of the lasers themselves. It can be determined that it was properly calibrated.

In an effort to clean up the camera installation on top of the ISAC target hall crane to resolve a fault, the position measuring tape and its associated camera were removed from the target hall crane on July 31, 2023.

Still to do: clean up power bar installation.

The bearings on the mini storage vault were lubricated. It is suspected that this has never been done. It is suggested that this be performed every two years.

A draft procedure will be created for this job, but at a high level, this process involves:

• Opening the door fully
• Disconnection of the motor, limit switches, and cable management system
• Attachment of a lifting magnet to the door itself
• Raising the door
• Lubricating bearings
• Reversing the process to re-assemble

The entire job took less than 1 hour to complete.

Bearings for the main storage vault door were lubricated on 2023-07-28. It is unknown when this was last done. It is suggested that this be a recurring maintenance task every two years.

Looked at SiC#45 in the hot cell. Looked very clean, no deposits on the heat shield or other components. Target also looked very straight. Only issue we saw was sparking marks on the EE side that faces the ground electrode, in several spots. This target had a bout of sparking when ramping up the protons, so I guess that was the location. Will look for matching spark marks on the ground electrode next time TM4 is in the hot cell. Forgot to take picutres...

 An electrical check was made after new target installed on TM4.

 TM4 with new target UCx#42 was connected in ITE. 

 TM4 with spent target SiC#45 was disconnected ITE  and an electrical check made right after moved on NHC. 

The TiC#5 post irradiation inspection was done on Wed. June 14 and Mon. June 19. This target didn't have any obvious issues but it didn't produce much beam. The inspection revealed that the container was quite embrittled and showed significant damage, though it was not broken. The FEBIAD grid looked fine, despite the large anode current draw (indicating that current was flowing elsewhere). The gas line looked fine though the gas injection to this target looked as if it wasn't connected. But there was a plug on the unused line, so it must have been correct. No other obvious signs that would explain the poor performance. Pictures are can be found here https://documents.triumf.ca/docushare/dsweb/View/Collection-37913

An annual electrical and mechanical inspection was performed on the SMP today by Adam Newsome, Travis Cave, Eric Lahe, Maico Dalla Valle, Antoniette Yap, and Jason Zhang as per Work Permit I2023-06-21-4. The following items were checked:

• Check condition of wiring for physical/radiation/UV damage
  • OK, no signs of significant damage
• Check for cable tray debris or damage
  • There were multiple items in the cable tray which do not belong there - misc. pieces of wood and metal... these items were not disposed of but should be in the near future
• Check inside control panel: components and wiring, labeling
  • Labeling intact, components in good condition
  • Misc. random wires pulled to check... one ground wire was loose - it was tightened
• Verify camera views
  • This was not inspected in detail but signal status was checked, and is checked prior to remote operation
• Check connectors for damage
  • All connectors OK
• Check pendant for damage and verify labeling intact
  • Pendant OK
• Lid open/close test
  • Lid was opened and close multiple times - smooth operation, no concern
  • Lid close logic was checked - OK
• Vessel rotation and limit switch check
  • Both CW and CCW limits were checked, functioning
  • No concern on rotation - chain drive, rotary limit switch, and cable reel all functioning normally
• Lubricate chains
  • Not done - should be done next year
• Inspect tensioners
  • Done - OK
• Tighten fasteners
  • Not all fasteners were checked - washers will be replaced soon so this was not deemed necessary
  • Approximately 50 washers are missing for socket head screws in slotted parts. Not safety critical but they should be replaced soon.
• Visual inspection
  • All OK

Overall the inspection was successful.

 TiC#5 moved to the spent target vault from the north hot cell. Placed in pail#279 in spot 3A, 40mSv/h when removed from NHC. See attached PDF for further details.

Based on a request from CNL (attached), modifications were made to the wire ropes protruding through the tops of F-308s to add a crimped loop which acts as a lifting feature. Tests were performed (report attached) on 10 sample units to validate the strength of these loops, since each loop could not be tested in-situ once the pails were already packed in F-308s. CNL has reviewed and approved the test report.

Wire ropes within the following F-308s, which were staged for shipping as of June 20, 2023, were modified to include the lifting loop:

1. 06
2. 13
3. 15
4. 16
5. 19
6. 20
7. 21
8. 22

Each lifting loop was:

• Crimped according to the same procedure, using the same parts and tools, as the 10 sample units
• Measured using a tape measure to confirm the 3" size specified by CNL
• Checked using a go/no-go gauge provided from the crimp tool manufacturer
• "Pull tested" by hand as a quick check to confirm the crimps were successful (not a quantitative and official test, but a secondary qualitative "feel good" check)

As of the time of writing this e-log, TRIUMF believes these F-308s to be ready to ship.

ITE water signal interlock check including HS,EE, TA, TU, MSP. Coil1 , C-window ,2a-window, 2A tank, 2A shielding plug , 2A dump, 2A collimator  are done. All things work.

 TM4 with new target SiC#45 was connected in ITE, all TPs are running at their full speed.

 TM4 with new target SiC#45 installed has been leak checked and electrical checked on top of NHC.

 TM4 with spent target TiC#5 electric check after moving from ITE to NHC.

 TM4 with TiC#5 was disconnected in ITE and moved to NHC.

Plant group changed TCS water filters last Friday. 4 filters on resin can inet /outlet sides and filters(4 in one cartridge house)on pump return line have been changed. Triumf maintenance tags on filters have been updated. No water leak after job. The TCS TK2 water level dropped  from 20" to 16" because of the job. I will refill the level to 28" today. 

TCS:TK2 is refilled to 28".

Conditioned TM2 up to 48kV in ITW. Some sparks and current is not very stable. Drawing about 178uA at 48kV.

The annual inspection of the mini-storage vault and main storage vault was completed June 23, 2023. The following items were checked:

• Cabling and cable management
• Connectors
• Controls box - internal wiring and components, functionality
• Limit switches - functionality, wiring, mounting
• Motor
• Bearings
• Set screws
• Miscellaneous fasteners

The inspection was generally successful. A couple of minor findings were:

• Bearings for both the main and mini storage vaults must be greased. This is planned for a different day as it involves removing the mini vault's door.
• There was a small piece of metal on the track for the mini storage vault which was causing the door to "bump" over it as it passed over. This piece was removed and the door behaved normally.
• The wheel track for the main storage vault was dirty - it was cleaned
• It was suggested that the 120 VAC power cable for the mini storage vault controls box should be connectorized - this will be added to the "to-do list" for the future

MAA ASU test have been done following document 154779. All three tests in document are passed. DCR Jas has all test documents.

This test includes the functional test on TH emergency roof hatch which is located at the west end of TH roof. The hatch could be opened and closed properly from TH inside.

ITW water signal interlock check is done. All ITW water signals including HS, EE, Coil , Ta, Tu, MSP, C-window, HVC1, HVC2, 2A-dump, 2A -shielding plug, 2A-tank, 2A-window, and 2A-collimator are checked. All  water signal interlock work fine.

 Gas lines pumped down at electric room for TM2 at ITW is done, leak rate 0.0e -8 <1.0e -3 T P pressure

argon is being supplied at 6 psi to TM4. 

 TM2 with TiC#6 was connected in ITW (FEBIAD), turbo pumps were started successfully.

TCS MP1 is replaced due to poor performance( system shows unstable and high reading on TCSCG1A and high TP1,TP2 current draw) . The pump is edward 15i scroll pump. Since vacuum group has no same spare pump, i have to use SMP roughing pump SMP:MP1 which is a  same pump to replace it.. After the replacement ,the TCS:CG1A and TP1, TP2 current draw are back to normal. The original TCSMP1 was surveyed. Swipes on intake and exhaust port are 300 counts and 1000counts. RAM contact field measurement are from 0.2 to 0.5 usv/hr. It is stored in TH. We will try to refurbish this pump first and use as for SMP:MP1. If we can not refurbish it, a new 15i pump will be purchased for SMP:MP1.

2023-05-31: Opened pump tip seal chamber and swiped chamber inside. The contamination level :1200 counts on 44-2.  The tip seal and tip seal chamber o ring need to be replaced . Checked gas ballast knob. The O-ring inside knob is in good condition. Checked exhaust port o-ring. it is in good condition. spare part PO will be issued soon.

2023-06-14:Tip seals and o-ring have been replaced on original TCS:MP1. After, it was tested at TCS for 48 hours. The pump is much quiet on operation, and the pump body temperature is mild. The final  inlet pressure this pump could get with TCS PV1 closed is about 23 mtorr.  The result is good. I installed it back to TCS vacuum station and reinstalled SMP:MP1 back to SMP vacuum station.  

When I tried to raise the anode voltage in cathode bias mode on May 23 evening, I found the target or tube shorted to HV common. Investigations in the faraday cage today showed the same. I removed all the new electronics (resistors, gemovs, etc) from the power supply to no effect, so I disconnected the TGHT supply and pushed it away from the busbars. There was still a short. David Frank and I then went down to the pit and disconnected everything to measure the module. The module itself showed no short, and the bus bars in the chase for TGHT showed no short, though the ones for TBHT still showed the short.

David and Frank reconnected the module and I disconnected the TBHT supply in the faraday cage, then I found no shorts to TGHT/TBHT. When I reconnected everything there were still no shorts. There must have been a short in the TBHT line in the faraday cage, and another short in the TGHT line in either the faraday cage or on the module top. Both these shorts got resolved by taking everything apart. Still not sure how it happened.

Next I found I could not raise the anode voltage above 230V, it looked like it was current limiting but since the current limit was high, I figured it had something to do with the new electronics installed. I disconnected them all the in cage and that solved the problem, and then reconnecting the gemovs that go from the PSU terminals to HV common caused the problem again, so I left those disconnected.

TM2 HS line helium leak check is done. leak detector base LR 1.8xE-8atm.cc/sec.  helium pressure 70 psi. 5 minutes test. no change on LD leak rate.    I spray lots helium to gas line adaptor and fittings. No leak.has been found  at this base leak rate level.  Since the TCS MP1 has some  issue ,this time the base leak rate on LD only can get to 1.8Xe-8 atm.cc/sec at this moment instead of 0.0xE-9.  The low E-8  level is not perfect, but  i  have no concern on it.

Yesterday and today module conditioning was done on Tm4 in ITE. This is the first ramp up after the shutdown and ITE is planned to run at high voltages for the first weeks. The module is behaving well - went up to 40kV yesterday, stayed there for an hour, and up to 46kV today. Current draw is 113uA at 46kV. No serious sparking.

Tuesday, May 23, 2023, 09:32 :  Ramping up again, easy to 45kV. Drawing 132uA at 49kV. Still behaving quite well.

 TM2 with TiC#6 was checked on SHC, see pic attached pls.

 The emergency close mechanism for the Storage Vault door was tested by Travis Cave, Nadia Jorgenson, Adam Newsome, and Jason Zhang. The door was opened to its fully open limit, then closed with the emergency system. 

The test was successful.

 TM4 was connected in ITE.  pics attached FYI.

 TM4 with target TiC#5 installed has been leak checked and electric checked on NHC.

SMP  vacuum pumping down is stopped. SMP and TM4 venting to atmosphere will be started soon.

Argon vented ITE station. ITEVV1S and ITGT SV3 were closed after venting.

The pail handling tool which is used to move 5 gallon pails around the target hall was inspected by A. Newsome, N. Jorgenson, and E. Lahe. The main tool as well as spare were checked for the following items. The tools are in good, working condition. It is noted that some fasteners on the hook assembly were slightly loose, but have been tightened.

• Inspect structural integrity of long tube - check for bending, warpage, dents, cracks, rust/corrosion
• Inspect structural integrity of hook assembly - check for bending, warpage, dents, cracks, rust/corrosion
• Inspect fasteners - check all fasteners installed as per drawings, fasteners are tight
• Inspect crane interface assembly - check for damage and wear where the tool connects to the crane
• Check alignment - verify the tool connects to the crane and hangs vertically with no major misalignment (this step was not done - alignment is regularly checked during operations, and there was no concern as the tube was straight)

 Note: these tools are being inspected monthly by D. Wang and F. Song.

ITE TP3,4, 1S,and 4S were started successfully this afternoon. All pump current draws  were below 1.5A . IG1S was switched on. I have no local controller so TP1 and TP2 on TM4 at  MSP can not be checked.  IG1S was hard to switch on at first. It timed out and showed error 09 code. I removed the connector back cap, and it could be switched on after. I will look on this issue. 

Turbo -pumps were stopped  last night at  6 pm. All four pumps worked good during check. For IG1S switching on issue, the problem either caused by over pressure(No TP1, 2 in ITE)   or because coaxial cable was pinched by connector cap and caused bad contact on pin to cable.   I modified the connector cap inside by opening more space for cable passing through the cap. The cap is installed back.   The gauge will be switched on next week again. We keep watch on it

TCS cooling water system was started and tested this Wednesday. Chiller compressor 2 and 3 was in operation cycle twice without issue. TCS:TK2 was refilled to 28 inches. Water system works fine. system was switched off after test.

ITW, ITE, ITW +ITE total , and low active cooling water return flow meter transmitters are inspected and calibrated.  Result:

ITW , PX-750-06Di , Calibrated to  4-20 mA for 0 to 6" H2O DP, linear.    Transmitter works fine.

ITE. PX-750-06Di, calibrated to 4- 20mA for 0 to 6" H2O DP, linear.   Transmitter works fine.

ITE+ITW total, PX-750 -30 SQDI.  It looks like electronic board for square root output is broken. It can not be calibrated  to 4mA @ 0 inch H2O DP. The transmitter is calibrated to 10.25mA - 25.25mA for 0 to30" H2O DP, linear. Transmitter works fine.

 Low active cooling water return, Px-750-30di, smart.  The transmitter is broken. The output current stuck at 44.5mA on all DP.  I tried zero and reset it by following instruction manual, but failed to bring it back. The electronic boards are broken mostly. The production is discontinued by Omega Engineering. A new Omega transmitter PX3005-25WDWBI (linear) will be ordered for its replacement.

2023-06-28: A new Omega transmitter PX3005-25WDWBI (linear) has been installed back to LALCW system in target hall. Transmitter is calibration by manufacturer @ 4-20mA output@0 to 25 in H2O DP. Control group will finish the cable connection in TH, electrical room, and reprogram   on epic page on July -11th.

2023-07-12: Cable connection, formula reprogram, and epic page reboot are done yesterday by Ray.M. New transmitter works fine. All flow rates are displayed on epic page properly with new program formulas.

NHC was entered on April 17, 2023 for inspection and maintenance. Summary :

Compressible and non-compressible waste was loaded into a 55 gal drum and removed from the NHC. This same drum will be inserted into the SHC at a later date to be sorted, compressible waste compressed, and drum filled more.

Manipulator remote end tong cables checked. Tong cables didn't show any wear but both east and west had tong cables had hopped off the third highest pulley (see detailed write up . This was fixed by tying the tongs in the closed position to provide slack in the cables then inserting a t-handle through the wrist and offering the cables back onto the pulleys. Cable hopping is most likely due to aggressive ratcheting and releasing of the tong during operation.

Manipulator booting flanges were removed from both manipulators as it was previously found that  the booting interferes with access to the inside of the containment box so it could not be used. Flanges were remove to provide even more clearance.

Containment box cover removal arm - linkage fasteners were removed one at a time and blue locktite added then reassembled and tightened appropriately to allow arm to swing freely (see detailed write up) . Lack of locktite during initial assembly was allowing fasteners that pass through bushings into the linkage arms to loosen over time/cycling.

Exhaust pre-filter changed.

Target insertion jig - The target insertion jig was rumored to had a missing fastener. A loose nut was found that appeared to belong to it but after much inspection a location for it could not be found...i.e. all parts appeared to be counted for. During this inspection it was noted that some over the fasteners in the main hinge were loose. Again these were removed one at a time, blue locktite added and fasteners tightened to allow proper movement (see detailed write up).

Window inspected for leak. No sign of any leakage from the "hot" side.

The spent target assaying turntable was repaired. It was tested today with a load exceeding the maximum it would need to handle during rotation (100 kg). It works as expected and is ready for operation.

The fields in the NHC after removal of Ferran's graphite sample is 238 uSv/h. This again seems to emanate for the items in the 5 gal pail...the copper tubing from the beam window or, as I mentioned in my previous elog, the peek samples. I did ask about removing these during the graphite sample removal but was told they were not "hot".

NHC is 1.26 mSv/h inside approximately .5m from table surface, between manipulators

SHC 186 uSv/h inside approximately .5m from table surface and between manipulaotrs

Helium cylinder and  Argon cylinder are installed in both ITE/ITW faraday cages , regulator for outlet pressure are not set yet.

TO ITE :  Argon bottle size 14"L x 4"D with SV2 connected at pressure 900 Psi ( 70 bar )

               Helium bottle size 18"L x 7"D with SV1 connected at pressure 2000 Psi ( 130 bar )

TO ITW: Argon bottle size 15"L x 2"D with SV2 connected at pressure 1000 Psi ( 80 bar )

              Helium bottle size 18"L x 7"D with SV1 connected at pressure 2000 Psi ( 130 bar )

An Neon cylinder size 20"L x 6"D  at less than 100 psi ( <10 bar ) pressure stored in the cabinet of ITW cage without connection

two gas line connection pictures are attached here for reference.

On Sept. 14 2022, a 10kOhm 30W resistor was installed in each target station faraday cage, in line with the HV bias supply. This was an effort to reduce the current draw from the BIAS supply and protect the power supply controls cards which have been repeatedly breaking due to HV sparks (we think). In the end we still broke cards after the installation, so it doesn't seem to have helped. See below for details on the electrical side:

At 30kV, HV currents are around 100-150uA, meaning the voltage drop over the resistor is around 1.5V. When operating at higher voltages, with higher current draw, the voltage across the resistor could be over 2V and we could get into a situation where it would have an effect outside the normal adjustments needed on the mass separator. We made this decision based on the fact that the power supply's setting resolution is on the order of 1 x 10^-4.

When the resistance of the water changes, this affects the current draw from the power supply and this in turn affects the voltage over this resistor. Based on some sample numbers of running times, there is not much variation in the current except from sparks and if there is some issue, like water leaking between HV and ground. During normal running, the voltage change across the resistor should be less than 0.5V during normal operation. This is on the same order as the 8 hour stability of the power supply.

HALCW ITC:MP1/MP2 pump and motor temperature measurements result:

MP1: pump discharging  port: 78F,  motor rear bearing house:72F  , Motor housing 140F(60C). 6F difference between them is less than 15F manufacturer clarified up limit in instruction manual. 

MP2: pump discharging port:78F,  motor  rear bearing house:72F, Motor housing 122F(50C).

MP1 is better than MP2 on motor status. It could be seen on phase current measurements as well.

Other notes on pump performance:    total flow rate 60GPM , discharging gauge pressure  99 to 100 psi on both pumps with one station all of TM water circuits bypassed + other station  two of TM water circuits bypassed + both stations 2A beam related water circuits  on(2X5).

HALCW ITC:MP1/MP2 motor phase current measurement is done by Joel from electrician group. MP1:17.1A/17.2A/16.7A.  MP2: 17.9A/17.9A/17.3A.   19.5A is manufacturer notified on full load phase current.on operating  instruction manual. 

HALCW flow sensors replacement job is done. All ITE/ITW(except ITE HS) return line water flow sensors including paddle wheels and coils are replaced.  After job, water interlock signal have been checked in electrical room .  Everything works fine. Visually inspections for possible water leak on HCLCW system have been done as well. one valve on ITE dump return line has a very small water seeping through valve stem. I will watch on it.  Other than that,  No major concern.

2023-03-08: leak on 1/2" ITE dump return line valve is fixed.

The linear actuator used for the Y-motion motor assistance on the spare telemanipulator was replaced and tested. It was observed around September 2021 that the former one which was installed was causing fuses to blow for the main 120 VAC power supply in the control box. After some troubleshooting, it was determined that the linear actuator itself did not operate smoothly - it was suspected that this caused motor overload due to additional friction. This suspicion was confirmed by operating the linear actuator independently with a power supply and measuring current draw. The part has been replaced by Thomson PPA90-58B65-08NXXX. Note: this part took over 1 year to arrive since it was first ordered. The spare telemanipulator is confirmed operational.

Update 2024-09-11: noting that this was for serial number 9351

Adam Newsome wrote:

The linear actuator used for the Y-motion motor assistance on the spare telemanipulator was replaced and tested. It was observed around September 2021 that the former one which was installed was causing fuses to blow for the main 120 VAC power supply in the control box. After some troubleshooting, it was determined that the linear actuator itself did not operate smoothly - it was suspected that this caused motor overload due to additional friction. This suspicion was confirmed by operating the linear actuator independently with a power supply and measuring current draw. The part has been replaced by Thomson PPA90-58B65-08NXXX. Note: this part took over 1 year to arrive since it was first ordered. The spare telemanipulator is confirmed operational.

 During this repair it was noted that the Y-axis electrical translation is locked out when the Z-axis is in the fully retracted position (i.e. the Z-axis limit switch engaged). I have made a note of this in the operator manual (CRLD-1046-B Rev1 ) which can be found in docushare collection 26780

vacuum pit ventilation upgrade was done last week. The jobs include: installed two industrial cooling  fans.  One is placed in pit on resin tan cover. Other one is placed on and opening to pit by shielding blocks.  They are installed for better air circulation in pit. Also,  2x two small 20W cooling fans are installed on ITH MP1 and MP1S to low the pump  operation temperature.  The result is positive. The ventilation status in pit meets the pump operation requirement (good ventilation and 40 Celsuis below) .  ITH CG2S 0.0 mtorr.  ITH CG2 0.26mtorr.

I visually inspected HALCW system including water station section, both target pits, and de-ionizer system.  No small leak and drip was found .  The inspection in both target pits will be repeated after flow sensors are replaced.

Two filters on HALCW resin circuit have been replaced. O-ring 235# were changed on both filter cartridge houses.  25micron  10"x 2.5" 3M cartridge new filters  are used. Old filters are not very dirty. They are bagged and stored in vacuum pit. Residual water from cartridge houses are collected and stored in high active storage jug with sealed cap.  No leak on resin circuit before and after the job.

Feb. 16 2023: HV tests done on ITE station. Ramped up to 59kV but was not stable there, current draw was very unstable and was sparking every ~6mins. Ramped down to 58kV and it was stable there for 3 hours drawing 285uA.

Feb. 24 2023: HV tests done on ITW station. Ramped easily to 60kV with no sparking - suspicious. Has been stable at 60kV for 45mins with no sparks and current draw of 200uA. Cannot find any reason that things aren't connected properly...

Five of used  internal leaked  TP BVs are serviced and repaired. Internal plunge  o-ring and case o-ring are replaced on all five BVs. Leak checked valves after  . They are ok to be used as spare parts.  The are active parts stored in TH now.

In past two weeks, ITW/ ITE primary vacuum back up lines and BVs in ITW/ITE pit have been leak checked.  ITW BV1 and BV2 on back up line side were leak. They are replaced with old leak free BVs.  ITE TP2 NW25 SST  flexible line right after pump were leak . It is replaced with new NW25 SST flexible line. Two leak were found on ITW side KF 50 O-rings connected to NW 50 SST flexible coupling. They were replaced with new KF50 o-rings. After job, both  stations primary back up lines in pit were leak checked .  They are good.

 The spent UC#41 was moved from the south hot cell to the spent target vault, placed in spot 1C, in pail #231. See attached PDF for details. 

Tom Kauss inspected target hall crane below hook attachment pins and plates ITA6550-01 yesterday. He certified the use of these pins and plates. The inspection of these pins and plates was in Target hall crane annual check list. It was issued as a calibration index by Isaac Earle in 2022-Feb-08.  After inspection, The inspection tag  was issued and attached to pin. Tom has an inspection record on this job

Tom Gauss inspected  two target module lifting frames ITA0494-1997-01 and ITA0494-1997-02 yesterday. He certified the use of these two frames for 2023. Inspection tags have been issued and attached to frames. He has inspection record on them. 

Tom Kauss  finished TH crane annual inspection yesterday. The crane woks fine. Tom has this inspection record in his file. The crane inspection tag has been issued for 2023.

Tom Kauss inspected target hall crane yesterday. The crane works fine. Tom has this inspection record in his file. The inspection tag has been issued.

ITE primary and secondary vacuum vessel air to vacuum seals leak check was done this week. One leak has been found on IG1S feed through to entrance module surface seal. It explains what we saw on ITE IG1S readings change(from low E-7 torr to 1Xe-6 torr) on December 22, 2022.  This leak seal will be replaced soon.

2023-Jan -27.  O-ring seal 229# was replaced on ITEIG1S feedthrough to entrance module surface sealing. Also o-ring seal 034# was replaced on the blank off cover beside the feed through to entrance module surface sealing. Since these o-rings are too close to each other. It is better to replace both of them to avoid misreading in leak check.

TM4 electrical check with UCX41target and without target at SHC.  The results are good. See attachment.

TM 4 has been disconnected in ITE.  See attachment for disconnection checklist.

Plant group and us  finished TH floor mopping and garbage collections last Wednesday. Th moping head had 800 count after using. all garbage were bagged , checked, tagged, and sent to radwaste area.

 ITW  was cleaned with vacuum canister in Jan 10th. HV  cage inside and blue nylon insulators were wiped.  Garbage inside the pits were cleaned out.

TM4 water lines helium pressure test was done yesterday at ITE. All water lines were air purged one day ahead  for the test. No leak  has been found on TM4 waterlines during the test. See attachment for detail

 UC#40 was moved from the north hot cell to the spent target vault. It was placed in pail #278 put in spot 1B and was 15.6 mSv/hr when removed from the north hot cell.

Also Ta#62 in pail #256 was moved from spot 7B back to 7A where it was originally located. This pail in the future will have to be repacked due to the fact it lacks a reinforcing disc in the bottom of the pail.

attached is vault details.

 TM2 with no target on SW silo be electrical checked right after module moving.

 TM2 with target UCx40 was disconnected in ITW and moved to NHC.

ITW and TM2 primary and secondary vacuum vessel leak check is done. Leak detector is connected to ITW TP1. Base leak rate on leak detector is 0.0 x E-9 atm.cc/sec.   See attachment for the result.  No big issue. Two old leaks we found last year at location D and E disappeared in this check. We did Vacseal resin spray on them last year.  It looks like the Vacseal spray works .  From the result , I can see the o-ring between exit 1 module and T - flange is closing to the end of the life.  There are two small leaks on this o-ring now at A and B location. We plan to change this o-ring next winter shut down. We do vacseal spray on them this year. The big O-ring between tank vessel and T -flange looks still ok. Two small leaks are found on location F and G on this O-ring. Not much we can do on them. The leak on location C and B were sprayed with resin yesterday after leak check. They are leak free after spray on check. I will double check them. Leak on location A will be resin sprayed after TM2 is removed and ITW is under vacuum.   All TM2 internal water-cooling lines are helium pressurized (70 psi) for 5 minutes each. HS shows 2.5 X E-9atm.cc/sec leak rate. The rest lines are 0.0 X E-9 atm.cc/sec.

The following three pails were moved from the main storage vault to the mini-storage vault:

1. #211, Ta#58 (formerly vault location 3C)
2. #217, ZrC#8 (formerly vault location 3A)
3. #228, UC#37 (formerly vault location 1B)

The target index spreadsheet has been updated.

[edit 2023-01-03] The crane was powered back on this morning - there do not appear to be any faults and it seems that the crane was unaffected by the power outage.

The ISAC target hall overhead crane was powered off for the holidays. Note that this may result in the commonly observed PLC battery failure issue when the crane is powered back on in the new year.

The following five pails were moved to the mini-storage vault today under work permit I2022-12-16-1:

• #239 (formerly vault location 7A): 1.38 mSv/h @ 1m
• #245 (formerly vault location 6B): 1.56 mSv/h @ 1m
• #264 (formerly vault location 6A): 748 uSv/h @ 1 m
• #267 (formerly vault location 1C): 708 uSv/h @ 1 m
• #268 (vault location 7C): 809 uSv/h @ 1 m

The mini-storage vault is now full and ready for transfer to F-308 flasks.

The following measurements were made on other pails:

• #211 (vault location 3C): 4.21 mSv @ 1 m
• #217 (vault location 3A): 1.05 mSv/h @ 1 m
• #246 (vault location 6C): 1.98 mSv/h @ 1m
• #274 (vault location 1A): 4.78 mSv/h @ 1 m
• #228 (vault location 1B): 3.86 mSv/h @ 1 m
• #256 (vault location formerly 7A, now 7B): 3.60 mSv/h @ 1 m
• #260 (vault location 5B): 1.46 mSv/h @ 1 m

The target index spreadsheet has been updated to reflect these changes. See attached PDF print.

Post irradiation inspection of C#4 which was running in TM4/ITE was conducted at the NHC on Nov. 22 2022.

The yields from this target had been dropping and its behaviour was erratic, with the voltages on the tube and target jumping all over the place sometimes. The ion current on the FCs followed the voltages. We took this to mean the target container was breaking down.

Upon inspection we found the container looked pretty damaged - highly crystallized and distorted. The container had gone banana-shaped, but not in the usual direction. It had curved  in the direction of the ion source (see photos). The heat shield and other surrounding components were super clean, no deposits or marks at all.

 TM4 with UCx#41 was connected in ITE on Tuesday (2022-11-29) 

TM4 was moved from the Conditioning Station to the East Target Station with C#4.

C#4 spent target was moved to the storage vault, in pail 277. Dose rate at approximately 1 m when leaving the hot cell was 164 mSv/h. The pail has been placed in vault location 4C. See updated vault layout attached.

TM4 was moved from the North Hot Cell to the Target Conditioning Station with UCx#41.

 an electric check and leak check done on NHC, TM4 with new target UCx#41 is ready moving to TCS.

The pin on TM4 has become loose again, making it very difficult to remove the multipin connector with the last target, C#4. For the installation of the next target, UCx#41, we will drill out the hole on the target side bracket so that it doesn't contact the multipin pin. Will try to remove this pin by force in January, or if needed change out the whole multipin bracket.

 TM4 with C#4 is checked on NHC right after moving from ITE.

TM4 was moved from ITE to NHC with C#4.

TM4 with C#4 was disconnected in ITE

 TM2 with UCx#40 is connected in ITW.

Did the PIE on UCx#39-IGLIS on Thursday Nov. 2 2022, couple pictures uploaded to docushare. Did not remove the target, just the heat shield cover.

Final electrical check on the module showed a dead short from TGHT/TBHT to HV common, which we did not see online. Seems like it must have occurred after ramp down? It persisted on the target after we removed it from the module. We couldn't find any obvious contact points, because it seems it did not happen while current was running in the target. Possible locations are the bottom support leg for the TBHT and the top of the right side target leg, though it was difficult to confirm with the camera.

Otherwise the only thing to note was a blacker-than-usual spot on the inside of the Cu heat shield, downstream in the proton direction.

Helium 70 psi. tested 5minutes at base leak rate 0.9 xE09 atm.cc/sec on HS line.  No leak.

 The spent UC#39 target (pail #276) was removed from the north hot cell and place in the spent target vault (spot 4B) it was 14.4 mSv/hr when removed from the north hot cell. See attached PDF for further details. 

an electrical check was done on NHC, TM2 with new target UCx40 is ready moving to TCS.

 TM2 with spent target UCx#39 had an electric check in NHC.

After UCx 39# target was removed out., I did electrical check on TM2.   @500 V B to C is 5M ohm. all Others between are above 25Mohm. HV to Chasis is 650Mohm.  A to P is still short.

 TM2 with spent target UCx#39 was disconnected in ITW then moved to NHC.

During the last ITE run with the SiC#44 target, the ITE:TBHT controls card was fried twice. The first time we put in our spare, and the second time we just continued to run without controls readback. For the C#4 run starting Oct. 19, we used the conditioning station supply. As soon as one of the other supplies is fixed, we will install it in the conditioning station. The equipment list (https://triumfoffice365-my.sharepoint.com/:x:/g/personal/cbabcock_triumf_ca/EQPffP4p1P9JqEDWIHGRPfsBVDSQjMCv-M8ZNg4ngkyGHw?e=fnLVYe) tracks these movements.

Conducted PIE on SiC#44, which failed online. It had a cathode short, a target short and an anode short by the time we called the experiment off. In the post irradiation examination, two clear marks where the target legs touched the heat shield were found (see attachments 1 and 2). No marks were found to indicate where the cathode short would have been. The fibreglass sheath covering the anode wire where it passes over top of the coil was destroyed, must have been a result of sparking (see attachment 3). No other issues noticed, grid looked fine, though close inspection is difficult.

17-Oct-2022 Comment by David Wang: On OCt 14th, Replaced a flexible hose on MP1S pump exhaust port,but did not solve the issue. High frequency vibration was sensed by hand on MP1S pump inlet and outlet ports. Pump height and position in pit are adjusted slightly in pit to reduce vibration. After, ITHCG2 and ITW CG4SA got a huge improvement in past 3 days. All back up line pressure are stabilized at normal operation status. Still, close watching on this issue is needed to ensure the present status is stabilized in long term.

The issue was returned after shielding block installation Monday morning at 8:30am. Investigated further,  I temporarily installed a turbopump used cooling fan on MP1s to improve pump heat dissipation. And a room fan is put outside on shielding blocks opening hole to increase air circulation into pit. Since then,  everything is perfect. All secondary turbo pumps current draw is around 0.5 to 0.6A which is the best.  I guess that short duo 10 pump life we observed in past could be related to high pump operation temperature in pit as well. We may increase the pump life if air circulation around the pump could be improved. A permanent solution is needed for it.

 Spent target move done. The SiC#44 was moved from the north hot cell to the spent target vault. It was placed in pail#275 and placed in spot#4A. It was 42.6mSv/hr when removed from the north hot cell. See attached PDF for further details about the vault.

Please note we will only have two free spots in the vault at the start of the running period after the winter shutdown 2023.

 TM4 with Target C#4 was connected in ITE.

A modification was made to integrate the hot cell's lift table into the E-stop circuit. See work permit I2022-10-07-1

The E-stop mounted on the right side of the small enclosure adjacent to the operator station will now serve to stop the lift table's up and down motion, as well as the turntables up/down and CW/CCW motions. Functionality was checked by B. Webster (electrical services) and A. Newsome.

Note: it is recommended next time there is a hot cell entry to inspect whether or not the limit switch specified in the schematic is actually installed. The schematic should be updated to match the drawing.

Redlined electrical drawing photo attached to this e-log, and the paper drawing is left inside the lift table's control box. The schematic will be revised based on the redline updates, likes as part of work request #6342 (to integrate this drawing into the turntable controls drawing package).

TM4 HS line helium pressure test is done. 70psi helium pressure@ 3XE-8 atm.cc/sec . No leak.

 an electrical was done for TM4 with target C#4 installed on NHC.

 Today while I was removing the SiC#43 it was noticed that the multipin guide pin was loose.

This made it difficult to remove the target, and the multipin shoulder bolts removal was required.

With the loose pin it was not possible to attach the multipin for the target C#4.

Chad was able to tighten the multipin guide pin enough, however it became obvious that the pin could not be removed when it was attempted.

With the pin tightened, the target C#4 was installed and all checks were good.

It was recommend that once the C#4 target is removed the TM4 will need some repair to remove the multipin guide pin. 

Chad - Also it was noted that the guide pin (ITA6453) in question showed signs of plating or heat (see pictures I've added)

A fully built steerer sub assembly ITA2826 revision E was boxed and sealed and put on rack storage in ISAC B2 South Hot Cell area. It is contained in a blue bin and green tag. 

It is advised if this assembly is used, it should be inspected for damage before using in a source tray.

 TM4 with SiC@44 was disconnected in ITE.

Myself and Maico were able to top up the NHC window oil.

The oil was filled through the expansion tank

- the Nitrogen line closed and the Nitrogen pressure valve was disconnected to ensure that no oil would go in to them.

- the pressure relief valve was disconnected to act as an air bleed line while we filled the oil

- with a funnel we slowly added the oil until the oil level could be read, showing about half full

- about 1.5 liters of oil were added

- once filled the Nitrogen line was reattached and the pressure was returned to recommended level 

- the remaining oil was returned the RH shop

Now the oil level will be monitored, which will help identify if there is any leak in the system.

On 26/Sept/2022

Chad disassembled the right operator side manipulator, and noticed that gears in the handle were quite tight especially when compared to the left operator side manipulator. 

Once a dry grease was added, and the handle reassembled all seemed to be in working order.

There was noticeable wear on a shaft and Chad has suggested to order some spare parts for the wrist and handle. 

 The spent target UC#38 was packed into pail #274 and placed in spot 1A of the vault. It was 33.3mSv/hr when removed from the north hot cell. See attached PDF for more vault details.

The motor cable for the storage vault was replaced as the old one was showing signs of wear. The U-track that the old cable ran through was also bent as a result of being hit.

In the process of replacing the cable, an e-chain was installed for cable management purposes. Mounting brackets were modified and a new U-track was installed as well. The new hardware is more robust than what was previously installed.

The vault door was opened and closed multiple times while observing the e-chain - everything behaved as expected. The system is operational.

Solidworks model IRH0189 is updated to show the changes

 TM2 with UCx#39 is connected in ITW.

TM2 with UCX#39 HS line helium pressure test is done at TCS. 70 psi helium 3minutes. No leak @0.0XE-9 atm.cc/sec.

 An electrical check was done on NHC yesterday.

 An electrical was done on the NHC for TM2 with spent Target UCx#38 on

 TM2 with Target UCx38 was disconnected in ITW and moved to NHC

ITE:ANODE supply reading strange currents - 17mA with the power supply on and no voltage. Checked anode circuit from electrical room:

Anode wire in electrical room shows 0L at 250V

Circuit with 50kOhm resistor mostly looks good (49-52kOhms) but a couple times read 28kOhms, no idea why. Tried jiggling all cables, unplugging and replugging and everything looks fine.

But power supply still seems to be giving out signal for 17mA readback. Decided fastest to swap with TCS power supply and troubleshoot this one on the bench.

TM4 with SiC#44 installed developed a short TBHT to HV common during its first heating in ITE. Was fine before installation. Now with everything cold TBHT to HVC is 25kOhms. Removed short in electrical room, will rely on short in the module.

 TM4 with target SiC#44 was connected in ITE on Tuesday.

 The spent Ta#64 target in the north hot cell has been packaged and placed in the spent target vault. Pail#273 spot #5C 86.6mSv/hr upon removal from the north hot cell. For detail on the vault see attached PDF.

HS line helium pressure test is done at TCS. No leak. I also leak checked gasline adapter and fittings on TM4 top. No leak.  1/4 copper gas line between module and ITE was leak checked yesterday. It is good.

 TM4 with Sic#44 installed and had an electrical / leak check at NHC. 

 An electrical check made at NHC right after TM4 moving from ITE.

 TM4 with Ta#64 has been disconnected in ITE.

UCx#38 developed a short between the plasma electrode and the extraction electrode about 30mins after reaching full temperature in the conditioning station. The decision was made to bring it into the anteroom and try to clean it there.

To do this, it was uninstalled, the parasitic attachments were removed and it was brought into the ante room.

I removed the EE and the PE, and cleaned quite a lot of material from them both with methanol. I think put the ionizer foil bar down the ionizer to help dislodge any material there, and I also turned the target over and tapped gently to get any material out. The first two times some flakes came out, the third time nothing came out. I then reinstalled the electrodes using the EE alignment tool (not sure how successfully, didn't push it into the ionizer too much because I was worried about catching the Rh foil).

The taret was meggered at 500V then reinstalled and electrical checks were done. Everything looks back to normal. Conditioning in ITW was successful.

 The spent target SiC#43 was moved from the north hot cell in pail #272 and place in 5A of the spent target vault. See attached PDF for details.

 TM2 with Target UCx#38 was connected in ITW.

 A standard electrical check was done for TM2 after the short issue be fixed.

 A electrical check was done for TM2 with UCx#38

 A electrical check was done at NHC, see the pic attached with please.

 the module was disconnected in pit and moved to NHC.

 The spent SiC#42 was moved from the north hot cell to the spent target vault, it was placed in pail #271 and put in spot 2B. see attached PDF for more details.

Dan lubricated components on the target storage vault (This was an outstand task from annual inspection). No issues on the main storage vault but we were not able to lubricate the mini storage vault because the position of the grease nipple on the fittings makes them inaccessible, see attached pictures. All four should be replaced with 90 deg fittings. 

An annual mechanical inspection was performed on the SMP today by Dan McDonald and Nadia Jorgenson. The following items were checked:

• Lubricate chains
  • Not needed
• Inspect tensioners
  • No issues found
• Tighten fasteners
  • A few slightly loose, most are in need of washers, see attached pictures
  • Could use some shims in a few places, see attached picture
• Inspect components during rotation - chain drive, rotary limit switch, and cable reel etc.
  • No issues

An annual electrical inspection was performed on the SMP today by Travis Cave and Nadia Jorgenson as per Work Permit I2022-06-30-2. The following items were checked:

Electrical Inspection of Safe Module Parking:

• Check condition of wiring for physical/radiation/UV damage
  • OK, no signs of damage
• Check for cable tray debris or damage
  • Some objects stored in the cable tray but nothing concerning, no damage noted
• Check inside control panel: components and wiring, labeling
  • Labeling intact, components in good condition
  • Wiring in good condition
• Verify camera views
  • Checked, no issues
• Check connectors for damage
  • All connectors OK
• Check pendant for damage and verify labeling intact
  • Pendant OK
• Lid open/close test
  • Lid was opened and close multiple times - smooth operation, no concern
  • Lid close logic was checked - OK
• Vessel rotation and limit switch check
  • Centre, CW and CCW limits were checked, functioning

Still to be done – Mechanical Inspection:

• Lubricate chains
• Inspect tensioners
• Tighten fasteners
• Inspect components during rotation - chain drive, rotary limit switch, and cable reel etc.

 TM4 with Ta#64 was connected in ITE. see attachment please.

With Ta#64 installed , TM4 HS line was helium pressure tested at TCS. base leak rate is 0.0XE-9 atm.cc/sec. HS line tested leak rate is 3x E-7 atm.cc/sec on 5 minutes 50 psi helium testing. Leak check result wasgood at NHC by helium spray method. We decided to apply water to HS and all other water lines still. The vacuum status is closely being watched. So far, TCS pumping down trend is still good. HS line supply water valve was switched on and off couple of times at TCS IG1 1.15 XE-6 range, and no vacuum spike was observed. More information will be logged in during the TM4 and target conditioning stage at TCS. 

 UC#37 was placed in pail #228 and place in spot 1B it was removed the north hot cell. See attached PDF for more details of it and the vault.

 New Target Ta#64 was installed on TM4. Electrical measurement result is good. c/w attachment.

Monday morning June 20th: TM2 with SiC # 42 was moved from ITW to NHC.

Monday afternoon: TM2 with no target was moved from NHC to SHC due to 10 pin connector guide pin loose issue. The guide pin has to be moved out in SHC due to NHC manipulator configuration limit .

Monday afternoon: TM2 with SiC # 43 was moved from SHC  to ITW.

all module moves are smooth.

TM2 with UCx#37 P2N target  was removed from ITE to NHC yesterday morning. The move is good.

 A p2n target in TM4 was electrical measured on NHC. see attachment pls.

 TM2 with Febiad Target SiC #43 was connected in ITW. NOTE: the number of TARGET in attached picture should be #43. 

 the module with target UCx37 was disconnected in ITE.

 While removing the SiC#42 it became apparent that the multipin guide pin had become loose again and was not allowing the target to dismount from the module.

The multipin shoulder bolts were removed and then the multipin was able to be pried off.

However the NHC manipulator were not able to reach the guide pin to remove it, which would be required before the SiC#43 could be installed.

The target module was then moved to the SHC where the guide pin could be removed and the installation of SiC#43 took place, along with the transfer of the parasitic attachment onto the SiC#43.

This problem seems to suggest that the multipin could use some redesign to ensure smoother target exchanges.

 TM2 with new target SiC#43 was electrical checked at SHC. please see attachment.

 An electrical check was done at NHC, see attachment pls.

On June 2 2022, while attempting to install target SiC#42 a gasket fell off the water line. I attempted to remove the target to have the gasket reattached, however the multi pin connector guide pin was loose and was preventing the target from being removed. During the attempt to remove the target it was noticed that an electrical cable in the back of the module had become loose and was dangling. The target was then secured to the module, and then the module was moved to the SHC to complete the job/repairs.

June 3 2022, containment box was removed, Einzle Lens cable reattached and tested, and the multi pin guide pin was retightened.

On June 6 2022, the containment box was damaged while lifting the containment box back onto the module.

The left rear corner of the box caught on the module and the corner weld snapped and folded the corner down about 90 degrees.

With help from Chad, we were able to restraighten the corner with a C-clamp, enabling the box to be reattached to the module.

However the 2 bolts that were on the corner that attach to the module were not able to be aligned and were not used.

The target was reattached to the module, and to save time was brought directly to ITW, skipping the conditioning station. 

 TM2 with Febiad target SiC#42 was connected in ITW.

 An electrical check was done at SHC for TM2 with FEBIAD SiC #42 Target. 

 TM2 with a test target was disconnected in ITW.

Annual ITE water signal interlocks check is done with Rob Shank. All ITE water signal  interlocks work fine.

5 pails were moved from the mini-storage vault into F-308's

At one point during the loading the mini-storage vault door would not close. Cause was a blown fuse, which was replaced and operations were able to continue as usual. Possible reason the fuse blow was a tilted pail that may have become jammed between the tray and the roof of the mini-storage vault. 

[Edit 2022-12-01, Adam Newsome]: the pails which were removed were: 220, 227, 233, 235, 238

 TM4 with UCx#37 was connected in ITE. Attachment available.

 Sic#39, Ta#59, C#2, UC# 32 & 30 have been moved from the spent target vault to the mini vault. See the attached pdf for details of the vaults.

 The TM4 with installed target #UCx37 had been electric checked at SHC. PICs attached.

 An inspection was performed on drive systems for the main storage vault by Dan McDonald, Travis Cave and Nadia Jorgenson. The functionality was not tested. Some areas for improvement noted, but otherwise nothing concerning was discovered. 

Notes:

• The wire insulation to the motor is showing wear and tear. Should be replaced in the future. For now was patched with electrical tape, see picture. May be beneficial to add an e-chain for the portion of the wiring that moves when door is opening and closing

• Emergency close mechanism cable should be changed to have a 5/32” Nico Sleeve

• Moving parts still need to be lubricated

• Chain inspected (OK)

• Gearbox inspected - OK

• All drive system set screws checked and tightened

• Sprocket alignment checked - OK

• Limit switches checked - OK

• Emergency close mechanism cable checked - OK

 The emergency close mechanism for the Storage Vault door was tested by Travis Cave, Nadia Jorgenson, and Dan McDonald. The door was opened to its fully open limit, then closed with the emergency system. 

The test was successful.

The annual inspection of the mini-storage vault was performed today. The following items were checked:

• Cabling and cable management
• Connectors
• Controls box - internal wiring and components, functionality
• Limit switches - functionality, wiring, mounting
• Motor
• Bearings
• Set screws
• Miscellaneous fasteners (some loose, but were tightened)

Everything appears to be in good working order.

Note: in the near future, the bearings should be greased. This is planned to take place during the next inspection of the main storage vault.

Annual ITW water signal interlocks check was done with TM2 in ITW.   Water signal interlocks on all water circuits related to TM and 2A beam lines in ITW work fine. 

 TM2 was connected in ITW with a Febiad Test Target. 

 A Test Febiad Target was installed and checked at SHC. 

Chad changed the EZL cable and plugs on TM2. New cable runs along the cable trays.

TM2 is in the TCS without containment box for HV testing following the installation of the IGLIS wiring.

Not great results so far - sat at 42.5kV for nearly 2 hours, current around 200uA and occasional sparks. I did not have time to go higher, will do this tomorrow. The sparks could be conditioning but it looks a bit suspicious to me. We will see if the ramp up tomorrow is very easy and how high we can go. I have data from HV testing of TM2 in December for comparison.

The EZL was reacting to all sparks, so I went into the target hall to see if it was sparking on the module top, but there was no sparking there.

Possible mitigations:

1. Re-do the connections on top of the service cap to remove the extra length on the wires inside the service cap and inspect the routing carefully to make sure nothing is in the wron place.
2. Inspect the wiring in the source tray to see if there is evidence of sparking in a certain area.

Second round of testing Tuesday April 5 2022:

Much better results, seems most of the sparking was conditioning. Went right up to 42.5kV with no issues. Spent quite a while getting up to 50kV, and didn't leave it there for more than a couple mins. May be running into the limitations of the HV cage at this point. Bias current was much lower, something like 140uA at 45kV.

Third round of testing Wednesday April 6 2022:

Ramped easily back to 45kV, a little more sparking above that. Sat at 47kV for ~30mins with no sparks. Won't try to go higher in case of issues with the cage. Will try to condition up to 50kV in the station. Other than the possible low megger value between B and C, all looks good.

 Last week we repaired the South Hot Cell turntable chain/sprocket. Chain was loose and there was a few section where the chain was not lining up properly with the sprockets.

3 issues were discovered:

-        One of the pins was bent. It’s been replaced but is a temporary fix. Need to replace them with stronger pins.

-        The smaller sprockets near the motor were too far from the main turntable sprocket which was causing the links to not immediately line up with the teeth on the turntable sprocket. With too much slack in the chain, it’s likely that this is were the misalignment was starting. This was fixed by adjusting the motor position and the position of the yellow plate bolted to the floor.

-        The yellow plate that is bolted into the floor has oversized holes relative to the bolts/washers used. This allows us to adjust the position, but the washers are to thin and are being bent/pulled into the holes. Should be replaced with thicker washers that can withstand the tension and this will help prevent the plate from sliding out of position.

Replaced 9 old turbo pumps from ITE/ ITW and  one 2A3M20 wire scanner from ITE are transferred to cyclotron tunnel for storage. It is TH RAD waste cleanup task in winter shut down.

UCx 32# P2N target in vault slot 1B is repacked is morning for Ferran to take out his samples( in two small plastic containers) stored in pail last July when Chad did the spent target job. The job went well.  Old pail # is 254# and new pail # is 233. It is put back to 1B in vault.

Two changes have been made to the control system to the South Hot Cell:

1. Addition of two emergency stop buttons: one located in the Target Hall on the wall adjacent to the hot cell, and one located on the control panel adjacent the operator station.
2. Addition of limit switches to the turntable's vertical drive system to prevent over-travel at both the upper and lower limits.

The emergency stops will both stop all turntable motion: vertical and rotational.

An update to operating procedures: in order for the vertical motion system to function, the limit switch cable must be plugged in. When plugging in the vertical drive motor to the wall outlet as per normal operating procedure, it is now required to also connect the limit switch (which is mounted near the motor on the driveshaft) to the cable coming from the appropriately labelled junction box on the South wall (M12 connector).

These changes are based on electrical drawings IRH2083 - IRH2085 and mechanical assembly drawing ITA6739. The changes have been commissioned according to commissioning plan Document-218490. The commissioning report will be uploaded to DocuShare. The work permit for this upgrade was I2022-02-15--3.

Polyurethane  water cooling lines in ITE and ITW  HV shroud are replaced.  Both stations Ta, Tu, MSP, HS, Coil , EE in HV shroud are new lines.

UCX34# in pail 258(Vault lot 7C) has been repacked today. It is an investigation to find a possible leak source of radioactive Iodine in vault. The new pail number is 268. It is back to vault 7c . I wrote down the information in log book. The job is smooth today. I retrieved UCx 34 old pail and liner to TH. The liner from UCx#34 only has 3000 counts.  I bagged it. It could be used later. However, the pail has 500K counts contamination on bottom outside rim. It may accidently be slided out of plastic bag and touched the NHC table during the repackage. I bagged it and store it in silo area. When we do drum clean up, I will throw it in the drum.

 A 3/8 inch drain valve on return cooling line was replaced in ITE. In the meantime two 1/2 inch valves labeled FEBIAD COIL and ENTRANCE COLLIMATOR RETURN at ITW were replaced . The 2 inches leaky supply/return water valves in ITW were repaired as well. Pls check pics

attached here for detail.

 The valves #V10 & V11 beside high active water pumps were replaced in Target Hall, pics attached.

Carla did the test. That is what she wrote in Feb 04th:  "I am done with the HV testing at ITE - the results were the same as at ITW. It stayed at 59kV for 30 mins with no issues. Trying to go above 59.5kV is probably possible but a bit more risky. ITE also has a band, from 54-56kV, where the current jumps around like crazy".

  Carla did the test. and reported the result as following: HV testing of ITW is complete. It was pretty well behaved up to 59.5kV, and sat at 59kV for 30mins with no sparks (that EPICS caught). There was some strange behaviour of the current between 51kV and 53kV - it was jumping by 20uA or more - but there didn't seem to be any voltage response, and it went away after 53kV (though it returned on the way back down). The test was done in Feb 02.

Spent target UCx #33 has been repacked with a new pail and lid in NHC. Old pail #255. New pail # 267. Location: Vault slot 1C.  it is an investigation job for  a possible leak pail in vault.  

Tom Kauss finished target hall overhead crane annual inspection today. The crane works fine. He issued new inspection tag and e-logged the job. 

Two shielding blocks  above vacuum station at TH west end were opened for inspection. Checked ITH:MP1, MP2 lubricant color and level through sight gauge on pumps. They are still ok.  Restored the shielding blocks.  Checked ITM:MP1 by decay tank (Mirror checked  sight gauge by north wall). Added lubricant to ITM:MP1 to middle level on sight gauge.  

ITE/ITW  are cleaned with vacuum canister. HV  cage inside and blue nylon insulators are wiped.  Garbage inside the pits are cleaned out.

TH emergency exit hatch which is located on TH west end roof is opened and closed for functional check. The hatch works fine. The limit switch on hatch is in position. No obstacle on hatch way to the roof. 

The spent Ta#63 has been moved from the north hot cell to the spent target vault. It was place in pail#266 and 
placed in spot #3B of the vault. see attached PDF for more details.

TM4 was removed from NHC to S_W silo yesterday.  The remove is smooth and successful.

Tom Kauss inspected target hall crane below hook attachment pins and plates ITA6550-01. He certified the use of these pins and plates. The inspection of these pins and plates was in Target hall crane annual check list. It was issued as a calibration index by Isaac Earle in 2022-Feb-08.  After inspection, The inspection tag  was issued and attached to pin. Tom has an inspection record on this job. See attachments.

Tom Gauss inspected  two target module lifting frames ITA0494-1997-01 and ITA0494-1997-02.. He certified the use of these two frames. Inspection tags have been issued and attached to frames. He has inspection record on them. See attachments.

 David did electrical check after target removed from TM4 at NHC. see attachment pls.

 David made an electric check after TM4 been moved to NHC from ITE. The target is still on the module. Please find out attached pic for detail.

 An electric check was done right after module moving from SMP to SHC. 

 The spent UC#36 target in the north hot cell has been removed and placed in the spent target vault. See attached PDF for detail note that the PDF does not show that spot 2B is occupied by the 2A3M20 pail.

TM2( no target ) has been moved  from NHC to SMP.  The moving is smooth and successful.

Frank and I replaced ITW Exit module 1 side square service panel o-ring seal. Also, The target module pit top flange o-ring seal in ITW pit is replaced.  

Travis and Nadia moved TM2 from ITW to NHC this morning. The move is smooth and successful.

ITE primary and secondary  vacuum vessel leak check has been down.  Base leak rate 0.0x E-9 atm.cc/sec on LD. Only 2.8 XE-9 atm.cc/sec leak has been found on big T tank seal which is very tiny. all other seals are perfect leak free.   No concern

Helium pressure 70 psi. 3 minutes on each circle untill LR on LD is balanced. Base leak rate on LD:0.0xE-9 atm.cc/sec.   The result:

A:   slowly to1.8Xe-8atm.cc/sec after 2 minutes and balanced there. 

B:   slowly to 2.0XE-8 atm.cc/sec after 2 minutes and balanced there.

C:  quickly response  to 3.1XE-8 atm.cc/sec and balance there.

D : slowly to 3.0X E-9 atm.cc/sec and balanced there.

All others including coil1, coil 2 ,MSP, EE, HS, window are perfectly leak tight. No response on LD.

 The leak rate on A,B,C,D are in low E-8 or E-9 atm.cc/sec range.  They should seal cooling water without leak.    No concern. 

Frank and I finished ITW and TM2 leak check. TM2 internal water-cooling lines are leak free. They passed 70 psi helium pressure test. We found some small leaks on ITW primary and secondary vacuum vessel. I list them here:

1. Exit module 2 service cap top plate to cap body O-ring at SW corner. Leak rate 2XE-8 atm.cc/sec. It is an old leak we found before. Solution: I sprayed high vacuum resin to leak area. It is improved to 3Xe-9atm/sec now. We can leave it there.

2. Exit module 1 module to tank flange o-ring at target module side and north side. Leak rate 3XE-8atm.cc/sec. Solution: replace the o-ring. It involves in disconnect exit module 1 and remove it out. We may or may not change it. Let's check the schedule and discuss it later. We need Travis help on module moving out.
   
3. Exit module 1 north side sqaure service panel o-ring. Leak rate 2XE-7 atm.cc/sec.  Solution: replace the o-ring. It is a straight forward job.  It will be done this shut down.
   
4. Exit module 1 north side round roughing valve panel o-ring. Leak rate 8XE-9 atm.cc/sec. Solution: Replace the o-ring. It involves in disconnecting and removing ITW RV4.  It could be done this shut down.
   
5. Big T tank o-ring seal underneath the flange at exit 1 module north side . Leak rate 3XE-8 atm.cc/sec. Solution: None. All modules and module base flange have to been moved out to replace this big o-ring.  It is a huge project to change this o-ring .  I checked this big o-ring seal every year. It is first time a small leak is found.  Maybe, we could try high vacuum resin spray first.
6. Dump module flange o-ring at the side by Target module. Leak rate 8XE-9 atm.cc/sec. It cannot be confirmed since the TM o-ring is just beside it. Mostly, the leak is on dump module side. We changed TM flange o-ring every year. But we never changed dump module flange o-ring in history. Many copper cooling lines above the dump module has to be removed to remove the dump module out. I do not think we have time to do it this year. Also,  the leak rate is pretty small. Maybe, we can schedule it next year.

  Most these small leaks are close to turbopumps. This could be the reason the ITW vacuum on gauges are still pretty good.

 electrical checked in ITW

 electric check done in ITE. 

TM4 has been connected in ITE. See attachment for checklist.

Remotely remove TM4(Ta#63) from TCS to ITE. The move is smooth and successful.

We loaded UCx #29 , SiC #38  , Ta#53, Ta#56 ,and Ta#57 from mini storage  into F308 flasks.  Later, the flasks are transferred from TH to B2 HC service area. In TH, Working area and Mini storage are cleaned and surveyed.  Tools are cleaned and surveyed as well. No contamination.   Mini- storage is empty now.

The spent UC#35 target has been moved from the south hot cell to the spent target vault. It was placed in pail #264 and put in spot 6A of the vault. See attached PDF for more details.

Helium pressure test on TM4 HS line at TCS is done.  LD base leak rate 0.0 xE-9 atm.cc/sec. Helium pressure 70psi. HS line had been helium pressurized for 5 minutes during the test. No response on LD. HS line with Ta#63 is leak free.

TM4 was moved from the South Hot Cell to the Conditioning Station.

the TM4 with new target Ta #63 installed in SHC and an electric check was made by David. 

TM4 was moved from ITE to SHC. Shield plug installed in ITE.

 the TM4 with UCx#35 was disconnected in ITE.

An issue was observed in which the target hall crane was not functioning: the N-E-S-W and up/down motions did not work, however the rotation motion did work. These symptoms were similar to what was observed in the past under https://elog.triumf.ca/TIS/RH-ISAC/2039 and https://elog.triumf.ca/TIS/RH-ISAC/1845

The crane control console was not powered (i.e. pressing the ON/OFF buttons when the selector switch was set to remote mode, even when safety conditions were met, did not enable/disable remote functionality). The power supplies were checked and everything appeared to be powered as would be expected, except for items which depended on the main contactor (O-K1) being energized. This contactor needs the PLC to be in an operational state, fault-free. The PLC was checked and the red fault light was flashing. The battery light was not on (i.e. battery was OK).

The program was re-downloaded to the PLC. During an attempt to go online with the PLC, error code 0004h appeared (see attached image for description). This is an unfamiliar error code - typically the aforementioned symptoms arise due to a battery failure and the program being lost. In this case it is uncertain at this time what the cause of this fault is. It will be monitored in the future to determine if it occurs again, and further investigation will be performed.

After re-downloading the program and placing the PLC in RUN mode, the crane was fully restored to its operating state - the main contactor was able to be energized once again. The crane was put into remote mode and a brief functionality test on the motion axes was performed: OK.

A rotary limit switch was installed, attached to the shaft adjacent to the drive motor for the vertical drive system. This limit switch is not yet wired to the control system and operational - this will be done at a future date and the e-log will be updated.

Relevant electrical drawings: IRH2083 to IRH2085

Edit (2022-03-02): see e-log https://elog.triumf.ca/TIS/RH-ISAC/2309

 The spent targets SiC#38 and UC#29 have been removed from the spent target vault and placed into the mini storage. See attached PDF for details.

 Ta#57 was repacked and placed in the mini vault. The pail was changed from #174 to #263. See attached PDF for more details.

It was noted on Nov. 9 that a squeaking noise was present when the turntable was rotated CCW with a module present.

Upon inspection, it appears the issue could be due to drive chain misalignment and improper tension. Furthermore, it was noted that a shaft collar on one of the existing chain tensioners was broken (a replacement was ordered).

Repairs will be performed on Nov. 19 to resolve these issues by re-aligning the chain, and resetting the tensioners. The turntable will be tested. This e-log will be updated once the work is complete and the system is returned to a functioning state. See Work Permit I2021-11-09--3

Edit, Nov. 19: the aforementioned repairs were completed and the turntable has been tested and is operating correctly. No squeaking noise is present. It is suggested to increase the diameter of the two chain tensioner shafts (and thus modify related bearing and shaft collar components) in order to prevent bending of the shaft which was observed. This will be done in the near future.

 Ta#53 was repacked and placed in the mini vault it was changed from pail#164 to pail#262. See attached PDF for further details.

 The spent C#3 target has been moved from the south hot cell to the spent target vault it was placed in pail #270 and put in spot 2C of the vault. See attached PDF for more details.

 TM2 with target UC#36 was connected at ITW.

 An electrical check of TM2 with target UC#36 and no external connections was finished at SHC. 

TM#2 was moved from ITW to SHC, then moved back to ITW.

 the module TM2 with target C#3 was disconnected at ITW and is being remoted moving to SHC.

 Ta#56 in pail #169 was repacked and placed into #269 and was placed in the mini vault at the back. It was 3.86mSv/hr upon removal from the NHC. See attached files for details.

 the five shielding blocks have been moved from ITW to ITE. 

 The spent SiC#41 target has been placed in pail #260 and placed in spot 5B of that spent target vault. See attached PDF for details. 

 the module with target UC#35 was connected in ITE and being pumped down.

 the tests were done when TM4 was on NHC. see attached photos please.

ITE IG1S cable end connector replacement has been finished by Roy Huang.

 TM#2 moved from ITE to NHC SiC#41 removed and then moved back to ITE.

 TM4 was disconnected and moved to NHC. 

 the test was done when TM2 sit on NHC.

 TM2 been connected with new target C#3 in ITW. 

 TM#2 with C#3 has been moved from the north hot cell to ITW. Also for the up coming site wide power outage, the ISAC Target Hall crane has been turned off and powered down, also the remote crane console has also been power down as well so that mean no ISAC TV for a few days.

Remote capability was added for the mini-storage door control. The control signals originate from the Opto 22 Module box that is used for the SMP remote control (this is located just above the storage vault).
The controls signal assignment document has been updated and can be found in C:\PDM Vault\PDM_Vault\_models\isac\isac1\wpn-3919 - safe module parking\Electrical

In order to operate remotely:
- Plug the mini-storage control box power cable into a wall outlet (adjacent main storage vault, under stairs)
- Plug the motor output cable into the mini-storage door motor
- Unplug the local pendant from the box
- Plug the cable that comes from the remote module box into the connector that the pendant was plugged into (M12, 5 pole Murr connector)
- Using the remote control program from the ISAC RH control room, click on the Mini-Storage option and then click buttons for open and close to operate the door (note: it is important to verify both opening and closing functions work before attempting any remote operation).

Remote and local functionality have been tested and verified working.

It is recommended to mount the mini-storage control box in a convenient area near the mini-storage (possibly on the wall adjacent the main storage vault).

Please contact me if you have any further questions.

 The spent UC#34 target was moved from the north hot cell to the spent target vault. See attached PDF for details.

 TM#2 with UC#34 has been moved from ITW to the north hot cell had the target removed and then moved to the south west silo.

 The spent Ta#62 target along with 2A2M19 were placed in pail #256 and placed in spot 7A of the spent target vault. See attached PDF for vault details.

 TM4 with a new target was moved back from NHC to ITE and reconnected at pit. The 5 shielding blocks were installed as well. Copies of connection checklist are attached here.

 TM4 electric check with new target was done by David. A pic attached here for ref.

TM#4 with SiC#41 has been moved from the NHC to ITE.

TM#4 with SiC#40 has been moved from the east target station to the south hot cell.

The West Entrance Module has been moved from the South Hot Cell to the West Target Station.

A cable track was installed between the mini-storage vault and the silos, for the purpose of implementing a retractable cable chain (e-chain). This will allow for cables to be managed during door opening/closing, so that remote control operation of the door will be possible in the future. See Work Permit I2021-08-11-2 (Aug 11)

Holes were drilled into the motor mounting plate (IRH2089) to allow for mounting a limit switch on the plate. See Work Permit I2021-08-17-7 (Aug 17)

Preliminary testing was completed in which the e-chain was fixed to the door with a C-clamp. Local and remote functionality were checked, and limit switch functionality was verified. Everything is working as expected. A final test will be conducted once the e-chain is fixed to the door and cabling routed through it. See Work Permit I2021-08-19-1 (Aug 19)

The e-chain has not yet been fixed to the vault door - holes will be drilled in-situ after preliminary testing is complete to confirm positioning.

 Edit [2021-09-23]: the installation is complete and has been tested.

The West Entrance Module has been moved to the South Hot Cell for repair.

UC#33 has been packed and moved from the north hot cell to the spent target vault. See attached PDF for 
deatails

The job is done with Matt at NHC. All TGHT and TBHT bolts are torque wrench tight in NHC. HS leak check result is good.

helium pressurized HS line at TCS. No leak.

See the attached for the way ITE has been re-wired for the Ta62 run. Note also that the copper block in the schematic on TBHT negative may not actually be connected. Wiring verification on Aug. 4.

Finally ITE:EL is still not working. It shows a value on the front of the PSU but doesn't draw enough current and doesn't affect the beam. We are running without it and it will hopefully be fixed on the Aug. 4 maintenance day.

These electrical issues bear some resemblance to those with Ta61, but I don't think we ever determined the cause there.

TM4 was moved from the conditioning station to the East target station.

The emergency close mechanism for the Storage Vault door was tested by Adam Newsome and Travis Cave. The door was opened to its fully open limit, then closed with the emergency system.

The test was successful.

At SHC: HS line no leak . electrical check result is fine. At TCS: helium pressurized HS line to 70psi, 3 minutes. LD  leak rate 0.0xE-9atm.cc/sec , no response.

Remotely remove TM4 (ta# 62) from SHC to TCS.  The moving is smooth.

An annual electrical and mechanical inspection was performed on the SMP today by Adam Newsome, Dan McDonald, and Jason Zhang as per Work Permit I2021-07-07-3. The following items were checked:

• Check condition of wiring for physical/radiation/UV damage
  • OK, no signs of significant damage
• Check for cable tray debris or damage
  • There were multiple shards of plastic in the cable tray - they were removed and disposed of
• Check inside control panel: components and wiring, labeling
  • Labeling intact, components in good condition
  • One COM wire for the relay array was loose - it was tightened
• Verify camera views
  • This was not inspected but has recently been checked, and is checked prior to remote operation
• Check connectors for damage
  • All connectors OK
• Check pendant for damage and verify labeling intact
  • Pendant OK
• Lid open/close test
  • Lid was opened and close multiple times - smooth operation, no concern
  • Lid close logic was checked - OK
• Vessel rotation and limit switch check
  • Both CW and CCW limits were checked, functioning
  • No concern on rotation - chain drive, rotary limit switch, and cable reel all functioning normally
• Lubricate chains
  • Done
• Inspect tensioners
  • Done - OK
• Tighten fasteners
  • Done - OK
  • Note: some concern over socket head screws in slotted parts - they should have washers. Not a critical issue but worth checking into.
• Visual inspection
  • All OK

Overall the inspection was successful.

 Yesterday a bottle of Cava (sparkling wine) was place, opened, and poured in the NHC, to commemorate its new operational status.

The NHC is now a functional hot cell and is ready for many years of target exchanges to come.

TM2 has been connected it ITW.  All turbo pumps are started.

Leak checked TM2 service cap at TCS. helium pressure checked containment box window and HS cooling lines.  No leak on service cap and waterlines.

TM2 UCX33# electrical check and leak check results. See attachment.

Chad installed containment box back to TM2 yesterday. We leak checked VCR joints on window line.    No leak.

Annual ITE water signal interlock check is done.  HS, TAR, TUBE, MSP, EE, COIL 1, containment box window, HVC1, HVC2, 2A window, 2A  shielding plug, 2A dump, 2A collimator, and 2A tank water signal interlock are checked.   Everything is working properly.  

2021-06-22. Annual ITW water signal interlock check is done,  HS, TAR, MSP,  EE, COIL1 , containment box window, HVC1 , HVC2, 2A window, 2A shielding plug, 2A dump, 2A collimator, and 2A tank water signal interlock are checked. Everything works fine.

 TM#2 has been moved from the SHC to the NHC.

Both electrical check and leak check (HS and Window lines)results are good.   See attachments

Correction: It should be UCx#32 P2N instead of UCx33# in check list attached . UCx#33 is on TM2 in ITW

Remotely removed Tm2 from silo to SHC. The moving is smooth.

Replaced  ITE TP4 due to failure start. The new pump works fine.

Remotely remove tm4 from silo to shc. The moving is smooth.

Tank refilled from 12 in to 25 in using the new valve.

A contractor on site today for chiller maintenance. CP2 and CP3 circuit is leaking and shall not be used. CP1 can still be used. The contractor will contact Plant Group with a quote for repair and upgrades.

 Myself and Isaac removed the boot from the left hot manipulator.

- opened the hatch in the TH to get access to the top of the boot

- released the latch on the boot and loosened the boot from above

- closed TH hatch

- with the right manipulator we were able to detach the rest of boot

This test proved that we can remove a boot from the manipulator without having to enter into the hotcell.

Due to the physical restraints that the boot causes for the operator, we have decided to not reattach the boot with its current design.

A new design will be investigated to allow the boot to be fixed without twisting, which is the source of the problems.

Repack of 4 spent targets in TH and SHC.  SiC#37 to new pail249#. SiC#36 to new pail 250#. Nb#8 to new pail 247#, SiC#33 to new pail 248#.  They are all in mini storage. Also, UCx 31 are transferred to mini storage.  There are 5 spent targets in mini storage now.  

2021-05-20: 5 spent targets have been loaded into F308's. We transferred two more spent targets into mini storage this morning for next week loading.

 Anders and I prepared ITE high voltage test in April 30 ( Friday morning), The MAA is locked for this.

 Friday, April 30, 2021, 14:06

Anders and Luca

Resistance measurements on each electrical feedthroughs (A,B,C,D,E,I,P,Q,R,U,60kV,ground) taken with no target or no short attached to the module. Results as expected:

P-Q = 6.439 mOhm

R-U = 6.019 mOhm

All other combinations = Open Loop

New steerer cables are installed in TM4. Cables are properly routed in containment box and service cap top. After job, TP2 is installed back onto module top.

Using SHC electrical test cables routed to to TH,  We tested TM4 steerer  4 polarities. At 100v megga test, left, right , up and down to ground are all OL. TM4 steerer has no short.

High active water system is refilled. Air are drained out of  system before pump to be started. Following sequence are used to bring the whole system back to operation:

1. close ITE , open ITW. Switch on the pump. Only 2A beam line related 5 water circuits are in loop in ITW.  Switch off pump when system pressure is stable above 100 psi.

2. Close ITW, open ITE. Switch on the pump. Only 2A beam line related 5 water circuits are in loop in ITE. Switch off pump when system pressure is stable above 100psi.

3. Open ITW, Open ITE. Switch on pump. both ITW and ITE beam line related water circuits are in loop.  Switch  off pump when system pressure is stable above 100psi.

4. Close ITE open ITW.  Bring ITW  target module water circuits back to loop by connecting bypass fittings on to circuits. Only bring one circuit back to system at first. Switch on pump. Wait for system pressure stabilized. Then Close ITW. bring next circuit back  to system.  Open ITW .  wait for pressure stabilized.  repeat the process until all water circuit and connected with bypass fittings in ITW.

5. Check possible leak on valves, fittings, and flow sensors in ITW pit.

6. Go to electrical room, check all ITW water signal status.

7. Close ITW, Open ITE. Repeat same procedure as step 4 on ITE target module water circuits.

8. Check possible leak on valves, fittings and flow sensors in ITE pit.

9. Go to electrical room, check all ITE water signal status.

10. Open ITW.  At this stage, full ITE station and half of ITW station water circuits are in operation.  Check possible leak on pumps, valves, fittings, gauges on water station at TH west end.

11. Keep system in operation. Watch on - tank level , system pressure, and conductivity on resin circuit and whole system.

On 2021- 04-20,  Tm4 is removed from Silo to SHC. The moving is smooth.

On 2021-04-19, Frank and I remotely removed Tm3 from SHC to silo . The moving is successful.

Travis assembled and tested the steerer wires March 31st (see attached)

Adrian and co installed a new T to be able to add an instrument loop for O2 and pH monitoring on the low conductivity water systtem (photo). See WP I2021-04-09-4

The crane pendant for the auxiliary hoist was upgraded to a FLEX EX2 style pendant by Canco Cranes. The installation work was performed by Canco, supervised by Tom Kauss and David Wang. Installation work was performed in one day (I2021-03-26-1).

Items installed include: new pendant (2 motion, 2 speed)

The existing antenna and receiver box located in the Target Hall were used.

The new system was tested by David Wang. Everything is reported to be in working condition.

Pail 237 only has 200u sv/hr field at 0.5 meter. On contact measurement: 0.9 to 1.6 m sv/hr.and less than 80 count contamination outside the pail.   It is moved to mini storage. We will transfer this pail to cyclotron vault and store it there later.

By Curtis. See Work Permit I2021-03-24-1 for details.

Frank and I removed Tm3 from TCS to SHC. The move is successful.

 David and I re-connect Entrance module at ITE after the monitor been replaced at SHC. 

 The east entrance module is now back at the east target station.

In mid-2020 design analysis was completed on the steel plate & pin assemblies (ITA6550) used to connect the ISAC target hall crane hook block to the module lifting yoke assembly ITA0494.  The released design note is Document-184431.  

In November 2020 fabrication was completed on two full plate & pin assemblies (photos attached below).  As per the relevant ASME standards (identified in the design note), each assembly has been identified with serial numbers (#1 and #2).  Material test reports for the steel plate and round bar material used for fabrication are attached in PDF format.  For both materials the tested tensile yield strength (from the MTR) exceeds the value used in design calculations (from Document-184431):  117ksi vs 100ksi for the plate material;  138si vs 103ksi for the round bar material.

On February 8, 2021 both plate and pin assemblies were load tested by David Wang and Frank Song.  The total load applied to each was 31,400 lbs (as per the ISAC target hall crane load cell) which exceeds the 125% of rated capacity (31,250 lbs) required for the test.  The lifts were conducted successfully and no deformations or other damage to the assemblies were observed.  Photos of the load test are also attached.

Both plate & pin assemblies are now certified for use up to their rated capacity.  As specified on drawing ITA6550 and in Document-184431, a monthly visual inspection must be performed to check for structural deformation, cracks, excessive wear, and loose or missing fasteners.  In addition, an annual inspection must be performed to check for structural deformation, cracks, excessive wear, loose or missing fasteners, and missing or illegible markings or safety labels.  A written record of the annual inspection must be documented and kept readily available.

 The East Entrance Module has been moved from the East Target Station to the South Hot Cell.

 ITE water flow wheels and coils are replaced. Wheels and coils on Oven, Tube, HS, EE, MSP, Febiad coil, containment box window, dump, dump plug, 2A window, and tank return circuits are replaced with new parts.

First thing I entered into the NHC to install to the target kart mounting clip, and remove excess tools and materials from the hotcell

After the TM3 without a target was lowered into the NHC.

Once inside, with the use of the manipulators, I was able to remove the containment box door, place it on the swivel arm, move the arm out of the way, after the door was return to the containment box and reattached.

 The North Hot Cell gas delivery lines (labeled 1, 2, and 3 on the hot and cold side panels) were leak checked today.  5psi helium gas was applied to each line in turn with the appropriate solenoid valve opened and a Staubli connector with plastic tubing and the leak check wand attached to the matching connector inside the cell.  The end of the wand was sealed using tape.  The Agilent G8601 leak detector was used on "sniffing" mode to check for escape of helium gas from all joints and connectors.  With the sniffing line attached the leak detector test port pressure was 3.9E-1 Torr and the baseline leak rate was 1.7E-6 Torr*L/s.  There was no response while testing all of the three lines.  For all three there was a leak detector response after disconnecting the Staubli fitting, which confirmed that the lines were properly charged with helium.

TM3 has been moved from silo to NHC. The move is successful. NHC ram stand and NHC protection railings are checked and installed. Everything works fine.

2021-03-05. TM3 has been moved from NHC to silo. The move is successful.

ITW water flow wheels and coils are replaced. Wheels and coils on Oven, Tube, HS, EE, MSP, Febiad coil, containment box window, dump,dump plug, 2A window, and tank return circuits are replaced with new parts.

TCS leak check: TCS IG1S1.6 XE- 6 torr. LD  0.0XE-9atm.cc/sec.We used a long pole to spray helium to TCS vacuum seals on diagnostic box and vessel body. Lots helium have been sprayed around the check area.  no leak has been found.

 David and I disconnected entrance module in ITE by following the procedure # 190510. And, the yoke was installed and left on for remote handling later. 

Edi and I inspected roughing pump ITM MP1, primary backup pump ITHMP1, and secondary backup pump ITHMP2. We checked oil level and color on all pumps.  Refilled lubricant to ITMMP1. ITHMP1 and MP2 oil level is fine. ITH MP1 oil color is darker than MP2. But, both them are ok still. Shielding block has been restored after the job.

TM3 old source tray, old target hall high active water resin tank, and  old 2A window RH clamp are transferred from TH to cyclotron lower vault basement 10 and 10A location for storage. They are placed beside and in front of old TM1 and TM2 source tray boxes which stored there in 2018. 

ITE TP1S new pump is installed today. Reset pump life time on controller to 0 hr.

The crane pendant for the main hoist was upgraded to a FLEX EX2 style pendant by Canco Cranes. The installation work was performed by Matt at Canco, supervised by Tom Kauss, David Wang, and Adam Newsome. Installation work was performed in two phases since the initial installation did not provide adequate range and an antenna issue needed to be resolved (I2021-01-14-1, and I2021-02-16-1).

Items installed include:

• New pendant
• New antennae
• New receiver box, mounted on main crane control panel in the crane control room

The old receiver control box will be kept for some time in case there is a need to revert to the previous system for some reason.

The new system was tested by David Wang - including using the pendant at the far end of the target hall where range was previously an issue. Everything is reported to be in working condition. Remote mode is functioning as expected.

Vacuum cleaned ITW and ITE station. 

 TM2 at SMP under vacuum. TM4 at silo.  Frank and I did the tests. Everything is fine on TM4 check.  On TM2,  all mega test at 500V are around 200K ohms which is so abnormal. We will move TM2 to TCS and  start investigation there.

Old resin can:  0.5 meter 360 degree rotation above silo area, 350u sv/hr.   On contact  3.0 to 3.5 msv/hr.  It was replaced during 2017 winter shut down, and stored in silo since then.

2a window RH clamp: 0.5 meter, 160 usv/hr.  On contact, hottest spot 3.5msv/hr, general,1.8 msv/hr. 

 Both of them were raise out of storage silo with TH crane. Pole monitor was used for field check.

TM4 is moved from TCS to SW silo. The moving is smooth.

High active water are purged to holding tank at B2  level. There should be around 48 gallons are purged out of system. No purging on dump circuits on both ITW/ ITE.

Ramp up ITW bias to 57KV. no spark. 200uA leaking current at 57KV. The test is done without target module in station.   ITW water circuits are looped in pit.  EE , EL are switched off during the test. 

Cables were disconnected for steers in containment box. The Megga measurement (500V) result from the top of the module:

Left to right: OL, left to top OL,  left to bottom OL, right to top OL, right to bottom OL,  Top to bottom OL. And all of them to ground are OL.  No short on cables from module top to steers itself. The short should be inside the steers. It will be confirmed with directly test on steers.  

ITE annual HV test is done. No module in station. The bias power supply has been ramped up to 49KV on control page. We still have voltage limit issue on this PS at 48KV so it only can go to 47.7 KV on PS panel. No major spark during test.. The test result is same as last year test which was did in March 2020. 

 TM#2 with Nb#9 was moved from ITW to SHC and then with no target it was moved from the SHC to the SMP.

ITW primary and secondary vacuum vessel leak check are done. There is a 5XE-8 atm.cc/sec leak on Exit service cap NW side square panel.  The leak is small. And, it is close to ITW TP3 so it is not affect ion beam line vacuum during operation. We will replace the seal on the panel later.   The rest leak check on air to vacuum seals are good. TM2 water lines are pressurized with 70 psi helium. We did it  3 hours after water lines are purged. No leak was showed during the check.

2021-02-24th: The o-ring on exit 1 NW side square panel is replaced by David Wang and Frank Song. 

 TM#4 with Ta#61 has been moved from the east target station to the south hot cell.

Frank and I finished ITE and TM4 primary and secondary  vacuum vessel  leak check.　ＬＤ　ｂｅａｓｅ　ｌｅａｋ　ｒａｔｅ　０.０ｘ－９ａｔｍ．ｃｃ／ｓｅｃ．　Ｎｏ　ｌｅａｋ　ｈａｓ　ｂｅｅｎ　ｆｏｕｎｄ．Ａｌｓｏ，　Ａｌｌ　ＴＭ４　ｗａｔｅｒ　ｌｉｎｅｓ　　ｈａｖｅ　ｂｅｅｎ　ｐｒｅｓｓｕｒｉｚｅｄ　ｗｉｔｈ　７０ｐｓｉ　ｈｅｌｉｕｍ　ｆｒｏ　３　ｍｉｎｕｔｅｓ　ｏｎ　ｅａｃｈ　ｃｉｒｃｕｉｔ．　Ａｌｌ　ｗａｔｅｒ　ｌｉｎｅｓ　ｉｎ　ＴＭ４　ａｒｅ　ｇｏｏｄ．　Ｎｏ　ｒｅｓｏｐｎｅ　ｏｎ　ＬＤ　ｄｕｒｉｎｇ　ｔｅｓｔ．　

TM3 was remotely moved from the South Hot Cell to the conditioning station. No containment box.

24/Noc/2020

USB was discovered to be in the reverse direction and will need to be change around to become operational

01/Dec/2020

USB was pulled from conduit

While attempting to re-pull the USB in the correction direction, the ethernet cable was damaged and need to be replaced,

(thanks to the Hubert's team for the wire help) 

It was decided that it was too problematic to re-pull the wires with all other wires in the way. Therefore all the wires were removed from the operator control panel, and pulled so that the USB, USB power cord, and ethernet could be re-pulled all together.

However, even once all the wires were re-pulled and reconnected it was discovered that the USB had become damaged, and was removed again.

23/Dec/2020

- A new conduit was added through to the NHC, for only the USB

- USB was fed through, reconnected, and tested

- Putty will need to be added around the conduit to ensure a good seal into NHC

The Target Hall Crane has been shut down in preparation for the power outage tomorrow (Dec 22). Power will be restored on Dec 23.

Dec 23 update: power has been restored. The crane appears to be in working condition as there is no fault indicator on the PLC.

TM3 was remotely moved from the conditioning station to the South Hot Cell. No containment box.

TM3 has been moved from the South Hot Cell to the Conditioning Station. No containment box.

TM3 has been moved from the Silo to the South Hot Cell.

TM2 has been connected to ITW. Turbo pumps are stared. ITW pumping down is fine so far.

TM2 has been moved from the Conditioning Station to ITW. 

C#2 has been moved from the south hot cell to the spent target vault. It is in spot 8A of the vault in pail # 235 and was 185 mSv/hr upon removal from the south hot cell.

The Target Index spreadsheet has been updated on DocuShare.

LD 0.0 Xe-9 atm.cc/sec , 70 psi helium 3 minutes.  No leak.

Everything looks good. A still short to P before target installation. We will float P,Q as before on module top.

TM2 has been moved from ITW to the South Hot Cell.

Reading at ITW: 114 mSv/hr

Reading at SHC: 85 mSv/hr

 UC#31 has been moved from the south hot cell to the spent target vault. It is in spot 8B of the vault in pail # 224 and was 3.71mSv/hr upon removal from the south hot cell.

 TM#4 with Ta#61 has been moved from the south hot cell to the east target station.

TM2 old source tray and TM4 optic tray are stored together in vault tray#9. The fielding measurement at SHC post 0.5 meter distance:
 

March 1st 2019, maximum 14.6msv/hr, minimum 4.78 msv/hr

Nov 2nd 2020, max 7.11m sv/hr, min 2.5msv/hr.

 TM#4 with UC#31 has been moved from the east target station to the south hot cell.

 Targets Ta#48,51,54 SiC#35, and UC#25 were repacked and placed in the mini vault. In the following order back to front. SiC#35 (240), Ta#54(241), UC#25(244), Ta#48(243), Ta#51(242).

Also during this repacking Ta#60 was also placed in the Spent Target Vault in spot 7B in pail# 239.

The were issues with both left and right master ratcheting;

- the left handle was getting stuck in a close position when there was a higher ratcheting tension added

- the right ratcheting was not tightening preventing proper use of the manipulator

Chad and myself were able to identify a missing set screw for the tong cable.

Once this was added the issue with the left master ratcheting seems to be solved.

Lubricant was added to the left master ratchet and this seems to solve this problem as well.

There was also an observation of missing set screws on the spare manipulator for attaching the wrist to the ratcheting handle, which will need to be ordered and attached.

 TM#2 with C#2 has been moved from the south hot cell to the West Target Station.

TM2 electrical check and leak check are done at SHC with C#2 target installed. The results are good.  

 TM#2 with Ta#60 is now in the south hot cell.

 TM#4 is now back in the east target station.

 TM#4 is now in the south hot cell from the east target station.

 TM#3 is now in the south hot cell.

Tm4 UCx 31# electrical check result. See attachment.

 Module move of TM#4 with UC#31 was finished to today at around 10:30AM.

Left (short) is switched with bottom. So on module:

Frank and I removed the panel, disconnected the "Left"cable  inside panel,  and checked  cable to ground resistance. "Left "is dead short to ground on ohmmeter check still. So the short could be on cable or inside source tray.  Further investigation is planned to confirm the short  location.

Both helium spray and helium pressurize on TM4 HS line withUCx31 target are done at SHC and TCS. No leak.

 UC#30 has been placed into the spent target vault, it was placed in pail 238 and in spot 1A of the vault. It was 81.5 mSv/hr when removed from the south hot cell. 

UCx#30 has been removed from TM#4 and put in a can with argon. 5(10) pin connector had to have guide screws removed to be uninstalled.

UCx#31 P2N installed.

 TM#4 with UC#30 has been moved from ITE to the south hot cell.

 Both the west entrance module and TM#2 with Ta#60 have been moved back into ITW.

 The West Entrance module has been moved to the south hot cell for repairs.

Arthur installed a new Magna Power PS for the TGHT yesterday. The old power supply has been moved to Evaporator 2. The power supply was configured for remote operation and tested successfully with low current (30 A).

 Graphite #1 along with the broke 2A2M19 wire scanner have been placed in the spent target vault see attached PDF for deatails.

Refilled TCS:TK2 from 10 in to 22 in using the newly installed valve.

Helium pressurize on TM2 HS line at TCS is done.    Base LR is 0.0X E-9 atm.cc/sec.  70 psi helium 3 minutes.   No response.   Also, The TCS vacuum pumping down over night is good. 

Electrical check and leak check at SHC. NO leak. electrical check ok.   Before target on, A is short to PQ, RU is short to HS ( 60KV bias) as we measured before.

 TM#2 with Graphite #1 has been moved from the conditioning station to the south hot cell.

Entrance Module was moved from South Hot Cell to ITW Station.

Note: weight of entrance module, as shown via overhead crane's load cell, is 14,900 lbs.

ITW Entrance Module was moved from west station to South Hot Cell.

TM2 was moved from ITW to the Conditioning Station.

Tm2 and itw entrance module have been disconnected in ITW. I will attach disconnection checklist later.

A relay contact-based interface module was installed in between Safety Group's storage vault door enable junction box and Remote Handling's control module for the vault door.

The purpose of this module, which contains a diode bridge and relay, is to isolate the safety system from the control module to prevent back-voltage on the safety system which can damage the PLC's power supply.

In the new configuration, rather than receiving a 24 VDC signal from the safety PLC, this signal activates the relay, whose normally closed contacts supply 24 VDC (from internal) to the safety relay inside the control module. Wiring was modified inside the control module to account for this change.

In investing how to achieve the same functionality as before this change, it was determined that the control module's electrical schematic was not correct and did not reflect the actual wiring. A new schematic was created for this based on the actual wiring, including new changes.

The system was tested by locking out the target hall, and verifying that:
- No failure occurred on the power supply for the safety PLC
- This new relay actuated when the target hall was locked out (i.e. received signal from PLC)
- This new relay correctly supplied 24 VDC to the safety relay within the control module, allowing for the Opto-22 control unit to output control signals to the motors

Note: currently the soft limit switches for the vault door close/open have been bypassed. This is not a safety issue; the door can still be fully opened and closed remotely (but the open override and close override buttons are rendered useless). The bypass will be rectified in the coming weeks and this e-log will be updated accordingly.

Edit (Aug. 13, 2020): the issue regarding the limit switches has been resolved. The entire system is functioning as it was prior to the safety interface installation.

 TM#2 with Graphite #1 has been moved back to the west target station from the conditioning station.

 The West Entrance module has been moved from the south hot cell back to the West Target Station.

Entrance module wire scanner has been replaced. Pictures to follow.

 The West Entrance module has been moved from the west target station to the south hot cell for repairs.

 TM#2 has been moved from the west station to the conditioning station. ITW entrance module moved will take place on Monday morning. 

The emergency close mechanism for the Storage Vault door was tested by Adam Newsome and Travis Cave. The door was opened to its fully open limit, then closed with the emergency system.

The test was successful.

An electrical systems check was performed on the SMP by Adam Newsome and Travis Cave. Overall, there were no issues to note. The following is a summary of the inspection (Work Permit I2020-07-16-1):

- Checked condition of wiring for physical/radiation/UV damage
- Checked for cable tray debris or damage
- Checked inside control panel: components and wiring, labeling
- Verified camera views
- Checked connectors for damage
- Checked pendant for damage and verified labeling intact
- Checked limit switch wiring and condition

 TM#3 has been moved from the conditioning station to the silo.

Tested RF from RF driver into new IGLIS wires at ITE. Used 5V, 1MHz (2MHz setting because of internal halving issue).

As expected there was a very slight mismatch visible (original cable ~ 68 Ohms, new cable ~ 53 Ohms).

The matching resistor will be changed and it will be retested.

 TM#3 has been moved from the silo to the conditioning station, where David and Frank will start on the gutting of the module.

Five shielding blocks are transferred to ITW

TM4 has been connected in ITE. Vacuum pumping down is good so far.

 TM#4 with UC#30 has been moved from the south hot cell to the east target station.

Electrical and leak check are good. See attachment.

UCx#30 has been installed onto TM4 with new high current fasteners torqued to 130 in lbs.

PQ SHORT TO RU. A TO PQ 1.8 M OHM AT 500 V. THE REST ARE OL

SEE ATTACHMENTS. EVERYTHING IS GOOD.

 TM#4 has been moved from the east target station to the south hot cell.

ITE venting is in processing.

ITW TP1 can not be started yesterday. Also, TP1S was difficult to start , and had a high current draw after.  We changed both of them in pit today. TP1 and TP1S are started successfully after replacement.

An inspection was performed on drive systems for both storage vaults (main and mini) by Adam Newsome and Dan McDonald. The functionality was not tested. Overall, nothing concerning was discovered.

Main Storage Vault:

• Chain inspected (OK) and lubricated
• Gearbox inspected - OK
• All drive system set screws checked and tightened (note: chain drive screw slightly loose)
• Sprocket alignment checked - OK
• Limit switches checked - OK
• Emergency close mechanism cable checked - OK

Mini-Storage:

• Chain inspected - OK
• Set screw checked - OK
• Gearbox inspected - OK (need inventory/spare in stock)
• Roller wheels checked - OK

 TM#2 with the graphite #1 target has been moved from the south hot cell to the west target station.

Dan and I did the SMP annual  maintenance service today. Lid open/close , vessel rotation and limit switch check, lubricate chains, tighten fasteners, and visual inspection.  Everything works fine.

ITE TP3 is replaced. ITE is under vacuum again. All turbo pumps are started successfully. Current draw on pumps are normal so far.

TM4 has been disconnected in ITE. Vacuum pumps and gauge are not disconnected yet.

Remotely remove TM2 from ITW to SHC. The move is good.  Shielding plug is put back to ITW.

 TM#2 with the graphite #1 target has been moved from the south hot cell to the west target station.

Target to HS is 400 ohm. The rest check is good. See attachment.

Target C#1 has been installed on TM4 with new high current fasteners torqued to 130in lbs.

 TM#2 with no target has been moved from the south west silo to the south hot cell.

  ITW - 2A2

o    2A2DSP-TC3 - not connected in El room

o    2A2COL-TC2 - does not work inside module

o    2A2COL-TC3 - does not work inside module

·         ITE - 2A3

o    2A3COL-TC3 - works, but plug needs repair in ITE pit

 Anders and I checked ITW and ITE thermocouple status. See result above.  Frank and I will fix the 2A3COL-TC3 loose cable to plug issue.

Jason Sargeant mopped up TH floor this morning. The mop head was checked after the job. There are 1500 counts on it. He think this level is reasonable low. 3000 counts would be normal in past.

Three manual valves are closed on TCS water system return line in experimental hall. See attachments. It is for TCS TK2 water level slow drop trouble shooting.  These valves will be opened again right after troubleshooting.  

TCS TK2 water level no change(11.1 inches) in this week after valves are closed. I will keep these three valves closed for one more week.

I opened these valves. In two week times, The TK2 level dropped 0.1 inches. The water level change could be a result of evaporation of water in system. We will keep watching on it.

Edi calibrated ITH:CM6, CM6S and ITM:CM3. By the same time,  ITH:MP1 and MP2  lubricate oil level are checked. Everything looks fine. No oil  leak on both pumps. 

Tom Kauss corrected the TH crane  festoon cable loops. He lubricated festoon cable wheels as well.    The maintenance is done.

A water leak was found on a fitting connecting ITW dump return line pressure gauge on top of exit module. TM tank flange, o-ring slot and o-ring were contaminated by water and water rust. Frank and I cleaned the flange and o-ring slot . We changed a new TM tank o-ring, vacuumed around other 3 module flanges. The leak fittings with pressure gauges were removed . I put a blind cap on removed fitting spot.. Water are switched back to ITW. No leak on blind cap.

Sorted and packed one 55 gallon drum with low contamination and active stuffs which are placed around silo area in the past. They include old poly water cooling lines replaced from ITE, ITW and TCS, contaminated paper  rags , gloves, and plastic bags,air cooling fans for turbo pumps, EE resistor packaged used on module top before, flow meters and cables used in ITW, etc. After packing, The field outside the drum on contact is less than 10 usv/hr.

PLC6 drop out in weekend caused the ITH MP1 and MP1s stopped. ITE turbo pumps were running still after that. Without back up pump, TPs started to trip off  later .  I found TP1,TP3, and TP4 were  tripped off this morning. And , The rest pumps ran with high current draw.  Jon Aoki restarted back up pumps and ITE turbo pumps. The ITE vacuum system works fine now.

High  active water pump is started. The system resistance is recovering now. Everything works fine so far. Check ITW and ITE water leak after pump is started. Tiny very slow seep on two small ball valves pack seal. No big concern.                                 

 This is a link to all of the issues with the NHC manipulators that I know of

https://documents.triumf.ca/docushare/dsweb/View/Collection-27663/Document-180176

Filters were replaced by Curtis von Cube on March 5th. See work permit for details I2020-03-05-5

TM4 has been connected in ITE. See checklist.

They work fine. Current draw on all pumps are normal. I asked operator to switch on IG1 , IG1S and PNG4.

See attachment. Everything looks good.

 TM#4 with the P to N target has been moved from the south hot cell to the east target station.

 TM#4 has been moved from the silo to the south hot cell.

 The east entrance module has been moved from the south hot cell back to the east target station.

The broken pieces in ITE entrance vacuum pit are vacuumed out.  At SHC, There are 4 pieces on module collimator block top,  wiring scanner top. Chad removed them out at SHC. Electrical check at module top is done by diagnostics group. Everything works fine.

New IGLIS cables installation is done. Two bundle of new cables are pulled from ITE to electrical room. They are in one PVC conduit. The old cables are not removed yet. I will pull old cables out when new cables are installed onto device in ITE Faraday cage.

 The entrance module has been moved to the east station to the south hot cell for inspection from the turbo pump explosion.

Frank and I did the test.  The emergency exit hatch on roof was opened and closed twice. Everything works fine.

TM2 was moved from SHC to SMP yesterday.  The move is successful. TM2 is located at SMP. There is no hot target on module so SMP vacuum is not started.

Spent target SiC#39 is removed from SHC to storage vault at 4C in pail #227.The move is successful.  Note:The small aluminum block holding wire on pail lid could be contaminated by SHC manipulator during the lid installation in SHC.

 Electrical check result is fine.  See attachment.

Frank and I removed TM2 from SMP to SHC. The move is successful.

ITE bias test is done to 48KV. No spark. We can not raise bias above 48KV. It looks like we have a current limit issue on control system when testing above 48KV.  John Cow checked current limit on PS locally. It is set to 8mA which is much higher than the test current. Isac operator issued an e-fault to control group.  

 John Chow did a local test on PS. Everything works fine.The problem is on control system. We have a 48KV voltage limit problem on control system. We decide to end the test now. 48KV is good enough before this year mini-shut down.