During the recent shutdown for the T2/M9 joint repair Graham Waters replaced the corrupted application code on the controller RAM disk.  The T1 target position control is now functioning properly.  T2 target position control is still not operational due to an electronics problem within the motor driver.   The T2 ladder position may still be moved using the portable control box.  The T2 target ladder was moved to position 3 (10cm Be) today in preparation for the upcoming running period.

 Repair of the west side manipulator in the west hot cell was completed today.  Part of the repair was done by entering the hot cell using double tank suits and supplied air.  The repair was then completed on the master side of the manipulator.  The manipulator is now operating smoothly.

Two sales representatives from Central Research Labs visited TRIUMF today as they were already in Vancouver on other business.  I showed them the RH Lab manipulators and received  hourly and daily service charge estimates if repair of the east hot cell (junk cell) manipulators requires one of their experts to come in.

- T1-MK2 target moved from storage pit to hot cell
- Removed unused proximity sensor and associated wiring (stored in tool-port boot box cabinet)
- Tested profile monitor actuation: seems stiff, but moves ok;  start travel @ 30psi, fully in position @ 50psi
- Replaced vacuum flange o-rings: Plug (#202), Feed-through port 1 (#222), Water supply tubes 1 and 2 (#208)
- Replaced all nylon ferrules for water supply tubes
- Leak checked water supply tubes: leak tight
- Replaced rusty nuts on profile monitor lift plate
- Profile monitor limit switch wiring replaced (D. Cameron)
- Heat shrink applied over motor wires (D. Cameron)
- Position micro-switch connectors replaced (D. Cameron)
- All wiring wrapped with protective coil and secured with PEEK zap-straps (D. Cameron)
- All limit and position switches tested: ok
- Profile monitor bellows straightened (noticed rotation of base seems stiff)
- T1-MK2 target moved to storage pit location #3
- T2-MK1 target moved from storage pit to hot cell for re-wiring

 

 The BL1A air amplifier has been shut down by closing the air supply valve on the device. The air amplifier supplies high pressure air (110psi) to the following devices: M9BB, M20BB, T1 Profile Monitor, T2 Profile Monitor, T2 Collimator, Septum Polarity Switch

- T2-MK1 target transported from storage pit to hot cell
- Proximity sensor removed
- Target lift "T" removed, painted, relabeled
- Replaced flange o-rings: Plug (#202), Feed through port 1 (#222), Feed through port 2 (#222), Feed through port 3 (#213), Water supply tubes 1 and 2 (#208)
- Replaced all nylon Swagelok ferrules
- Leak checked water tubes: OK
- All wiring above vacuum flange replaced, secured, inspected  (D. Cameron)
- Damaged lower MS connectors replaced  (D. Cameron)
- Discovered motor wire insulation degrading  (D. Cameron)
- Motor replaced and rewired
- Motor, position micro switches, and profile monitor micro switches tested: ALL OK
- Tested profile monitor actuation: Smooth (IN: start motion @ 5psi, fully actuated @ 20psi)
- Target lift "T" installed
- Feed through port cap #2 replaced with TBP0936 (old cap was makeshift part using weird gunk sealant)
- Upper and lower parts of target photographed
- Target ladder moved to position 0
- Target ready for use.  Will be transferred to storage pit hole #4

* Approximately 50cpm found on 44-2 monitor from wet wipe used to clean blue flanges surrounding hot cell entrance on HC roof
 

 The BL1A tunnel was accessed to drain and sample T2 cooling package water.  A puddle of water was noticed in the South TNF area around the drain by the boot-box.  No water was found in the BL1A tunnel.  Photos attached.

The T2-MK1 target (spare T2 target) was transported from the hot cell to the storage pit today.  

While the flask was being aligned to the storage pit locating pins, the base of the flask bumped the top of one of the alignment pins.  This was caused by a slight misalignment between the flask locating hole and the alignment pin at the moment when the flask was lowered.  This caused the target to swing within the flask and hit the inside wall of the flask.  

While the target was being lowered into the storage pit hole, it was observed that the profile monitor cassette had become loose from the impact and was protruding from its frame.  The target was raised back into the flask and transported back to the hot cell for inspection.

While lowering the target into the hot cell, the profile monitor cassette was protruding so much from its frame that it hit the target support ring on the hot cell turn table.  This caused the profile monitor cassette to come completely out of its frame and fall onto the hot cell table.  The cassette was damaged from the fall and appears to be unusable.  Probes Group is in the process of assembling a new cassette, which should be ready within the next few days.  They have requested that the damaged cassette be given to them so they can salvage parts (the cassette has not seen beam and should not be active).

The target was inspected and photographed and then transported to storage pit hole #4.  It is possible that the profile monitor frame was also damaged.

This mistake can be avoided in the future by working much more carefully and slowly when locating the flask on alignment pins and by completely removing all flask swing before lowering the flask.

 On January 15th, when attempting to move the T2 target from the beam line to the hot cell, the latch mechanism on the flask did not actuate and the target could not be lifted from the beam line.  

On January 16th the flask was placed on blocks (IMG_0818) (while remaining attached to the crane) in the RH hot cell lab for inspection.  The cause of the problem was found to be a damaged and disconnected military style connector (IMG_0824).  Damaged wiring was also found (IMG_0836).

On January 21st the connector and faulty wiring was replaced by Travis Cave, which fixed the problem (IMG_0838).  The new location of the connector is less exposed and should prevent it from getting damaged if the target swings within the flask.  Travis and Don Jackson also used the opportunity to check some wires on the flask that previously were not documented properly.  The flask was returned to its storage position in the lab and is ready for use.

The T2 cooling package water was drained to the BL1A active sump, refilled, cycled, and drained again.  Samples of T2 cooling package active water was given to RPG, tested, and approved for release.

On January 21 at approximately 4pm the full volume of the sump (280L) was released to the city sewer.

The T2-MK2 target was transported from the beam line to the RH hot cell.  The profile monitor was secured in the 'in' position before lifting the target, as it is better protected in this configuration.  This procedure will be used for all future target moves to reduce the risk of damage to the monitor.

The field on the target while lifting was approximately 5mSv/hr at 2m.  A field of 12mSv/hr was measured directly above the T2 target hole on the monolith.  A shield plug was installed into the hole which reduced the field to 500µSv/hr.

A section of the "montior" cable was found to have damaged insulation (photo attached).  Fortunately this cable terminates at the cooling package, so only a short section needs to be replaced.

- T2-MK2 target moved from beamline to hot cell (Feb 4th)
- Steel target support shield installed as well as ~3 layers of lead blankets.  Even with this extra shielding fields in the working area were as high as 800µSv/hr.
- Target flushed with water, then with air overnight to dry
- Target pumped out using cold trap (required 4 iterations to removed all water)
- Target lift "T" removed, painted, labelled 
- Unused proximity sensor removed and stored in tool port boot box cabinet
- Replaced o-rings for feed through ports #1, 2, and 3, as well as plug port
- Removed unused electrical feedthrough at port #3 and replaced with plug
- Replaced all nylon Swagelok ferrules on water supply lines
- Leak checked upper water supply lines, found Hansen fitting teflon tape needed replacing, then was leak tight

- Target wiring inspected by Dave Cameron, determined all wiring requires replacement including motor wires
- Removed target ladder drive motor, found motor coupling had degraded and was crumbling
- Ordered new aluminum flexible coupling (McMaster PN: 6208K511)
- Installed new coupling and replacement motor (See attached photo)

- Disassembled profile monitor upper cable housing, and inspected the o-ring under part SKRH1001B.  The condition of the o-ring was good. Bent pins found on Deutsche connector
- Deutsche connector was found to be installed with 2 o-rings in a single o-ring groove, neither was the correct size
- Reassembled profile monitor assembly using new Deutsche connector installed with nut side up for easier future removal.  New SKRH1001B part was used with polished o-ring surfaces.  New o-rings used with Apiezon M grease

- Re-wiring completed by Dave Cameron (March 12th) (See attached photos)

- Checked motor functionality, position microswitches, monitor microswitches:  All OK
- Actuated profile monitor: smooth travel, no bellows twist, fully engaged @ 20psi
- Installed lift "T", threads on support pillar B10106 required chasing
- Photographed target ladder and above vacuum flange
- Confirmed suspicion that part B10105 is undersized and was installed with an undocumented spacer between it and part D10390
- Added this spacer to Solidworks model of target (3/4" OD, 0.505" ID, 5/8" height)

- Leak checked water supply bellows and target cassettes: OK (scanned PDF of results attached)
- Target ladder left in position 0
- Profile monitor raised and secured in position for transport
- Target moved to storage pit location #5  (no standoffs on pit hole flange) (~1.8mSv/hr at 3-4m from target)  (March 15th)

- The old T2 heat exchanger tube array was moved to the storage pit while the blocks were off (placed between hole locations 12 & 13)

 The following work was performed on the T1-MK1 target:

- Unused proximity sensor removed
- Lift flange removed, painted, relabeled
- Seals changed for feedthrough #1, #2, plug port, and both water supply feedthroughs
- Seals (2) changed for feedthorugh #3 which required desoldering protect monitor connector and machining o-ring support tube
- Replaced nylon ferrules for water supply swagelok fittings
- Leak checked upper water supply tubes: all OK

- Target rewired by David Cameron (motor wires OK, micro switch wires were re-terminated, but not replaced)

- Installed lift flange
- Checked potentiometer, motor, micro switches, profile monitor limit switches: all OK
- Checked profile monitor actuation: smooth motion, travel starts at 10psi, fully actuated at 35psi
- Leak checked target ladder: results OK, see notes attached
- Noticed protect monitor wire conduit had dropped down from vacuum flange.  It is secure in current position and connector would have to be de-soldered to lift it, so decided to leave as-is.

- Target ladder moved to position zero
- Profile monitor raised to 'IN' position and secured for transport
- Target transported from the hot cell to the beam line

Note that after the target was installed in the beam line and vacuum was pumped down it required ~55psi to actuate the profile monitor.  Approximately 20psi more than when not under vacuum.

The T1-MK1 target protect and profile monitor electronics were 'blip' tested by Bill Rawnsley on April 5, 2013.  The response from the profile monitor appeared normal, however the protect monitor response was very weak.  After various debugging it was found that the 9 pin connector on the target on the vacuum side of the vacuum flange had become disconnected from the vacuum flange feed-through.  It is suspected that this happened while changing vacuum flange seals in the hot cell.  The connector was plugged in to the feed-through and reassembled.  The monitor was retested on April 8th and gave a normal response.

The lower air amplifier was started and actuation of the T1 profile monitor tested from the control room:  functioning normally.

Unused cables and hoses, concrete pieces, and various other garbage was removed from the top of the T1 monolith.  Spiro Wrap around the T1 profile monitor cable was replaced as it had degraded.

The T1 target is now ready for beam.

The T2-MK2 target was transferred from the storage pit to the beam line yesterday (April 16th).  The field was measured to be approximately 165mSv/hr at 0.5m from the target ladder (after approximately 5 months of cool down time).  Vacuum was started this morning and has pumped down normally (1ACG4 at 11mTorr after ~5 hours) indicating that the target is leak tight.  

The T2 profile monitor and protect monitor were 'blip' tested by Bill Rawnsley and Mike Russel from the racks on the Meson Hall mezzanine today.  The response from both monitors appeared normal.

T2 profile monitor and M20 beam blocker actuation were tested from the MCR, both devices actuated smoothly and all limit switches registered properly.

The T2 target is now ready for beam and the T2 monolith may be covered.

 The T1-MK1 target was leak checked on April 15th at the T1 monolith by Ron Kuramoto and Edi Dalla Valle.  No leaks were found.

The T1 and T2 profile monitors were used during today's development shift.  Target ladder movement for T1 was done at the panel on the mezzanine, for T2 the portable control box was used.  Both monitors actuated properly and the scans did not show any "missing" wires.  The profiles at both targets were found to be too broad and were adjusted to span 2 wires horizontally and 6-7 wires vertically (Yi-Nong Rao).

 Today (May 31, 2013) I was contacted regarding a burning smell and high temperatures around the T1/T2 controls racks.  Erwin Klassen, Bill Rawnsley, Graham Waters and myself investigated and found that the cooling fans for two power supplies on the T1/T2 control racks had failed and both units were warm to the touch.  The power supplies are labeled "T1 Power Supply" and "T2 Power Supply" in racks 1-F and 1-A respectively.  Bill Rawnsley measured temperatures as high as 90*C inside the power supply boxes using an infrared thermometer.

Small AC fans, supplied by Operations Group, were attached to each power supply behind the failed fans as a temporary measure (see photos).  Large box fans were also placed in front of the racks.  After setting up the fans the exterior of the power supplies were cool to the touch, and temperatures of about 50*C were measured inside the boxes.

The operators are aware of the situation and will check on the power supplies twice a shift over the weekend.  Repairs will be attempted on the next maintenance day.

 Replacement of the power supply fans for the T1 Power Supply, T2 Power Supply, as well as an additional power supply in rack 1A was completed this morning.  The boxes were blown out with air to remove dirt and dust.  The inside of all boxes were inspected and no evidence of melting or burning was found. 

After installation the output voltage was measured for each power supply using a multimiter on first the DC setting, then on the AC setting to check for fluctuation (as recommended by Erwin Klassen).  Results below: 

T1 Power Supply:  24.2V DC, 0.001V AC 
T2 Power Supply: 23.6V DC, 0.002V AC 
Other Power Supply: 24.2V DC, 0.004V AC 

The fans are all running properly, the power supplies are cool to the touch, and the T1 and T2 cooling packages are up and running. 

 Complete overhaul of all manipulators in the Remote Handling Hot Cell Lab in the Meson Hall was performed by Peter Dudley from Central Research Laboratories between October 28 - November 8th.  Overhaul included replacing all tapes and cables, disassembling, cleaning, lubricating, and rebuilding the master and slave wrist assemblies, adjusting motion locks, and other repairs/maintenance as required.  All 6 manipulator arms in the lab are now fully functional.  Pete reported that some cables from the manipulators in the west side hot cell were showing heavy wear, and cables from the other arms showed mild to moderate wear.

The highest amount of contamination was 1600cpm from a wet wipe on the inner slave boom on the west manipulator in the west hot cell.  Pete received a total dose of 0.10mSv as measured from DRDs worn during this period.

The temporary boot box area in the lab has been disassembled.  No contamination was found on the lab floor, tools, or manipulator removal cart.

- T2-MK1 target transported from the storage area by Isaac and Grant and installed at the T2 monolith.  All services were connected.  Storage pit covered.

- Edi began pumping approximately 10am, and was not able to pump below ~20 Torr.  Dimo came in to assist.

- The vacuum interlock was bypassed and the cooling package started to check for water to vacuum leaks:  No change in vacuum.

- Methanol was sprayed around the flange area to look for leaks, and a leak was found on the north edge.  A piece of black rubber was visible and it appeared that the o-ring was out of position and pinched by the flange.

- The beamline was vented, the target lifted approximately 1" w/o using the flask. The rubber was found to be a pad from the storage pit stand-offs that had become stuck on the underside of the T2-MK1 target flange.  This was removed.  The o-ring was in the proper position and undamaged.

- The target was lowered, and pumping restarted.  Only  around 4 Torr was achieved.

- The beam line was vented once more, and the target lifted approximately 6".  Both flanges and the o-ring were cleaned and inspected.  A small amount of dirt or grease was found on the wypall.

- The target was lowered and pumping restarted.  The beam line pumped down at the normal rate.  At approximately 200 mTorr a helium leak check was performed.  The top of the T2 monolith was flooded with helium and there was no response from the leak detector.

- It was observed that the "MONITOR IN" lamp was illuminated on the T2 control panel.  Isaac confirmed that the monitor was fully out and tested the limit switches, no change in lamp status.  Confirmed with control room that they have no warnings or interlocks from T2 that would prevent them from running beam.  It's possible that this lamp has always been illuminated even with the monitor out.

- Plant group began covering the T2 area at approximately 6pm

- The M20 beam blocker was tested after installing cap block, and actuated properly.

- The T2 target ladder was moved from position 0 to position 3 using the portable control box

- T2 expansion tank was topped up to 1/2" above the nut on the warning level sensor

- At 6:30pm 1ACG4 reads 150 mTorr and dropping slowly