Logbooks Lab Maintenance Evaporator_1 Evaporator_2 Laser cutter Target Production Test-Stand RH-ISAC RH-Cyclotron RH-Meson Hall RH-Beamlines RH-ARIEL
  RH-Meson Hall, Page 17 of 18  Not logged in ELOG logo
Entry  Friday, March 11, 2022, 15:09, Adam Newsome, Maintenance, Target 2, Cooling, Filters replaced: T2 cooling system 

All filters were replaced for the T2 cooling system: demineralizing resin circuit and target water system.

Entry  Monday, March 14, 2022, 14:08, Adam Newsome, Maintenance, Target 1, Cooling, T1 cooling system: filled, tuned, leak-checked 

The T1 cooling system was refilled with water via the expansion tank until the tank level read approximately 38 cm.

The system pump was restarted. All sensors displayed acceptable nominal values. Demin flow was tuned to 1.0 gpm.

 No leaks or abnormalities observed - system running normally.

NOTE: the needle valve for demin flow control adjustment was behaving strangely - it needed to be tapped when loosening to increase flow in order for results to be observed. Suggest replacement next shutdown (2023) - a calendar reminder was set to do this.

Entry  Monday, March 14, 2022, 14:09, Adam Newsome, Maintenance, Target 2, Cooling, T2 cooling system: filled, tuned, leak-checked  

The T2 cooling system was refilled with water via the expansion tank until the tank level read approximately 38 cm.

The system pump was restarted. All sensors displayed acceptable nominal values. Demin flow was tuned to 1.0 gpm.

No leaks or abnormalities observed - system running normally.

Entry  Wednesday, April 13, 2022, 12:31, Adam Newsome, Standard Operation, Target 2, Target, T2-MK2 moved: from target station to storage 

The T2-MK2 target was moved from the target station to the storage area (position 3). Upon removal, it was measured with a pole monitor at 0.5 m to be 960 mSv/h.

Entry  Wednesday, April 13, 2022, 12:33, Adam Newsome, Standard Operation, Target 2, Target, T2-MK1 moved: from storage area to target station 

The T2-MK1 target was moved from the storage area (formerly position 4) to the target station. Services were reconnected in order to prepare for normal operation.

Entry  Thursday, April 14, 2022, 14:38, Adam Newsome, Other, Target 2, Diagnostics, Issue with Protect Monitor SHV Cable PXL_20220414_210238000.jpgPXL_20220414_210053641.jpgPXL_20220414_210037717.jpg

Diagnostics group (Shengli Liu) noted a lack of connectivity between control panel and T2 Protect Monitor via the high voltage cable. Upon inspection it was noted:

  • The cable was very brittle due to radiation exposure and it was cracking in multiple places
  • In the SHV connector, the pins were slightly bent (bending them back into position seemed to rectify the connectivity issue).
  • The cable was bent at the strain relief junction

RH Group has advised that Diagnostics replace the entire cable as soon as possible. For now it appears to be working.

Entry  Wednesday, May 04, 2022, 11:27, Adam Newsome, Standard Operation, Target 2, M9, M9 and M20 Beam Blocker Actuation Test 

The beam blockers for M9 and M20 were actuated, and vacuum was monitored to ensure no disruptions. Both actuation tests were successful. Motion was observed and no abnormalities noted. Cabling and air connections checked: OK.

 

Note: there was a safety interlock issue with M9 which prevented actuation - a relay or fuse was temporarily removed from the safety system ~10 years ago but it was not replaced. It was replaced for the purpose of this test, and then removed again.

Entry  Thursday, May 05, 2022, 14:38, Adam Newsome, Maintenance, Target 2, Controls, T2-MK1: profile monitor actuation check and repair to connector T2-MK1_prof_mon_connector_-_rear_-_after_fix.jpg

An attempt was made to actuation the T2 profile monitor, however it showed up in EPICS as being not present. Furthermore, the "Remote" indicator light on the physical controller was not lit up despite the switch being in remote mode. The limit switch indicator light was working.

 

Upon troubleshooting with Erwin Klassen, it was determined that a jumper was missing on the profile monitor control connector (on the target end, rear of bulkhead). The jumper shorts pins A and G on the mil-spec connector on the controller end, which is for 120 VAC supply, to indicate that the device is connected. T1-MK1 was checked - this jumper was present on T1-MK1, across pins E and F of the mil-spec connector, but was not present on T2-MK1. Otherwise the connectors were identical. It is suspected that it was accidentally omitted during maintenance in the past. Regardless, a new jumper was soldered in-place on T2-MK1 across pins E and F to replicate T1-MK1. The system functioned normally after this.

 

Attached photo shows the completed solder job - the current state of the connector on the rear side of the target bulkhead panel.

Entry  Thursday, May 05, 2022, 14:39, Adam Newsome, Standard Operation, Target 1, Target, T1-MK1 and T2-MK1 profile monitor actuation test 

The profile monitor actuation tests were completed for T1 and T2. No abnormalities were noticed in vacuum during either test.

 

Note: an issue was observed with T2-MK1 - see e-log 290. The issue was resolved.

Entry  Wednesday, May 25, 2022, 10:15, Adam Newsome, Standard Operation, Target 1, Target, T1-MK2 moved from hot cell to storage area 

The T1-MK2 target was moved from the hot cell to the storage area, in position 5. Note: manual nudging of the flask was required to get it to align with guide pins properly.

Entry  Wednesday, May 25, 2022, 10:16, Adam Newsome, Standard Operation, Target 2, Target, T2-MK2 moved: from storage location to hot cell 

Target T2-MK2 was moved from the storage location (formerly position 3) to the hot cell in preparation for replacement of end of life targets.

Entry  Wednesday, June 08, 2022, 08:59, Adam Newsome, Other, Target 2, Cooling, T2 flow rate sensor (BL1A:T2CS:FGTGT ) - warning and trip limits adjusted After_Adjustment.PNGSensor_data_around_June_6-8.PNG

See fault 14966: https://web.accel.triumf.ca/ncr/dbfault.pl?faultgroup=CYCLOTRON&faultno=14966&btn_submit=Getfault

The flow rate sensor for T2 target cooling was exhibiting some instantaneous drops below the warning threshold, causing nuisance warnings. It was also dropping quite close to the trip limit. The reason for this unknown and this is unexpected since the sensor was recently replaced this winter shutdown.

 

Until the problem can be figured out and resolved, Ops has lowered both the warn and trip threshold values to 3.0 gpm and 2.8 gpm, respectively. This was done mid-day on June 7. This has been done in the past and is deemed safe to do as it is still within normal operating parameters (and a defeat is not required). The main reason for doing this is to reduce the chance of an accidental trip if the flow rate were to drop below the previous trip threshold of 3.0 gpm. These noisy blips do not seem to be dropping below 3.0 gpm, although they are close (see attached screenshot of June 6-8 data). The sensor history will be examined weekly, and if there are no drops below 3.0 gpm, these thresholds should be adjusted back to their regular values.

 

Entry  Wednesday, July 06, 2022, 12:49, Adam Newsome, Repair, Other, Hot Cell, Hot Cell - Helium wand tubing broken 

The tubing for the helium wand inside the hot cell is broken and needs to be replaced. More tubing has been ordered and the job will be completed in the coming weeks.

Entry  Wednesday, July 06, 2022, 12:52, Adam Newsome, Other, Other, Hot Cell, Potential hot cell window oil leak 

Some oil was noticed around the hot cell window, on the control panel, and on the ground below the control panel. A leak is suspected.

 

Suggest tightening all bolts to specified torque along the window, and monitoring overflow oil level (position today was marked). If the problem persists, the gasket must be replaced. Note that the gasket should likely be replaced anyway as it has not been done for some time.

Entry  Thursday, July 28, 2022, 12:51, Adam Newsome, Repair, Other, Hot Cell, Meson Hall Hot Cell - Nuclear Ventilation Issue 

It was reported today by Peter Bratt that the nuclear ventilation system for the hot cell is not functioning. At this time, the cause of the issue is unknown. Remote Handling and Electrical Services are investigating. This e-log will be updated when the issue is resolved.

 

Update: the issue was caused by worn belts which had been smoking. The belts must be replaced.

Entry  Monday, August 22, 2022, 09:01, Adam Newsome, Standard Operation, Other, Active Sump, Active Sump Draining 

On Aug. 18, 2022, Operations informed RH group that an alarm activated for the full status of the MHESA B1 RCR1 Lab holding tank. Additionally another alarm was reported in the RH control room regarding the RH sump full (Southwest Meson Hall Extension - Remote Handling area). However, there is an alarm signal for the RH sump that was seen as OK at the MHESA Lab HMI.

Upon examining the RH active sump it was clear that the water level was in fact quite high, and the red warning light on the local control box was on.

After sampling and testing by RPG the sump contents were released under work permit C2022-08-19-3 as per the procedure in Document-64834. The approximate volume of the full sump is 7270L.

When the water level was below the warning threshold (i.e. red warning light came off, and green light indicating "sump good" came on), a request was made to the control room to reset the alarm. Operations cleared the alarm at the RCR Lab controls and retired the signal defeat that was in place in the DCR (“RCRL warn” signal was defeated).

 

Edit (2022-08-23): BL1A holding tank water level was checked - it is empty.

Entry  Tuesday, August 23, 2022, 14:36, Adam Newsome, Standard Operation, Other, Other, BL1A Holding Tank - Level Check 

The water level inside the BL1A active water holding tank was checked today (Aug. 23, 2022). The tank is essentially empty at this time.

Entry  Tuesday, August 30, 2022, 14:24, Adam Newsome, Maintenance, Other, Hot Cell, Nuclear Ventilation - Filter Change 

Mechanical Services Group changed the pre-filter in the ventilation system on Aug. 29, 2022 as per work permit C2022-08-29-2.

 

It is recommended that Mechanical Services change the HEPA filter as soon as possible. These filters are on order with approximately 7 month lead time. 

 

Edit: as of 2023-05-03, the HEPA filter has been changed.

Entry  Thursday, September 15, 2022, 14:34, Adam Newsome, Standard Operation, Target 2, Target, T2-MK2 target elevations measurement T2-MK2_-_Sept_2022.pdf

The target elevations measurement and beam spot checks were completed on Sept. 15, 2022. This was done after a July 2022 target exchange for target positions 3 and 5.

 

Updated target elevation drawing can be found in DocuShare (Collection-33652)

Entry  Tuesday, October 04, 2022, 09:59, Adam Newsome, Maintenance, Target 2, Cooling, T2 cooling package maintenance - mini-shutdown 2022 

The following maintenance tasks were performed during mini-shutdown of 2022 with the goal of resolving the Fault 14966 (target water flow rate low).

  • Replace the o-ring, paddle wheel, and shaft on the following flow rate sensors:
    • Q1 (FGTGT)
    • Q2
    • Q4
  • Replace the demineralizing flow metering valve with a new needle valve (the old one was flaky and appeared to occasionally restrict flow)
  • Re-tune the demin. flow to 1.15 gpm
  • Top up the expansion tank due to water loss during the maintenance job (from 27.1 cm level to 34.8 cm)

To test the theory that the demin. flow metering valve was faulty and had an effect on the target water flow rate during operations, the valve was closed to determine if it stopped flow to the target. The result is that it did not, and only flow in the demin. circuit was affected. Therefore, it is likely that the root cause of Fault 14966 was not due to the demin. metering valve, but rather an issue with the pump, heat exchanger, pressure in the lines, or another form of obstruction. It should be noted that when the pump is turned off, all flow rate and pressure sensors drop to zero (except the pressure sensor located in the BL1A Service Tunnel) - so if the fault occurs again and symptoms show this case, it is likely that there is an issue with the pump intermittently turning off or similar.

As an aside: it is recommended in the future when changing circuit boards on the flow rate sensors to use metal screws instead of the plastic screws supplied with the parts.

 

Dose rates observed in the work area: 300-500 uSv/h at the target cooling package area, 1300 uSv/h at the target monolith area.

ELOG V2.9.2-2455