Logbooks Lab Maintenance Evaporator_1 Evaporator_2 Laser cutter Target Production Test-Stand RH-ISAC RH-Cyclotron RH-Meson Hall RH-Beamlines RH-ARIEL
  RH-Meson Hall, Page 17 of 18  Not logged in ELOG logo
ID Date Authordown Category Type Specific Subject
  282   Friday, March 11, 2022, 15:09 Adam NewsomeMaintenanceTarget 2CoolingFilters replaced: T2 cooling system

All filters were replaced for the T2 cooling system: demineralizing resin circuit and target water system.

  283   Monday, March 14, 2022, 14:08 Adam NewsomeMaintenanceTarget 1CoolingT1 cooling system: filled, tuned, leak-checked

The T1 cooling system was refilled with water via the expansion tank until the tank level read approximately 38 cm.

The system pump was restarted. All sensors displayed acceptable nominal values. Demin flow was tuned to 1.0 gpm.

 No leaks or abnormalities observed - system running normally.

NOTE: the needle valve for demin flow control adjustment was behaving strangely - it needed to be tapped when loosening to increase flow in order for results to be observed. Suggest replacement next shutdown (2023) - a calendar reminder was set to do this.

  284   Monday, March 14, 2022, 14:09 Adam NewsomeMaintenanceTarget 2Cooling T2 cooling system: filled, tuned, leak-checked

The T2 cooling system was refilled with water via the expansion tank until the tank level read approximately 38 cm.

The system pump was restarted. All sensors displayed acceptable nominal values. Demin flow was tuned to 1.0 gpm.

No leaks or abnormalities observed - system running normally.

  286   Wednesday, April 13, 2022, 12:31 Adam NewsomeStandard OperationTarget 2TargetT2-MK2 moved: from target station to storage

The T2-MK2 target was moved from the target station to the storage area (position 3). Upon removal, it was measured with a pole monitor at 0.5 m to be 960 mSv/h.

  287   Wednesday, April 13, 2022, 12:33 Adam NewsomeStandard OperationTarget 2TargetT2-MK1 moved: from storage area to target station

The T2-MK1 target was moved from the storage area (formerly position 4) to the target station. Services were reconnected in order to prepare for normal operation.

  288   Thursday, April 14, 2022, 14:38 Adam NewsomeOtherTarget 2DiagnosticsIssue with Protect Monitor SHV Cable

Diagnostics group (Shengli Liu) noted a lack of connectivity between control panel and T2 Protect Monitor via the high voltage cable. Upon inspection it was noted:

  • The cable was very brittle due to radiation exposure and it was cracking in multiple places
  • In the SHV connector, the pins were slightly bent (bending them back into position seemed to rectify the connectivity issue).
  • The cable was bent at the strain relief junction

RH Group has advised that Diagnostics replace the entire cable as soon as possible. For now it appears to be working.

Attachment 1: PXL_20220414_210238000.jpg
PXL_20220414_210238000.jpg
Attachment 2: PXL_20220414_210053641.jpg
PXL_20220414_210053641.jpg
Attachment 3: PXL_20220414_210037717.jpg
PXL_20220414_210037717.jpg
  289   Wednesday, May 04, 2022, 11:27 Adam NewsomeStandard OperationTarget 2M9M9 and M20 Beam Blocker Actuation Test

The beam blockers for M9 and M20 were actuated, and vacuum was monitored to ensure no disruptions. Both actuation tests were successful. Motion was observed and no abnormalities noted. Cabling and air connections checked: OK.

 

Note: there was a safety interlock issue with M9 which prevented actuation - a relay or fuse was temporarily removed from the safety system ~10 years ago but it was not replaced. It was replaced for the purpose of this test, and then removed again.

  290   Thursday, May 05, 2022, 14:38 Adam NewsomeMaintenanceTarget 2ControlsT2-MK1: profile monitor actuation check and repair to connector

An attempt was made to actuation the T2 profile monitor, however it showed up in EPICS as being not present. Furthermore, the "Remote" indicator light on the physical controller was not lit up despite the switch being in remote mode. The limit switch indicator light was working.

 

Upon troubleshooting with Erwin Klassen, it was determined that a jumper was missing on the profile monitor control connector (on the target end, rear of bulkhead). The jumper shorts pins A and G on the mil-spec connector on the controller end, which is for 120 VAC supply, to indicate that the device is connected. T1-MK1 was checked - this jumper was present on T1-MK1, across pins E and F of the mil-spec connector, but was not present on T2-MK1. Otherwise the connectors were identical. It is suspected that it was accidentally omitted during maintenance in the past. Regardless, a new jumper was soldered in-place on T2-MK1 across pins E and F to replicate T1-MK1. The system functioned normally after this.

 

Attached photo shows the completed solder job - the current state of the connector on the rear side of the target bulkhead panel.

Attachment 1: T2-MK1_prof_mon_connector_-_rear_-_after_fix.jpg
T2-MK1_prof_mon_connector_-_rear_-_after_fix.jpg
  291   Thursday, May 05, 2022, 14:39 Adam NewsomeStandard OperationTarget 1TargetT1-MK1 and T2-MK1 profile monitor actuation test

The profile monitor actuation tests were completed for T1 and T2. No abnormalities were noticed in vacuum during either test.

 

Note: an issue was observed with T2-MK1 - see e-log 290. The issue was resolved.

  292   Wednesday, May 25, 2022, 10:15 Adam NewsomeStandard OperationTarget 1TargetT1-MK2 moved from hot cell to storage area

The T1-MK2 target was moved from the hot cell to the storage area, in position 5. Note: manual nudging of the flask was required to get it to align with guide pins properly.

  293   Wednesday, May 25, 2022, 10:16 Adam NewsomeStandard OperationTarget 2TargetT2-MK2 moved: from storage location to hot cell

Target T2-MK2 was moved from the storage location (formerly position 3) to the hot cell in preparation for replacement of end of life targets.

  294   Wednesday, June 08, 2022, 08:59 Adam NewsomeOtherTarget 2CoolingT2 flow rate sensor (BL1A:T2CS:FGTGT ) - warning and trip limits adjusted

See fault 14966: https://web.accel.triumf.ca/ncr/dbfault.pl?faultgroup=CYCLOTRON&faultno=14966&btn_submit=Getfault

The flow rate sensor for T2 target cooling was exhibiting some instantaneous drops below the warning threshold, causing nuisance warnings. It was also dropping quite close to the trip limit. The reason for this unknown and this is unexpected since the sensor was recently replaced this winter shutdown.

 

Until the problem can be figured out and resolved, Ops has lowered both the warn and trip threshold values to 3.0 gpm and 2.8 gpm, respectively. This was done mid-day on June 7. This has been done in the past and is deemed safe to do as it is still within normal operating parameters (and a defeat is not required). The main reason for doing this is to reduce the chance of an accidental trip if the flow rate were to drop below the previous trip threshold of 3.0 gpm. These noisy blips do not seem to be dropping below 3.0 gpm, although they are close (see attached screenshot of June 6-8 data). The sensor history will be examined weekly, and if there are no drops below 3.0 gpm, these thresholds should be adjusted back to their regular values.

 

Attachment 1: After_Adjustment.PNG
After_Adjustment.PNG
Attachment 2: Sensor_data_around_June_6-8.PNG
Sensor_data_around_June_6-8.PNG
  296   Wednesday, July 06, 2022, 12:49 Adam NewsomeRepairOtherHot CellHot Cell - Helium wand tubing broken

The tubing for the helium wand inside the hot cell is broken and needs to be replaced. More tubing has been ordered and the job will be completed in the coming weeks.

  297   Wednesday, July 06, 2022, 12:52 Adam NewsomeOtherOtherHot CellPotential hot cell window oil leak

Some oil was noticed around the hot cell window, on the control panel, and on the ground below the control panel. A leak is suspected.

 

Suggest tightening all bolts to specified torque along the window, and monitoring overflow oil level (position today was marked). If the problem persists, the gasket must be replaced. Note that the gasket should likely be replaced anyway as it has not been done for some time.

  298   Thursday, July 28, 2022, 12:51 Adam NewsomeRepairOtherHot CellMeson Hall Hot Cell - Nuclear Ventilation Issue

It was reported today by Peter Bratt that the nuclear ventilation system for the hot cell is not functioning. At this time, the cause of the issue is unknown. Remote Handling and Electrical Services are investigating. This e-log will be updated when the issue is resolved.

 

Update: the issue was caused by worn belts which had been smoking. The belts must be replaced.

  299   Monday, August 22, 2022, 09:01 Adam NewsomeStandard OperationOtherActive SumpActive Sump Draining

On Aug. 18, 2022, Operations informed RH group that an alarm activated for the full status of the MHESA B1 RCR1 Lab holding tank. Additionally another alarm was reported in the RH control room regarding the RH sump full (Southwest Meson Hall Extension - Remote Handling area). However, there is an alarm signal for the RH sump that was seen as OK at the MHESA Lab HMI.

Upon examining the RH active sump it was clear that the water level was in fact quite high, and the red warning light on the local control box was on.

After sampling and testing by RPG the sump contents were released under work permit C2022-08-19-3 as per the procedure in Document-64834. The approximate volume of the full sump is 7270L.

When the water level was below the warning threshold (i.e. red warning light came off, and green light indicating "sump good" came on), a request was made to the control room to reset the alarm. Operations cleared the alarm at the RCR Lab controls and retired the signal defeat that was in place in the DCR (“RCRL warn” signal was defeated).

 

Edit (2022-08-23): BL1A holding tank water level was checked - it is empty.

  300   Tuesday, August 23, 2022, 14:36 Adam NewsomeStandard OperationOtherOtherBL1A Holding Tank - Level Check

The water level inside the BL1A active water holding tank was checked today (Aug. 23, 2022). The tank is essentially empty at this time.

  301   Tuesday, August 30, 2022, 14:24 Adam NewsomeMaintenanceOtherHot CellNuclear Ventilation - Filter Change

Mechanical Services Group changed the pre-filter in the ventilation system on Aug. 29, 2022 as per work permit C2022-08-29-2.

 

It is recommended that Mechanical Services change the HEPA filter as soon as possible. These filters are on order with approximately 7 month lead time. 

 

Edit: as of 2023-05-03, the HEPA filter has been changed.

  302   Thursday, September 15, 2022, 14:34 Adam NewsomeStandard OperationTarget 2TargetT2-MK2 target elevations measurement

The target elevations measurement and beam spot checks were completed on Sept. 15, 2022. This was done after a July 2022 target exchange for target positions 3 and 5.

 

Updated target elevation drawing can be found in DocuShare (Collection-33652)

Attachment 1: T2-MK2_-_Sept_2022.pdf
T2-MK2_-_Sept_2022.pdf
  304   Tuesday, October 04, 2022, 09:59 Adam NewsomeMaintenanceTarget 2CoolingT2 cooling package maintenance - mini-shutdown 2022

The following maintenance tasks were performed during mini-shutdown of 2022 with the goal of resolving the Fault 14966 (target water flow rate low).

  • Replace the o-ring, paddle wheel, and shaft on the following flow rate sensors:
    • Q1 (FGTGT)
    • Q2
    • Q4
  • Replace the demineralizing flow metering valve with a new needle valve (the old one was flaky and appeared to occasionally restrict flow)
  • Re-tune the demin. flow to 1.15 gpm
  • Top up the expansion tank due to water loss during the maintenance job (from 27.1 cm level to 34.8 cm)

To test the theory that the demin. flow metering valve was faulty and had an effect on the target water flow rate during operations, the valve was closed to determine if it stopped flow to the target. The result is that it did not, and only flow in the demin. circuit was affected. Therefore, it is likely that the root cause of Fault 14966 was not due to the demin. metering valve, but rather an issue with the pump, heat exchanger, pressure in the lines, or another form of obstruction. It should be noted that when the pump is turned off, all flow rate and pressure sensors drop to zero (except the pressure sensor located in the BL1A Service Tunnel) - so if the fault occurs again and symptoms show this case, it is likely that there is an issue with the pump intermittently turning off or similar.

As an aside: it is recommended in the future when changing circuit boards on the flow rate sensors to use metal screws instead of the plastic screws supplied with the parts.

 

Dose rates observed in the work area: 300-500 uSv/h at the target cooling package area, 1300 uSv/h at the target monolith area.

ELOG V2.9.2-2455