Lid down operations for 2019/2020 shutdown went ahead as planned on March 10th 2020 with Dan Louie and Arthur Leung absent due to a conference. Please see attached file for station counter numbers. Station two right side Highfield gear box was making intermittent growling from outboard bearing, this station is next on scheduled maintenance and will be inspected post removal next shutdown. Station 3 has spare jack set 13 in place, using Operations thermal camera we where able  to observe higher than normal running temperatures from right side gear box. Upon removal next year we will investigate bearing end play tolerances as this is the suspected cause of heat.

The lid down operation took place on April 19, 2024.

The system was energized a few minutes ahead of time.

Starting master synchro value: 47401. The master synchro was not jogged prior to starting.

Upon startup at 12:45 pm, the system worked fine and lowered the lid. One stop occurred after lowering a few inches but the system was easily restarted with no modification. No abnormal observations made. The system was stopped at 1:05 pm at a master synchro count value of 12385 to check the tank seal, confirm limit switch functionality, etc., then resumed. The lid was lowered at 1:17 pm.

Overall, it seems that the lowering process was more "smooth" than in past years - the jack stations seemed to be well-synchronized and relatively few motor/brake toggles were required during travel (this is just based on memory and visual observations, not actual data). If this is true, it is likely attributed to the fact that during lid up operation this year, each station was synchronized with respect to each other to help reduce stoppages.

See attached summary.

The lid down operation took place on Mar. 31, 2023.

The system was energized a few minutes ahead of time.

Starting Master Synchro value: 47388. The master synchro was jogged up prior to starting to approximately 47395.

Upon startup at 10:38 am, the system worked fine and lowered the lid. No stops occurred and the lid lowered smoothly. No abnormal observations made. The lid was completely lowered at 11:05 am.

See attached summary.

The lid down operation took place on Apr. 27, 2022.

The system was not energized well ahead of time to allow to "warm up", as is usually done.

Starting Master Synchro value: 47387

Upon startup, the system worked fine and lowered the lid.

After some time, jack station 12 became out of sync with the master synchro. It needed to be manually jogged to adjust its synchronicity. After it was adjusted, the entire operation went smoothly and the system did not automatically stop again.

No major issues with any jacks. No overheating observed.

A second lid down operation took place on April 30, 2024.

The system was energized a few minutes ahead of time.

Starting master synchro value: 47427 (after it was jogged up slightly prior to starting).

Upon startup at 12:51 pm, the system worked fine and lowered the lid. The lowering was stopped at approximately 5" gap as per standard procedure for Operations to perform checks. Furthermore, the lowering was stopped multiple times after that at approximately 0.5" increments for resonator latch checks.

No abnormal observations made. No jogs required. Once again, this was a very smooth lowering process. The lid was fully lowered at 2:00 pm.

Ending master synchro value: 66

See attached summary.

Lid down Start at 11:17, lid went down without any issues or stop's. Lid finish at 11:45

Start count              Finish count

1- 47386                   47

2- 47378                   49

3- 47374                   45

4- 47382                   46

5- 47394                   47

6- 47385                   48

7- 47398                   49

8- 47375                   45

9- 47395                   50

10- 47395                 49

11- 47395                  51

12- 47393                 49

Prior to the lid-down operation today, the Cyclotron was lowered by 0.75" and then raised again to confirm that the upper limit switches were working.  Dan Louie confirmed this from the control racks.

Maico and Grant walked around the perimeter of the cyclotron to inspect each station and ensure that there were no interferences, e.g. dial indicator rods, tread plates, etc.

The lid was lowered successfully by Gord Roy and Dan Louie.

Mechanical counter numbers recorded after lid down are shown below:

Lid down Started at 12:15, station and count numbers. Lid went down with out incident as station 1 and 7 show the counters will need replacing. We are going to change counters before the end of this shutdown to ensure proper orientation in case of emergency lid up scenario. 

Start          12:15                   Finish    13:15                 Master #47383   Master final 38

1-16047                    76303

2-47366                           44

3-47351                          41  

4-47365                          43

5-47362                          42

6-47365                          43

7-17495                  49568

8-47358                         40

9-47360                          44

10-47366                       44

11-47362                        45

12-47393                      43

The large shield door on the RH B2 level of the remote handling building has been shut.

The newly developed Ladder Handling Tool (TRH1401), which is used to move the maintenance ladders from the #5 resonator area closer to the centre post, was tested inside the cyclotron tank to perform the actual operation. This is a task that was historically performed by operators, resulting in dose received (typically 0.1 - 0.3 mSv for two people, twice per annual shutdown). This tool completely eliminates the need for people to receive this dose - only a small fraction of this dose is involved for one person in setting up the tool for use.

Overall, the test was deemed successful; both ladders were successfully moved which validated the functionality of the tool. There was difficulty in unlatching the lifting eye interlock for the first ladder (this was expected) but it was eventually achieved without human intervention. After the first ladder was moved, the entire tool was brought out of the tank, and some minor adjustments were made (ex. clutch adjusted). An attempt was then made to move the second ladder, and it was a significant improvement over the first attempt.

Feedback was obtained from this test and work will be performed to improve some aspects of the design (mechanical, viewing, procedural). The tool will be tested at least once more before the end of 2021 shutdown, and we will aim to have the important feedback items implemented by then.

The LE1/LE2 Probe Frame was mounted on the Upper Resonator Trolley in the mockup with the intention of confirming functionality and making some updates to the probe installation/removal procedure document.

The following updates were made to the LE1/LE2 Probe Frame and the Upper Resonator Trolley:

• Additional holes drilled and grommets installed in the trolley's valve bank mounting plate to support all of the air cylinders on the Probe Frame
  
• All old brass fittings replaced with quick-connect style fittings
• All air tubing replaced with new polyurethane tubing
• Flow control valves installed
  

The air cylinder functionality was tested in the mockup and working as expected. In the future, a full mockup procedure will be performed in order to confirm camera views as well as finish updating the procedure document.

A simulated removal of the LE2 Probe from the Cyclotron tank was performed by the RH and Probes group using the 
service bridge, upper resonator trolley, LE probe attachment, and the (soon to be) attached LE Probe removal 
procedure on 2017-02-23.

Because of observed noise on the synchro at jack station 11 during recent shutdown lid up/down operations, the synchro at this station was replaced on Jan. 31, 2024. The procedure in Document-234859 was followed.

Prior to starting the replacement, the following counter values and synchro measurements on the station in question and adjacent stations were noted:
The master synchro count value was measured at: 0000
Station 10: Counter: 99392.5, synchro voltage: 5.89 VAC
Station 11: Counter: 0073, synchro voltage: 0.787 VAC (anomaly)
Station 12: Counter: 0068, synchro voltage: 5.98 VAC
 

During the replacement, the master synchro was jogged such that adjacent stations 10 and 12 read a synchro value of approximately 0 volts (as per the nulling procedure). The following observations were made:
The master synchro count value was measured at: 0072
Station 10: synchro voltage: 0.047 VAC
Station 11: synchro voltage prior to swap: 5.70 VAC (anomaly)
Station 12: synchro voltage: 0.282 VAC

After the replacement, before jogging the master synchro back to its starting value of 0000, the following measurements were made:
Station 10: synchro voltage: 0.038 VAC
Station 11: synchro voltage after swap: 0.12 VAC (now correct)
Station 12: synchro voltage: 0.278 VAC

When jogging the master synchro after the swap was completed, it was confirmed that stations 10, 11, and 12 all responded as expected, and their values were synchronized with respect to each other, indicating a successful replacement. The master synchro was jogged back to its original counter value of 0000. The system is now considered operational.

Annual jack maintenance : Jack 10b upon inspection it was found that the output shaft seal on 10b was in need of replacement. In past years RH personal had to remove a LoveJoy coupling which required cutting of the coupler due to galling and possible interference tolerances being out. We sourced sample split seals from Motion Canada that can be installed with out coupling removal we will install and monitor to determine the effectiveness and the possibility of converting all jack stations to this seal design . Attached are pictures of old seal style, new style seal, worm, wheel housing, current coupling on shaft, old coupling that has been cut off and various components. The jack components appear to be in good working order, no extra ordinary maintenance needs to be performed besides seal replacement. 

Fault 16710 was initially assigned to Remote Handling: IBOP0206 giving false positive - Al-ALCW water pressure shows "off" when it isn't; The safety system is reporting that Al-ALCW water pressure is "off" (page SVG) when the system is still on and at normal operating pressure.

2024-04-10: initial inspection by A. Newsome yielded the following (email from A. Newsome to K. Genge):

1. First, on an unrelated note, there's a thermometer mounted to the Al-ALCW pipe which is loose and rattling due to vibration of the pipe. There's a little bit of water leak in this area. I don't want to mess around with it but I suggest someone tighten it soon! 
2. I looked around for sensors on the Al-ALCW pipe and I think I found the water pressure sensor which is giving the faulty reading. I have three suggestions for what to look into, in order of importance:

1. The cable for this sensor has a portion of it which is electrical-taped together. I didn't mess with it, but I suspect underneath the electrical tape it could just be disconnected. This would be a super quick check and quick fix. Suggest connectorizing it in the future with a simple Molex connector or similar - let me know if you want us to do that. 
2. The pressure transmitter itself could have failed or could have some sort of internal issue. Suggest disassembly to inspect. First, water will need to be turned off and the isolation valve turned off. If no spare readily available, suggest swapping with another transmitter of the same model to see if that is in fact the issue before ordering one (I think there's one nearby for the Meson Hall water system, beside the electrical panels). 
3. Somewhere along the line, there could be a cable degradation issue, or the cable could be disconnected/pinched/cut. Suggest looking into this last as it is the most tedious and also least likely.
   

2024-07-16: J. Ableseth confirmed the pressure transmitter (3400T Series) appears to be in working condition.

2024-07-24: A. Newsome and J. Zhang investigated the elevating system control panel located in B3 level. The following are findings (email from A. Newsome to K. Genge):

1. Our elevating system panel accepts an overall interlock summary signal from an unknown external source (probably a safety panel located elsewhere). There's no manipulation of the signal at all - it just enables/disables the system from running. 
2. The indicator lights on top of the elevating system panel do not have any electronics nearby - the light wiring comes from an external source via multiconductor cable. They are just indicators and are not connected to any electronics inside our panel at all. In fact this isn't even in our drawing package. 
3. We traced the light signal multiconductor cable out to the tunnel on B3 level - the cable runs along the middle cable tray. Did not follow all the way, but we assume it comes from the safety panel in B2 that Kathleen pointed out. In this panel, there's an exact duplicate of the indicator light display! This one, too, showed the "CYC H2O OFF" light as being on (false logic since the pump is active). It appears that the wiring for these lights is connected to a bank of relays right beside it. My suspicion is that one of these relays has failed, which then causes both of the indicator lights to be stuck in the ON position (this is the "safe" position). Given that there's also a similar cyropanel-related faulty signal, this makes even more sense - the relays are probably very old and/or there was some external issue that could have caused both to fail. Seems more likely than two totally unrelated sensors failing at the same time, that just happen to be routed through the same panel and relay bank. 

• Kevin Ardron investigate the relays in that panel... if it is not obvious the relay has failed, easy thing to do is just swap it with an adjacent one that is known to work and see what happens.
• Probably a good idea to just replace all of them if they are all the same age, because we'll likely see others fail. I think it is a relatively inexpensive and straightforward thing to do that could save some headache and beam trips in the future. 
• If the relay appears to be fine, or if the relays turn out to be totally unrelated to the actaul signal itself, continue tracing the signal back to its ultimate source. This panel on the B2 level is most likely where we'll find the issue.
  
  

[Update] 2024-07-26: Email from K. Genge:

An update from Safety System’s findings re: elevating system interlocks -

1. Very difficult to test the relays given the design/location of them and the cables connecting to them.
2. Kevin A. managed to trace the cryopanel elevating system related fault (#17020) over to the vacuum racks on SAB2 where he coincidently ran into Dimo, Vacuum Group Leader. Turns out that the sensor that gives this signal is connected to old cyclotron cryogenics/vacuum equipment that is no longer in use (and therefore providing the elevating system interlock system with the right info!). During the shutdown, Dimo and his team will move this sensor to the correct location so that it’s providing the correct info. That fault has been redirected.
3. The water ok signal goes to a “water system box”. We don’t know where this box is, but Kevin is willing to provide additional cable info to Joe. I recommend that the next step is for Joe and Kevin Ardron to connect and figure out where this cable goes.

2C has been installed located on all QDLs and all the numbers, continuity check done and passed. Bridge has been removed from the cyclotron tank.

Motor contactors for the cyclotron elevating system jacks were inspected on 2025-01-23 by Joel Semilla under work permit C2024-01-19-1. Joel's assessment is as follows:

"All the twelve magnetic contactors have the same contact tips condition. Last year, I have [sic] to take out the contacts from the housing due to severe "pitting" of the contact's silver surface due to excessive "flash-over" which is common to magnetic contactor on inching/jogging duty. Due to the better condition of the contact tips this year, I can re-surface the contact tips on the magnetic housing itself."

Prior to recent inspections, a recurring inspection at an informed frequency had not been set. It is suggested based on the state of the contactors now, in comparison with the previous inspection, to schedule inspections of these contactors every 4 years. Next inspection due: Jan. 2028.

Edit: on 2024-01-24, Joel Semilla updates: "re-surfacing of stationary and movable contacts for the 12 cyclotron elevating motors have been completed".

Maico Dalla Valle and Grant Minor, supported by Dan Louie and Arthur Leung, entered the Cyclotron Vault on January 15th, 2014 to check the indexing of the jacking stations.  520MeV work permit 2014-01-15-4 was filled out for this work.

Yoke gaps at all stations were found to be within .005" to .010" of the .25" shim stock, and all mechanical counters were found to read zero.  This is consistent with the recalibration done on March 19th, 2013.

The system is properly indexed mechanically, and ready for lid-up.

Grant

Due to concerns raised regarding the state of the lubrication of the power screws at Station 9, the lubrication was visually inspected by me and Ron Kuramoto on February 4th.

Photos are attached.

The power screws for these stations were serviced and re-lubricated on the following dates:

Station 9 - 1996

Station 10 - 2001

Station 11 - 1997

Station 6 - 2011

There did not appear to be any major visual differences in the lubrication between any of these stations.  The grease at Station 9 appeared to coat the power screw uniformly through its range of travel, and there were no major signs of drying, hardening, or separation of the constituents relative to the other stations inspected.

There is a slight apparent difference in the opacity of the grease between Station 9 and Station 6 in the photos attached, but this may be due to the lighting and camera flash at the angle taken.

There did not appear to be any flecks of metal, contaminants, or other signs of abnormal wear in the grease.

The mechanical properties of the grease at Station 9 vs. virgin grease would have to be assessed by a tribologist in a laboratory setting from samples.

Samples of the grease were not collected at this time, but could possibly be collected in the future when Station 9 is removed for service.

The hydraulic cylinder on the West side of the service bridge (used to raise the bridge for insertion into the Cyclotron) failed this morning, leaking oil in the vault tunnel.  Most likely this was due to a failed seal or gasket.

Maico Dalla Valle has removed both the East and West cylinders for refurbishment and is pursuing repair kits from Hyseco.

The purple coloured cylinder on the East side has been slowly leaking oil for some time.  A gasket in the West cylinder (yellow) seems to have failed and a broken piece of the gasket was removed during the disassembly, shown in the photo "Hydraulic Cylinder Gasket 4 Feb 2013 008.jpg" attached.

Cylinder model number is ENERPAC RC-254.

http://www.hyseco.com/