The lid up operation took place on Feb. 4, 2022.

The system was not energized well ahead of time to allow to "warm up", as is usually done. Upon starting, brakes were not energized - this was because of the master synchro position - once it was adjusted, interlocks for motor brakes toggled as expected.

Starting Master Synchro value: 61

Minor issue when first starting: after a few attempts to raise, jack 12 needed to be manually jogged to adjust its synchronicity with the others. After it was adjusted, the entire operation went smoothly and the system did not automatically stop again.

The system was stopped at approx. 3 inches of travel to inspect the seal, etc. Everything OK.

No major issues with any jacks. No overheating observed.

Jack 11 showed occasional noise spikes on readback (this happened in 2021 as well - suggest replacing this station's synchro next).

Meter stick hit the ceiling and bent slightly. The meter stick versus limit switch discrepancy could be due to the stick shifting slightly by accident (due to vibrations or accidentally being bumped by someone). The limit switches were trusted as it would be highly unlikely for them to both disagree with the meter stick simultaneously if there was an adjustment setting issue with them.The limit switches toggled as expected, and the gap was measured at 46.5" (correct value).

Ending Master Synchro value: 47387

Total time to raise was approx. 40 minutes.

Doses:
Arthur: #150, 0
Dan L: #310, 0.02
Dan M: #819, 0.04
Nadia: #868, 0.02
Adam: #862, 0.014
Kyle: #111, 0.09
Ryan: #115, 0.05
Chris: #840, 0.043

When attempting to perform the radiation survey, the program displayed an error at startup stating that the software was not able to keep up with the incoming hardware samples, and suggested to increase sampling rate or buffer size. The default sampling rate of 500 ms was not used - rather, 100 ms was used. No issues were observed with this rate. As far as I am aware, this issue had not occurred in the past, and the cause is unknown.

An issue was observed in which radial motion on the Video Trolley Mk 1 did not respond to commands. After troubleshooting, it was determined that this was due to the "OP LIMIT" interlock - the "OP LIMIT" pushbutton on the console was illuminated in red, and needed to be continuously held down in order to operate the radial in/out motion buttons.

It was determined that the root cause of the issue was a failed radial limit switch which was likely damaged during trolley transport. The limit switch was replaced, and functionality was restored.

The lid down operation took place on Apr. 27, 2022.

The system was not energized well ahead of time to allow to "warm up", as is usually done.

Starting Master Synchro value: 47387

Upon startup, the system worked fine and lowered the lid.

After some time, jack station 12 became out of sync with the master synchro. It needed to be manually jogged to adjust its synchronicity. After it was adjusted, the entire operation went smoothly and the system did not automatically stop again.

No major issues with any jacks. No overheating observed.

All of the old brass air fittings on the Tool Trolley have now been swapped over to push-connect style fittings. As these are plastic fittings, it is recommended to inspect them after ~5 years for degradation.

The LE1/LE2 Probe Frame was mounted on the Upper Resonator Trolley in the mockup with the intention of confirming functionality and making some updates to the probe installation/removal procedure document.

The following updates were made to the LE1/LE2 Probe Frame and the Upper Resonator Trolley:

• Additional holes drilled and grommets installed in the trolley's valve bank mounting plate to support all of the air cylinders on the Probe Frame
  
• All old brass fittings replaced with quick-connect style fittings
• All air tubing replaced with new polyurethane tubing
• Flow control valves installed
  

The air cylinder functionality was tested in the mockup and working as expected. In the future, a full mockup procedure will be performed in order to confirm camera views as well as finish updating the procedure document.

Under work permit C2022-10-04-1, the motor contactors for jack motors 1 through 12 were replaced. The contactors showed signs of corrosion.

The vault crane annual inspection was completed by Tom Kauss.

The wired pendant was replaced with a remote pendant by Tom Kauss.

The lid up operation took place on Jan. 30, 2023.

The system was not energized well ahead of time to allow to "warm up", as is usually done.

Starting Master Synchro value: 62

The Master Synchro was jogged to a value around 2 prior to starting, to allow it to lag behind the jacks.

When first starting: after a few attempts to raise, it was determined that the master synchro value needed to lag behind the other synchros more than initial suspected. This was changed, and the system operated smoothly for a short time.

During lid travel, station 5 and station 11 both caused trips and needed to be manually jogged to match the rest of the stations. The system was restarted, and more trips occurred. Stations 7 and 10 were adjusted as well. Eventually, after adjusting a few stations, the lid travel smoothed out and no more issues were observed for the remainder of the operation.

The system was stopped at approx. 3 inches of travel (synchro count 5255) to inspect the seal, etc. Everything OK.

No major issues with any jacks. No overheating observed.

Jack 11 showed occasional noise spikes on readback (this happened in 2021 and 2022 as well - suggest replacing this station's synchro next).

When finished, the limit switches toggled as expected, and the gap was measured at 46.5" (correct value).

Ending Master Synchro value: 47388

The attached spreadsheets show all synchro values before and after the operation, as well as jack station infrared heat measurements.

Start time: 9:23 am
End time: 10:53 am (includes gap measurement, etc. - actual lid travel finish was a bit earlier)
Total time to raise was approx. 1.5 hr.

Doses:
Adam Newsome: 0.005 mSv
Maico Dalla Valle: 0.121 mSv
Eric Lahe: 0.056 mSv
Ryan Anderson: 0.017mSv
Kevin Lucow: 0.060 mSv
Ed Parton: 0.007 mSv
Jason Zhang: 0.025 mSv
Nadia Jorgenson: 0.005 mSv
Arthur Leung: 0 mSv
Dan Louie: N/A

[edited 2023-09-8 to fix typo - Adam Newsome]

The lid down operation took place on Mar. 31, 2023.

The system was energized a few minutes ahead of time.

Starting Master Synchro value: 47388. The master synchro was jogged up prior to starting to approximately 47395.

Upon startup at 10:38 am, the system worked fine and lowered the lid. No stops occurred and the lid lowered smoothly. No abnormal observations made. The lid was completely lowered at 11:05 am.

See attached summary.

The vault shield door has been closed and seal inflated. The operation was performed with no issue.

The original end feet and end caps were removed from the maintenance ladders and replaced by new end caps (TRH1637).

The "old" video trolley featuring scissor mechanism and DSLR camera has officially been decommissioned. Going forward, Video Trolley Mk 2 (TRH1089D) will be used.

The two camera tilt mechanisms on the lift trolley have been upgraded. Upgrades include:

For the individual camera:

• Replaced cylinder
• Replaced fittings for cylinder
• Replaced air tubing from flow control to cylinder
• Visual inspection and fasteners tightened

For the overall platform containing the camera and lighting:

• Replaced cylinder
• Replaced fittings for cylinder
• Replaced valve (5/3 centre closed style)
• Replaced air regulator and set pressure (note: at the time of writing this e-log, it still needs to be fastened in place via its mounting bracket)
• Replaced air tubing
• Visual inspection and fasteners tightened

The mirror actuation mechanism was observed to be "sticky" during 2023 winter shutdown - it occasionally did not function properly and needed some manual assistance. 

The following items were addressed to resolve the issue: 

• Replacement of the Tyne Myte double acting valve which controls the cylinder (based on troubleshooting tests, it seemed this valve was not functional or intermittently functional)
• Addition of a silencer and in-line flow control on the exhaust of the aforementioned valve - adjusted to allow for smooth operation of the mirror when toggled
• Cleaning of the cylinder's shaft (it had a sticky residue build-up and was notably high friction) - this cylinder should likely be replaced in the near future 
• Replacement of air tubing along the supply line to the valve, and between the valve and cylinder
• Replacement of all fittings (push-connect style) on the valve and cylinders

The mirror actuation was tested after these changes and is behaving normally.

No further repairs required, although it is suggested to change the remainder of the tubing and fittings for the other valves which control different functions on this trolley, and to eventually upgrade the valves themselves to a low profile valve bank. 

Motor contactors for the cyclotron elevating system jacks were inspected on 2025-01-23 by Joel Semilla under work permit C2024-01-19-1. Joel's assessment is as follows:

"All the twelve magnetic contactors have the same contact tips condition. Last year, I have [sic] to take out the contacts from the housing due to severe "pitting" of the contact's silver surface due to excessive "flash-over" which is common to magnetic contactor on inching/jogging duty. Due to the better condition of the contact tips this year, I can re-surface the contact tips on the magnetic housing itself."

Prior to recent inspections, a recurring inspection at an informed frequency had not been set. It is suggested based on the state of the contactors now, in comparison with the previous inspection, to schedule inspections of these contactors every 4 years. Next inspection due: Jan. 2028.

Edit: on 2024-01-24, Joel Semilla updates: "re-surfacing of stationary and movable contacts for the 12 cyclotron elevating motors have been completed".

Because of observed noise on the synchro at jack station 11 during recent shutdown lid up/down operations, the synchro at this station was replaced on Jan. 31, 2024. The procedure in Document-234859 was followed.

Prior to starting the replacement, the following counter values and synchro measurements on the station in question and adjacent stations were noted:
The master synchro count value was measured at: 0000
Station 10: Counter: 99392.5, synchro voltage: 5.89 VAC
Station 11: Counter: 0073, synchro voltage: 0.787 VAC (anomaly)
Station 12: Counter: 0068, synchro voltage: 5.98 VAC
 

During the replacement, the master synchro was jogged such that adjacent stations 10 and 12 read a synchro value of approximately 0 volts (as per the nulling procedure). The following observations were made:
The master synchro count value was measured at: 0072
Station 10: synchro voltage: 0.047 VAC
Station 11: synchro voltage prior to swap: 5.70 VAC (anomaly)
Station 12: synchro voltage: 0.282 VAC

After the replacement, before jogging the master synchro back to its starting value of 0000, the following measurements were made:
Station 10: synchro voltage: 0.038 VAC
Station 11: synchro voltage after swap: 0.12 VAC (now correct)
Station 12: synchro voltage: 0.278 VAC

When jogging the master synchro after the swap was completed, it was confirmed that stations 10, 11, and 12 all responded as expected, and their values were synchronized with respect to each other, indicating a successful replacement. The master synchro was jogged back to its original counter value of 0000. The system is now considered operational.

It was observed when attempting lid up operation on 2024-02-06 that the brakes for each of the jacks were not operating correctly. It appeared that power was not being applied so the brakes were stuck in the engaged state. This ultimately resulted in issues with the lid up operation.

The issue was traced to relay A1 (the master brake power relay) not toggling as expected, despite the relevant control signals being present to try to enable it. This relay is located in the MCC-E 400V panel. Adjacent to the relay is fuse F4 which supplies the relay. This fuse was blown. The fuse was: English Electric CIS50. 50A rated, 600V, H.R.C. Form II. Replacements were ordered, however the part is obsolete due to its age. In the short term, a temporary workaround was implemented by installing a 30A fuse. This will be replaced when the spare fuses arrive.

The system was powered up again today (2024-02-07) and the brakes energized as expected. It appears that there is no issue. The root cause of why the fuse blew in the first place is unknown at this time. It was originally suspected that it was due to accidental mis-wiring of the brakes when they were reconnected after annual servicing, but if this was true, the fuse would have instantly blown again when relay A1 was energized. The best guess at this point is that the fuse failed due to age (it is likely around 60 years old).

This e-log will be updated if any further developments are made on this issue.

It was observed during lid up operation on 2024-02-08, approximately halfway through raising the lid, that the motor contactor for station 10 located within its small motor panel stopped functioning. The symptoms observed were: entire system stopped since station 10 lagged behind (approx. 150 counts on counter), station 10 could not be jogged locally in either direction, the control signal to activate the motor was being sent to the contactor when attempting to jog, but no motion occurred.

After locking out the panel, the contactor was disassembled and reassembled by an electrician. The system was powered back on and the motor functioned normally. The explanation as to why the issue occurred in the first place is unknown but it is likely attributed to years of infrequent usage causing it to "stick" and/or corrosion buildup.

In any case, it is recommended that all contactors be inspected during the year of 2024 and that at least station 10 be replaced, and spares for other stations procured.

The cyclotron lid was raised starting ~10:30am on 2024-02-06 and finishing at ~3:30pm on 2024-02-08, under work permit C2024-02-06-4.

Upon first attempt to raise the lid, issues were encountered. The system seemed to start as expected but quickly tripped, resulting in no appreciable travel. Upon investigation, it was determined that this was due to a blown fuse which feeds the brakes master relay (see e-log  https://elog.triumf.ca/TIS/RH-Cyclotron/165). The result of this was the the brakes were not properly disengaging, leading to additional friction in the system, and preventing regular motion.

After rectifying this issue, a second attempt was made to raise the lid. This time, issues were encountered with some of the stations being out-of-sync with respect to the others (a result of the troubleshooting which took place for the aforementioned issue). After manually jogging some stations, it was decided to lower the lid all the way, jog motors for individual stations so that they physically match each other in terms of travel distance at a known starting point, manually adjust counters on some stations whose counter values were significantly off so that they matched neighbours, and then jog individual stations such that each synchro measurement was close enough to begin lid up operation.

After this work took place, another attempt to raise the lid was made. This time, the lid traveled fairly smoothly, with a few occasional stops. It seemed that some motors were lagging behind others a bit - namely stations 5, 11, and 12. After raising the lid approximately 4-6", it was decided that the best course of action would be to fully lower it and start again, now that the system had some time to "warm up".

The lid was lowered to the bottom limit again, and then raised. The master synchro count was 0 to start. This time, lid travel was the most smooth, and stops near the start of travel were infrequent. The occasional stop occurred but the system could easily be started again. Jogging individual stations was rarely required. Most stops were due to noise observed on the synchro at station 5 (false trips).
When the lid was approximately halfway up, another unexpected issue occurred: station 10 completely stopped, which caused the entire system to stop. Station 10 could not be jogged in either direction in local mode. After some troubleshooting, it was determined that the motor contactor was causing issues - eventually it was rectified (see e-log https://elog.triumf.ca/TIS/RH-Cyclotron/166).

The lid continued to raise smoothly for the remainder of the travel with very few or no stoppages. It raised all the way, as confirmed by the gap measurement.

Final master synchro count when lid was fully up: 47401

 

See attached inspection checklist which contains information about each jack station during lid up operation, as well as pre-job inspection data.

Recommended actions:
- Replace synchro for station 5 next shutdown
- Inspect all 12 motor contactors prior to next lid down
- Order spare motor contactor
- Install replacement fuse (on order)