Some issues were encountered with the turntable controls on the west hot cell, as a result the festooning post for the turntable was damaged. While the post was out of commission, the turntable was operated without actively monitoring the top of the hot cell and some cables ended up catching on the limit sensors, causing some slight fraying. The cables were duct-taped to prevent shorting for now but should be inspected and replaced accordingly in the future. We should also check that the sensor bracket did not move from where itshould be.

This morning Bill Richert pressurized the beam dump water cooling system with 30psi air and held for 2 hours.  He reported no change in pressure which indicates the flexible hose connections installed last week are leak tight.

On December 2 the upper half of the RH water blocks were installed (4 total) using a 0.030" thick 6061-T6 Al shim torqued to 60ft*lbs as was tested in Document-114260.

Bypass loops for testing the cooling system piping were installed as shown in the attached photo.

 The upper lead shield was installed this morning.  Also the water hoses for lower lead shield, beam dump, and upper lead shield were all installed.  See attached photos and hose installation information PDF.

Tuesday, November 04, 2014, 16:58

This is a test.

The following work was completed today on the EHD water leak sensors:

• Mike Vogel installed a 1/4" copper tube which leads from the east side of the EHDT shielding down to the catch tray below the water blocks.  This can be used for future testing of the in-tray sensors without removing the shield blocks.  It may also be possible to test the other sensors if enough water is poured into the tray for it to overflow and eventually get them wet.  The routing of the copper tube is not expected to interfere with the vertical shield plug
• Ray Mendoza re-located the SMT circuit boards to a rack on the north wall of the E-Hall, east of the concrete shield wall.  The push-connect terminal on one board was damaged, so there is currently no electronics installed for EHD:LEAK06  (After various debugging over the last couple weeks it was eventually determined that the previous problems with these sensors was caused by a shared power source for the relays and the sensors themselves.  Ray installed a dedicated 9V power supply for the sensors, with 24V supply to the relays still coming from the PLC)
• We swapped the wiring of two of the sensors so that LEAK01 and LEKA02 are the strips located in the tray as specified in interlock spec Document-112445 (see below for details of final installation)
  • Inside tray east side sensor is cable #4, wired to EHD:LEAK01
  • Inside tray west side sensor is cable #2, wired to EHD:LEAK02
  • Outside tray east side sensor is cable #3, wired to EHD:LEAK03
  • Outside tray west side sensor is cable #1, wired to EHD:LEAK04
• After the wiring was completed we shorted across each sensor in the junction box near the beam dump.  EHD:LEAK01 through LEAK05 responded as expected

• Water was poured into the 1/4" copper tube to test the sensor strips in the tray.  After approximately 50mL sensor #2 triggered, and #1 triggered after approximately 100mL total.  Both sensors were still in alarm 5 minutes later.

• Water was applied to sensor #3 (outside tray, east side) using a snake camera with plastic tube attached.  Approximately 50mL was applied;  The sensor triggered once after a small amount of water reached the strip, came out of alarm, then went back into alarm when more water was applied.  It stayed in alarm for approximately 1 minute then cleared

• EHD:LEAK04 (outside tray west side) was triggered by pouring water onto the ground in the general area of the sensor (direct application with the snake camera was not possible). 125mL was initially poured which did not trigger the sensor.  An additional 125mL was applied which triggered it.  More water was added to the LEAK03 sensor to confirm that the system behaves properly with all 4 sensors in alarm

•  Air was forced down towards the sensors using a shop-vac hooked up in reverse.  LEAK03 and LEAK04 cleared within a couple minutes.  LEAK01 and LEAK02 cleared in approximately 2 hours.

Two tarps were installed above the hot cell roof to protect against concrete dust while testing in the hot cell.

Zip ties were used to hook the tarp onto tubing brackets on the back wall.

On 2024-04-22 around 3:30 pm it was discovered that the crane's main hoist was in a faulted state. The operator (Adam Newsome) experienced the fault after performing a safety reset and attempting to lower the hoist. There were no visible signs of any issues, mechanically. This fault had not been previously reported by any other crane operators. The crane was previously unused, sitting idle. Note: the auxiliary hoists appeared to function normally.

Fault messages on the HMI indicated:

"135. Main Hoist West Drum North Motor Drive Fault (1000VFD)"
"104. Main Hoist East Drum South Motor Drive Fault (800VFD)"
"103. Main Hoist East Drum North Motor Drive Fault (700VFD)"
"138. Main Hoist West Drum South Motor Drive Not Ready (900VFD)"
"136. Main Hoist West Drum South Motor Drive Fault (900VFD)"

It is clear from this that there is either some sort of common issue seen across all these main hoist VFDs, or one issue with one of them which caused a cascading series of faults.

On 2024-04-23, upon investigation of these faults by going online with the PLC to determine fault logic, it was clear that all faults were indeed present, but there was no obvious indication as to what it was. Inspection of the VFDs in the control panel showed that all of the aforementioned drives displayed a fault code. This was fault code 4 which indicates DC bus undervoltage.

After researching this fault online, it appears this is typically caused by an issue with the input mains supply (480VAC @ 3 phase in this case), or by the drive's input DC filter/buffer circuitry. When measuring the DC bus voltage, it is expected for it to be approximately 1.414 times the AC supply voltage. In this case, 1.414*480 = 678 VDC. The first troubleshooting step was to measure to confirm the DC bus voltage on a known working and not working drive.

The bus voltage was probed on drive 500VFD which, based on lack of fault message, was expected to be functioning properly. With the safety off due to E-stop condition, the voltage was nearly zero. When a safety reset was pressed to enable the drive, the voltage changed to 690 VDC. This is close enough to the expected 678 VDC. The voltage did not change, even when the fault message for the other drives appeared again.

Next, the bus voltage on two known faulted drives, 900VFD and 1000VFD, was probed. In both cases, after the safety reset, the bus voltage started at 690 VDC but then slowly dropped down towards nearly zero (somewhere around 18 V) over a period of 3-5 seconds. It was during this transition when the voltage dropped off that the undervoltage condition became true, which triggered the fault.

As of 2024-04-24, the root cause of this issue is unknown. It will be investigated further and this e-log will be updated when a solution is found.

Update 2024-04-24: the root cause has been identified. The undervoltage fault was just a symptom as a result of the input contactors for these drives switching off, causing the DC bus voltage to drop slowly due to capacitance in the input filtering circuit. The reason for the input contactors switching off is attributed to safety signals dropping out due a fault observed specifically on 900VFD. When looking at the drive itself, a fault with code 4030 was displayed: Enc1 open wire.
This fault implies the encoder may be disconnected. The encoder wiring was checked: OK. The encoder cable was swapped with a unknown working one from an adjacent drive - the issue remained with 900VFD, which suggested the problem is with the drive itself. The encoder board (20-750-DENC-1) was swapped with an adjacent drive and the problem followed the board. The encoder board was then switched with a brand new spare (note: jumpers needed to be set!).
Upon power-cycling the system, the fault did not persist. Therefore, it is suspected that the encoder board had failed (in fact this happened previously with the same drive - see e-log 42). Upon inspection, one of the capacitors on the board appeared to be cracked - this will be investigated further to see if replacing it fixes the problem.

A spare encoder board will be ordered. This issue should be monitored in the future - it seems as if the drive itself is perhaps causing the encoder boards to fail.

Note: upon powering the system on again, another issue was noticed: 500VFD shows "drive not ready" fault. This is not displayed on the HMI though - it was just not possible to reset the safety system and this was only discovered from going online with the PLC. This will be investigated further.

Update 2024-04-26: the 500VFD "drive not ready fault" was investigated. It was determined that the SP+ (safety power +) signal wire was loose, which meant the safety signals to the drive were not getting through, causing it to remain in a "not ready" state. The wiring issue was corrected. Performing a safety reset resulted in successful drive enables across all drives. However, upon attempting to move the crane, even though all safety signals were green and it appeared to be able to move, it did not.
It turned out that there was a crane pendant fault: "Fault 305. Radio Control Receiver in Fault (3700RC)". This is exactly what happened previously in a similar situation (see e-log 55). The steps mentioned in that e-log were followed (power cycle, reconnect antenna/connector). Upon powering back up, everything worked as normal. The crane was tested in local mode - all three hoists up/down (main hoist run to upper limit), all trolley travels in each direction, and bridge travel in each direction.

As of now, everything is operating normally and all issues are considered to be resolved. A spare encoder board has been ordered.

The main trolley's E/W motion was observed to be slowed on 2024-02-13.
Upon investigation, the following faults were present:
- 200. Rotating Hook Velocity Difference between SSI Encoder and Drive Speed Feedback
- 82. Main Hoist Slack Rope

It is suspected that these faults are irrelevant in this situation. Upon inspection of the main trolley status screen, it was evident that both the SLOW EAST and SLOW WEST indicators were on (which matches observations). Clicking one of these status icons showed "Main Trolley Encoder Not Homed 2253ENC".

Logging in as an administrator allowed for homing the encoder.

The trolley was moved all the way East, to the limit, and the encoder was homed at position 0.389m (encoder count = 6886940). Note: the alignment arrows were not used as this would have required gaining access to the crane which was difficult at the time. It is suggested to properly home it in the future.

The E/W motions were fully tested to confirm proper slow down and stopping at the expected positions. The crane appears to be operational as of 2024-02-14.

 

It was observed recently that the main hoist's wires seemed skewed, and there was occasionally some noise heard when raising and lowering the hook block. It was suspected that this was due to wires having jumped in their tracks at some point. This is typically caused by side loading. It is possible that wire wrap skew occurred during the incident outlined in e-log 46. 

Gordon Crane was contacted for a service call. Crane inspector Ali from Gordon Crane was supervised/assisted by Maico Dalla Valle. They lowered the hoist down into the target pit and supported it on saw horses, then let the wires run all the way out. Ali confirmed that there was a wire wrapping issue, and re-seated the wires properly. The crane is now functioning normally. It is recommended to re-apply lubrication as soon as possible.  

Note: Ali from Gordon Crane has advised that it is acceptable for some degree of wire skew to occur - they can handle the abrasion if there's a small angle between them. However, wires should not be rubbing across each other at a large angle (ex. more than approx. 10 degrees). 

When the EHDT shielding service stand shield plug was installed in January it was found that the Beam Dump Outlet Hose (TEL5079) was interfering with the plug.  The following remedial action was taken:

- Upper lead water blocks disconnected and upper lead shield removed w/ hose assemblies and upper half of water blocks attached
- BD hose assembly TEL5079 removed by disconnecting Swagelok fittings
- A 1-1/8" spacer was added between the ceramic break and the 45 degree elbow
- The finished assembly was helium leak checked:  no leaks
- Final dimensions of the hose assembly were recorded for drawing updates (Isaac's notebook)

- All water blocks were disconnected (previous install used gaskets only w/o retainers so that a leak check could be performed)
- New gaskets manufacutred by Dan McDonald on Feb 2 (TEL4263)
- Gaskets cleaned w/ acetone and put into retainers (nice fit)
- Sealing surfaces on lower and upper half of BD water blocks cleaned with acetone, gaskets, installed, and torqued to 60ft*lbs w/ torque wrench and crows foot wrench
- TEL5079 reinstalled.  Swagelok nuts tightened to same rotational position as initial install
- Upper lead shield reinstalled (Feb 3)
- Upper lead water block sealing surfaces cleaned, blocks installed and torrqued to 60ft*lbs as w/ BD blocks

Before installation of upper lead water blocks I attempted to move, install, and uninstall the upper half of the water blocks using a 4' pole tool.  The blocks were fairly hard to manipulate due to the stiffness of the 1" hose.  The original design was to use a 1/2" hose, but we switched to 1" hose during a very rushed part of the project because of shorter lead times for 1" hoses.

As there is currently no beam planned for the next 4-6 weeks I will investigate replacing the upper lead shield and beam dump flex hoses with smaller diameter more flexible hoses.
 

The spacer flanges were installed on both turntables today.

See photos and information in the following DocuShare Collection: Collection-39816

Important note: the fitment was quite tight due to interference with universal joints and grease nipples. The flanges were still able to be installed with a bit of difficulty. They are not posing any immediate issues, but it is predicted that the adapter flanges will certainly interfere with drive system components. It is necessary to change the design of the adapter flanges to allow for the appropriate clearance.

A safety walkaround was completed for the ARIEL Hot Cell area.

The resulting spreadsheet can be found on DocuShare as Document-242733.

No major deficiencies identified.

A safety walkaround for July 2024 was completed for the B2 level by A. Newsome. No deficiencies to report.

Results can be found in the master spreadsheet

The position limit modification described in e-log 49 has been reverted. Currently the South soft limit is set back to 0.36m.

The limit was tested and confirmed (craned stopped at 0.33m position which is acceptable due to coasting). The entire bridge range of motion was checked to ensure there were no adverse effects - all is OK. The South bumpers need to be reinstalled - this will take place in the coming weeks.

Changes noted in crane log book.

Relevant work permit: A2022-05-30-3

Edit (2022-06-08): the bumpers have been re-installed.

 In August 2014 gasket corrosion tests were prepared by placing a 1" Swagelok VCR gasket in a 500mL beaker with de-ionized water and a 1"x3/4"x1/8" piece of 6061 aluminum.  Tests were prepared for a silver plated 316L SS gasket (Swagelok PN: SS-16-VCR-2), a silver plated nickel gasket (PN: NI-16-VCR-2), and a TRIUMF made 0.060" thick 6061 Al gasket.  The top of the beakers were sealed, and they were left to sit until March 2016.

The Nickel and SS gaskets show no noticeable corrosion.  The aluminum gasket became dull in colour, with some corrosion visible on the surface.  See attached photos of each gasket.  The gaskets have been bagged and stored with beam dump spare parts in the NW corner of the RH Meson Hall hot cell lab.

The non-existent safety limit switch for the target hall door which prevents remote motion has been bypassed in the crane PLC control panel to allow for remote operation of the crane. This will be un-bypassed when a switch is installed. Specifically, a jumper was placed from terminal 18001 to 20121 and 20141 which will enable the hall lock safety relays 2012SR and 2014SR. The crane is currently operational in both local and remote mode.

The location of the already installed blocks including the TSH0392 protruding lift bails were remeasured, and it was found that modification of the Standard Lock-Block Flat Top block was not required.  A Standard Lock-Block Flat Top block was installed in the place of TSH0487 in drawing TSH0372, and the remainder of the blocks on top were installed.  It was a tight fit for the lower two Half Height Lock-Blocks, but future removal of the BD shielding and SS plug should still be possible.  Drawing TSH0372 will be updated to reflect as-built status.

The remote handling 4" marman flange clamp was reinstalled today with a used seal.  It is "Clamp B" as tested in Document-114623.  The purpose of installing the clamp now is to prepare for the upcoming remote handling test of the vacuum joint and one of the water blocks.

During installation it was found that it will be necessary to manipulate both the BD flange and the EHDT beam pipe flange to have the seal mated on both of them.  Clamp installation will therefore be a 2 or 3 person job when done remotely.  The BD can be moved upstream by pushing on the back of the clamp mounting collar.  The EHDT beam pipe can be moved downstream by threading a pole tool into the collar just upstream of the vacuum flange.

If the clamp becomes stiff during early travel it means that the flanges aren't seated in the jaws properly and the position of the clamp or flanges must be adjusted.  Do not back off the clamp drive nut or lift the clamp in this case.  This procedure was followed during today's installation.

 A 4" Remote Handling Marman Flange Clamp was delivered to Doug Preddy today to be used to clamp the EHDT beam pipe section to the beam dump during beam pipe installation.

The clamp is one of the two manufactured in 2014, Identified with marker "B"

 Powered down ARIEL Target Hall Crane today by switching off main power switch on B1 level in preparation for site-wide BC Hydro power outage on Dec. 27-29.

Naimat Khan noticed after using the crane that some grease dropped onto a spreader bar, and believes it is a leak from the main hoist (see attached photo). The hoist should be inspected.

Edit: Dan McDonald notes that this has been observed since the crane was installed and is likely due to excess grease dropping out. Perhaps not a major concern.

Two small (approx. 5 cm across) puddles of green fluid were discovered on the floor, directly below the crane trolley.  The hook block was lowered and inspected.  No fluid found on hook block.
The plant group (Neil Wong) was notified and asked to schedule an inspection when the maintenance crew is on site to inspect the ISAC target hall crane.

The crane bridge and trolley were moved to another position on Friday evening and parked over the weekend.  The floor directly below the crane trolley was inspected on Monday morning.  Three very small (1-3cm diameter) puddles of green fluid were found.

December 12, 2024 - Chad Fisher, Albert Kong, Aaron Tam 

Tests:

Gas lines removal: 

• Starting with the most exterior connection, VCR connection loosened off with open ended conventional wrench
• Once loose, the nut can be un threaded with manipulator finger (rolling nut technique) 
• Once gas line unhooked, gasket removed by bringing female end outside the service tray footprint and jiggling until the gasket was removed
  • Also possible to use a pick if needed
• The same procedure was conducted for the interior VCR connection

Gas lines installation: 

• Starting with the inner most connection
• Gasket placed on 3D printed tool and clipped into position on VCR male end
• At first an M10 bolt was inserted into the elbow below VCR connection, but without rotational authority, the makeshift handle is not worth using
• Griping the elbow with one manipulator and rolling the nut onto the threads with the other proved successful
• Nut was tightened using conventional open ended 19mm wrench

Observations/Notes:

• Service Tray was not in a fully connected position, so even less space will be afforded.
  • This may affect the ability to get 2 manipulators on the same connection
• Piston modules were missing some limit wires on the side. These constrain movement horizontally and will either need to be removed as part of the procedure or, make the procedure more difficult
• Mass markers and various other connectors not installed, and these could slightly restrict movement as well
• Service tray pin was restricting the movement of the left manipulator during install
• Lighting was inadequate under the piston 

Recommendations/follow up items/questions:

• All metal Parker VGR style gaskets to replace plastic retainer versions
  • This is so that the degraded plastic doesn't break off and end up in the gas lines (upside down connections)
• A modified wrench with flats for handles and with more length would make the above procedures easier 
• Along with raising and lower the service tray, the service tray pin being oriented towards the beam entry direction, would make life easier 
• Still need to test gasket install on "other" Piston gas line connection
  • Chad will redesign some new gasket tools to be tested
    • side load and axial load gaskets, low and high clearance, aluminum construction 
• Lighting positioned to flood the service tray area will be needed
• labeling the gas lines with a more permanent solution will be needed
• Once the high voltage feed-through parts have come in, we can re-test and see if the piston module can be lowered to aid in target removal situations
• Aaron will test Parker style seals to see if they can be removed as easily once brought up to specified torque 

------------------------------------------------------------------------------------------------------------------------------------------------------------------

 December 16, 2024

• Upon inspecting the piston modules on AETE in TISA, we became aware of how the wires are arranged for the limit switches, it may be a good idea to look into how these wires are handled when using the piston module jig.

An issue was observed in which the pendant did not work to control the crane. This is the second time in recent memory this has happened. See e-log 55 for details. The same sequence of steps outlined in e-log 55 was followed, and the pendant control was re-established. It is still unclear what the root cause of this issue is, but it is suspected that the crane pendant loses communication with the receiver for some reason, and even though communication can be re-established, the reset button on the crane control console does not clear the fault message, and the system must be power-cycled in order to fully reset. This is just speculation based on what is observed. Further investigation required.

In preparing to troubleshoot the issue described in e-log #54, the crane was power cycled, and the pendant battery removed, to get to a "fresh start" state. Prior to this, the crane functioned normally aside from the incorrect E/W direction control on the North Aux Hoist.

Upon powering the crane back on, the pendant did not work to control the crane in any mode. The HMI had a fault present which read "305. Radio Control Receiver in Fault (3700RC)". This was accompanied by a red light in the safety control relay status summary screen, for "Radio Control Converter Communication Fault With Receiver (3714CONV)".

If the crane was placed in remote mode, the safety control relay status summary all turned green, and the reset button could be pressed, enabling remote mode. This means the issue was specific to the pendant/receiver communication specifically.

The receiver (in the cabinet in the control room) was inspected and the power status LED was on, the RF LED was off (which means there is no issue, OK), and the "OK to receive signal" LED was on - this indicates that the receiver was functioning as expected.

To further troubleshoot the issue - the crane was powered off, the receiver's antenna was disconnected and reconnected, and the multipin connector for the receiver was disconnected and reconnected. The system was powered back on, and the reset button was pressed. The fault message and the safety relay issue were cleared, and the pendant functioned again as normally expected (aside from the persistent issue from e-log #54).

It is unclear exactly what the issue was and how it was resolved, but could have been related to either a loose connector, or power cycling and resetting the system.

[edit 2023-01-03] The crane was powered back on this morning - there do not appear to be any faults on the HMI and it seems that the crane was unaffected by the power outage.

The ARIEL target hall overhead crane was powered off for the holidays. In the new year, throw the main disconnect in the crane control room to power back on.

An issue was observed in which the North Aux hoist failed to travel West when commanded to, but the East motion was functioning. The North Aux hoist Trolley was stuck in a position up against the East wall.

Present during troubleshooting: Adam N, Maico D, Tom K, Allon M, Travis C

After troubleshooting, it was determined that:

• There were no fault messages on the HMI display relating to this issue
• The HMI indicated "Bridge Not in North Limit and/or Auxiliary Trolley North Not in East or West Limit" - the Bridge was not in the north limit as described, and this message implies the PLC thought the North Aux hoist was somewhere along the middle of its travel
• The West run signal was reaching the remote receiver from the crane pendant
• The West and East run signals were correctly reaching their respective input pins on the VFD (DI1, DI2)... upon swapping wires and commanding it to run East, the West direction still did not function
• The VFD was displaying the correct output frequency information on its display when commanded to run East, but not west
• The limit switch was not related to this issue

Upon swapping out the VFD with the working one from the South Aux hoist, the North Aux hoist Trolley was able to move both East and West, as normal. It was therefore determined that the VFD had failed and must be replaced.

Current state of system as of July 3, 2020:

• The North Aux hoist is fully functioning (contains VFD from South one)
• The South Aux hoist is disabled (no VFD, breakers shut off)
• The North Aux hoist limit switch flag has been temporarily bypassed to allow for crane work in the target hall (not a safety issue - extended bumpers are installed and the regular bridge limit switches are functioning normally... this is only to allow the bridge to run its full length of travel when the North Aux hoist is at its fully East position)

Next steps:

• Adam Newsome requested quote for replacement drive (Delta Electronics TDN007E1100WM0) - will advise when replacement arrives
• Install replacement drive into South Aux hoist upon arrival (note: check EMC level modification)
• Verify entire system functioning as normal
• Reinstall North Aux hoist limit switch flag

The North Aux Hoist VFD which had failed (e-log 50) was replaced today by Tom Kauss and Adam Newsome on Work Permit A2022-03-15-1.

The hoist's motions were all tested - it is functioning normally again.

See E-Log 44 for details on North Aux Hoist failure.

A replacement VFD was ordered by Adam Newsome and installed by Tom Kauss.

Adam and Tom replaced the VFD in the South Aux hoist (which had been relocated to the North Aux hoist). The original braking resistor was used. No functionality changes to the system.

Both Aux hoists were tested: E/W travel, up/down travel. Each hoist is functioning correctly. E/W speeds were compared between the two hoists and found to be the same (~14 Hz for slow speed, ~95 Hz for fast speed).

The replacement job is complete and the issue outlined in E-Log 44 is resolved, although the original cause for failure has not been determined.

Current state of system as of Sept 9, 2020:

• The North Aux hoist is fully functioning (contains original VFD from South one)
• The South Aux hoist is fully functioning (contains newly replaced VFD with original braking resistor)
• The North Aux hoist limit switch flag has been temporarily bypassed to allow for crane work in the target hall (not a safety issue - extended bumpers are installed and the regular bridge limit switches are functioning normally... this is only to allow the bridge to run its full length of travel when the North Aux hoist is at its fully East position)

Next steps:

• Reinstall North Aux hoist limit switch flag (TBD when Target Hall installation work is done)

Update 2022-10-06: During routine inspection of the crane, Tom Kauss investigated the direction swap issue. It was determined that there was likely an issue with the initial installation of the new VFD back in March 2022, and that it was unnoticed (directional control wires crossed). The issue has been resolved by Tom Kauss and is no longer a concern. 

It was observed during operation today (Aug. 23, 2022) that the motion axes were reversed for East/West travel on the North Aux Hoist. i.e. when pressing the joystick on the local pendant in the East direction, the hoist traveled West, and vice-versa. This behaviour was not noticed (or at least not reported) before. It could potentially be related to the recent replacement which was done in March 2022 (https://elog.triumf.ca/TIS/RH-ARIEL/52), although the motion was checked after replacement. It is possible that an oversight was made in the testing at that time though.

The controls should be checked and the issue should be rectified as soon as possible. The Aux Hoist controls are not run through the PLC, but rather handled directly within the hoist's control box. It is recommended to go online with the PLC and check if there is any hint as to why this is occurring, before making any modifications. If no info can be gained, it is recommended to try swapping the VFDs for East and West motion, and check if that rectifies the issue. It is possible that the VFDs are programmed specifically for their direction output, and they simply need to be swapped. 

An issue was observed in which the North Aux hoist failed to travel West when commanded to, but the East motion was functioning. The up/down motion was also functioning. The North Aux Hoist Trolley failed during regular usage, seemingly randomly, when it was about 70% towards the West end of travel. Note that the West motion VFD inside the North Aux Hoist is the one previously taken from the South Aux Hoist (the same issue with the North Aux Hoist was observed last year, and the VFD was swapped, and a new one was installed in the South Aux Hoist).

A replacement VFD (Delta TDN007E1100WM0) will be ordered and installed, and this e-log will be updated.

Edit 2022-03-15: the replacement VFD has been installed and the system is operational. See e-log 52.

Edit: as of May 30, 2022, the modification has been reversed, and the crane is functioning normally as per the manufacturer's limits. 

Modifications have been made to the crane to allow for the South Aux Hoist to reach closer to the South wall during the ARIEL Hot Cell installation period. These modifications are temporary, and were considered to be a safer and simpler alternative to the modification proposed by the hot cell contractor workers, which involved installing a sort of come-along on the wall and pulling the hoist closer to obtain the desired reach. The following modifications were made:

1. Removal of the bumpers on the south side (T. Kauss). There are no bumpers on the South side of the crane’s bridge currently.

2. Modification of the PLC program to reduce the software limit by approximately 4 inches (A. Newsome). The previous soft limit was set at 0.36 m and it was reduced to 0.26 m (~3.9 inch reduction).

 These changes have been tested – the crane stops in the expected position. However, it is very close to the wall now. If you are using the crane anywhere near the South wall: exercise extreme caution. The crane automatically slows down when approaching the South wall, and there is plenty of time for the operator to react and further slow the motion by only holding the joystick down at about 20% speed. I strongly recommend operating at about 20% speed when close to the wall (on top of the automatic speed reduction I mentioned).  

• These changes are based on Work Permit A2022-01-06-1
• Changes have been noted in the crane’s logbook

See attached screenshot of PLC program indicating that the new limit has been reached.

Contact me (Adam Newsome) for more detailed information.

A 1/8" SS tube was routed from the Swagelok fitting on the front of the lower lead shield to the service stand water catch tray as shown in the attached photos.

The tube was routed to fit in the cut-out and chamfered corner gaps of block TSH0387 in the de-rated EHDT shielding assembly TSH0293.

 The lower half of the beam dump EHDT shielding was installed yesterday by Plant Group.  After installation of the service stand plug, the position of the south and east faces of the plug were checked with the laser tracker w.r.t. EHAT MB4.  The south face was within approximately 2mm of nominal, and the east face was approximately 6mm east of nominal position.  It was decided that this positioning was acceptable.  The modified 6 foot block (TSH0387) was then installed with approximately 4mm clearance from the plug according to TSH0293.

Beamlines Group may now proceed with installation of the EHDT section of beam pipe.

Photos and results of the laser tracker measurements are attached.

The load cell which is located on the crane itself to display the load to operators was reported not working during the week of November 15. It is planned to investigate on Nov. 25 and this e-log will be updated with the status.

Edit (2022-02-02): the load cell is functioning again. No changes were made.

On August 1, 2023 HC1 was pumped down to -1200 Pa (gauge) and then valved off to test the leak rate after turntables had been sealed with backer rod in the gaps.

The sealing with backer rod allowed the cell to reach the test pressure of 1000 Pa. The cell pressure equalized within 30-40 seconds which is an improvement but still not sufficient to meet the goals we have set.

Next step is to pump down to -500 Pa and use smoke generator and perform thorough investigation to identify any leaks.

On Tuesday, February 14th I finished modifying Jason's boxes for the remote crane tests by adding shelves to mount cameras... Apart from given the edges a quick sanding (so no one gets slivers)...which I will try and do tomorrow.

On November 28th the lower lead shield was installed with 3/8" shimming at the front end, and 11/32" shimming at the rear end.  The south and east faces were aligned as flush as possible with the lower center block.  The beam dump insert was then placed on the rails in the lower lead shield.

Laser tracker measurements were performed by Michael Vogel, and he reported that the beam dump was 1.7mm high at the rear, and 0.8mm high at the front.

The lower lead shield was lifted, and 1/32" shimming was removed from the front, and 3/32" from the rear.  The block was then placed precisely using the laser tracker with targets on the beam dump insert.

After placing the lower lead shield, Michael aligned the beam dump by shimming and adjusting the rail track, and was able to get all fiducial points within 0.2mm of the nominal position.

Painting and relabeling of the modified lower center block (TSH0461) was completed on Monday Nov 24.  The height of the modified block was measured at the four corners using a tape measure and found to be approximately 533mm at all corners.

The block was lowered to the E-Hall and aligned on Tuesday Nov 25.   No cantilever lift was required because the catwalk above the hatch had been removed.  During the block installation one of the crane cables was contacting the concrete on the edge of hatch opening.  Future installations should use a long sling or cable to prevent this.  Photos of the installation are attached.  Beamlines Group assisted with alignment using their laser tracker.  Vertical alignment was achieved using 3x3" metal shims of various thicknesses placed at 4 corners of the block.  North-south, east-west alignment was achieved by installing based on marks drawn on the E-Hall floor by Beamlines group.  After initial placement, measurements were taken with the laser tracker, and the position was adjusted.  The nominal positions of the beam dump according to installation drawing TSH0372 are:

East Face: x=-5926.3mm from EHBT CoP
South Face:  y=2223.6mm from EHBT CoP
Top Face: z=-208.0mm from EHBT CoP

The laser tracker measurements of block position after final placement are as follows:

East Face: x = -5926.2 ~ -5926.9mm
South Face: y = 2220.9 ~ 2224.7mm
Top Face: z = -209.6 ~ 211.6mm

The East face is within 0.6mm of nominal position which is excellent (note that the east-west direction cannot be corrected using the alignment rail track).  The south face position is within 2.7mm.  This is fine because adjustment can be made to the north-south position of the rail track.  The top face of the block is a maximum of 3.6mm below the nominal position which is also fine, as the lower lead shield block can be shimmed up to it's nominal position.  Data from Beamlines Group is attached (note that 19.05mm must be added to each measurement to account for the distance from target base to center).  The location of the measurement points on the top face are as follows.

                 North Side
--------------------------------------------
| 6                  4                  2 |
|                                           |
| 5                  3                  1 |
--------------------------------------------
 

We will aim to have the bottom of the lower lead shield at z = -204.8mm (this leaves nominal 2mm space to be shimmed under the rail track to bring the BD flange center to beam height).  Therefore the following thickness shims should be placed on the top of the lower center block.

Position 1: 5.8mm (suggest 1/8 + 1/16 + 1/32" shim = 5.6mm)
Position 2: 5.9mm (suggest 1/8 + 1/16 + 1/32" shim = 5.6mm)
Position 3: 6.8mm
Position 4: 6.0mm
Position 5: 5.1mm (suggest 1/8 + 1/16" shim = 4.8mm)
Position 6: 4.8mm (suggest 1/8 + 1/16" shim = 4.8mm)

Position 3 and 4 do not need shims, as the outer four corners should be adequate.

During the maintenance period today the E-Hall tunnel was accessed to begin controls tests on the beam dump water system and initial fill of the system.  This work was done by Bill Richert and Dave Morris while I observed.  Before work began I verified that pressure relief valves were installed as per the P&ID (TEL5104 Rev A) - they have been installed but the exhaust ports from the valves have not yet been routed to the active drain.  They first tested the hydrogen venting and measuring system in the E-Hall and all seemed to work properly.  Next, in the tunnel Dave confirmed that he was able to actuate the solenoid valve used for filling the system from EPICS.  Next the pressure sensor used to determine expansion tank level was tested - although not calibrated properly yet they were able to confirm that it is wired correctly and responding as expected.  Upon inspection of the pump it was found that the pump motor was not mounted properly to the support plate below (this should have been done by the supplier before delivery).  Because the pump cannot be run in this state it was decided not to fill the system at this point.  Bill Richert will have the pump properly mounted before the system is filled, possibly during the two day maintenance period next week.

It was reported that the hot cell turntables would not rotate and the access hatch could not be operated. The turntables' elevation motion was working normally, and other cell functions were working.

Upon investigation, after going online with the PLC and checking the interlocks for the turntable, it was determined that motion was being prevented because the turntables were in the "critical position" in which they could interfere with the access hatch raising/lowering. However, the access hatch was fully closed, so this logic should not have been actively preventing motion. After inspecting the target access hatch limit switches, it was determined that the upper limit switch's Normally Open contacts were behaving normally, but the Normally Closed ones were not. When the switch was toggled, the NO contacts did not switch over. Thus, the sensor was in an unknown state causing conflicting logic in the PLC (the program thought the access hatch was in an intermediate state between opened and closed, thus preventing motion... and the access hatch could not move because the turntables were in the "critical position"). After testing the switch multiple times, jiggling the wiring/contacts, and rewiring one of the screw terminals, the NO contacts started working normally again. It is suspected that a wire was loose. 

The issue has been resolved and tested - the access hatch logic is functioning regularly and both turntables can fully rotate and elevate.

A fault occurred which presented as "114. Main Hoist Cable Broken (3200PX)". This occurred when a SEG block was suspended approximately 1 m off the ground.

Upon inspection, it was determined that the cable was in fact not broken, but wrapped around itself. There are no guides, and it is possible for the cable to double wrap if loaded in an usual fashion. This condition triggered the "Hoist Rocker Switch 1" sensor, 3200PX. The sensor is not visible or accessible from ground level, and could not be inspected, but it was confirmed that there was no 24 VDC PLC input at 30000EA:I.Data[7].0, as would be expected under normal operating conditions.

To rectify the issue:

• The sensor was bypassed in the control panel by connecting wire 32001 directly to 24 VDC after confirming that there would be no adverse affects from doing this.
• With careful supervision, the load was lowered, while watching the cabling.
• The load was removed from the crane.
• The hoist was then lowered to its extreme lower limit, and the cable unwrapped itself naturally as it was being lowered.
• The sensor bypass was removed.
• The sensor began functioning normally again when the wrapping issue was resolved.
• The hoist was raised and lowered multiple times to confirm the cable wrapping issue was no longer present.

The crane is returned to its normally functioning state. Operators will keep a lookout for any more issues relating to the hoist cable. The crane will be inspected on Sept. 22, 2021.

 December 12, 2024 - Chad Fisher, Albert Kong, Aaron Tam, Austin Hagen

Tests:

Loose piece connection and removal 

• By hand, the two connections were brought together and removed carefully

Observation/notes:

• Copper extensions are fragile and can bend when removing extraction electrode. 
  • This makes this part fairly limited in its capacity to be re-used
  • Copper extensions will need to be tuned before inserting into hotcell for replacement 

Recommendations/follow up items/questions:

• Bigger lead-ins would be appreciated
• What is the exchange frequency?
• the flexible nature of the copper extensions makes re-use limited
• How many connections can we expect from the aluminum fingers?
• Would a closer locating feature specific to the pins help?

December 12, 2024 - Michael Genix, Aaron Tam 

• Guide pins for the extraction electrode contact before the banana plugs
  • As these pins are low tolerance, this will act as the guiding for the plugs
  • Copper extensions have a much smaller diameter than the plugs, so positioning can be less precise in this area 
• Exchange frequency is still TBD
• Pin and plug life is still TBD
• Potentially the copper extensions can be tuned in the hotcell

- On May 4th the EHDT beam pipe section was installed by Mike Vogel of Beamlines Group
- A new Helicoflex seal was used (provided by Vacuum Group)
- 4" RH Clamp was installed by Isaac Earle.  Clamp became stiff in early travel, was backed off, then fully tighetend down to stop-ring (later learned that early stiffness was likely due to lower part of jaw hitting the outside of the flange and it would have been better to jiggle the clamp rather than back off)
- Pump was started on May 4th end of day by Anthony Ip (turbo pump, no ion pump)

- Vacuum level at low 10E-6 Torr by morning May 5th.  Leak check was performed by Anthony.
- Small leak found at top of 4" seal. No other leaks in system.
- Baseline leak rate ~4*10E-8 Torr*L/s.  Reaching plateau of 1*10E-7Torr*L/s when flooded with helium
- Leak is suspected to be caused by beginning torquign clamp then backing off as mentioned above

- Beamline vented and seal removed (will be reinstalled after water hose swap, before RH test)

- The hoist rings were removed from the upper lead shield
- Two standard lock-blocks were installed over the E-Linac beam dump according to TSH0372
- 5/8" of shims were required on the north end of both blocks to make them level.  Aluminum shims were used (1/2" + 1/8")
- The service stand plug was also installed using a cable sling and chain-fall pulley setup prepared by Neil Wong (tight fit with surrounding shielding, but the install went smoothly)
- No change in EHDT vacuum (approximately 3.0E-8 Torr)
- The modified block TSH0487 is now required.  Installation will continue once it is ready.

Upon powering on the crane today and attempting to use the main hoist, the following faults were present:

1. Main Hoist East Drum North Motor Drive Fault (700VFD)
2. Main Hoist West Drum South Motor Drive Fault (900VFD)
3. Main Hoist East Drum North Motor Drive Not Ready (700VFD)

Note that the auxiliary hoists functioned as normal.

Upon power cycling the crane to reset, the faults disappeared, and the main hoist functioned normally again. The root cause of the issue is unknown. It is suspected to be related to either prolonged inactivity, improper safety reset sequence, or the battery being removed from the pendant. This issue will be monitored for re-occurrence.

Testing was performed on the ceramic water breaks to be used on the beam dump water hose assemblies.  The ceramic breaks are a custom MDC product with the following description:  3kV ceramic break, 1" OD tube 0.083" wall thickness, 2" length, 304SS tube stub each end, 250psi water rating (see TRIUMF PO#  TR199315).

A load was applied perpendicular to the part, 12" away from the center of the ceramic, and increased incrementally until failure.  Two parts were tested, which failed at 125lbf and 170lbf. Equivalent to 125ft*lb and 170ft*lb when converted to torque.  Test data, photos of the failed specimens, and a more detailed description of the test setup are attached.

The purpose of the tests was to gain an understanding of how fragile the ceramic parts are.  The results show that the ceramic breaks should be able to withstand the expected loads caused by the flexible hoses being pulled as the RH water blocks are installed or removed remotely using pole tools, however this operation should still be done cautiously.  The ceramic breaks are at risk of failure if a torque of over 100ft*lb is applied, such as if someone were to stand on the ceramic breaks or the attached hose.

I received a call today from Jim Adamson at Kaltech regarding modifications to shielding block TSH0225.

They had finished removing 19mm from the bottom of the block, as well as removing 10mm of material from the side plates (TSH0246).  He was wondering whether it was also necessary to remove material from the back plate (TSH0253) and weld the back plate to the 6" plate (TSH0252).  I instructed him that it is not necessary to machine and weld the back plate.  This decision is based on weld strength calculations I performed last week which showed that the existing welds are much stronger than what is required to take the load applied when lifting the block (FOS >> 10)

It was observed today that the crane's west light was not functioning.

There was an issue with a 20 A circuit breaker used to control motor assist functions for the telemanipulators (specifically, the rightmost CB in the panel for the right (East) manipulator set). This circuit breaker was moved to the panel for the left (West) manipulator set in the rightmost position, and then subsequently replaced with a new one, which is functioning correctly. It is suspected that the former CB which was not working was calibrated towards the low end from the factory, based on discussions with the manufacturer and extensive testing of multiple scenarios.

The bridge motion was slowed due to encoder homing issue. It is likely that the problem which occurred yesterday caused an velocity fault (mismatch between encoder speed and commanded speed), which unlatches the homing status for the bridge motion axis.

When the bridge was in the southmost position (bumper pressed against wall), the position readback was: 0.353 m, encoder count = 5164003.

The bridge was moved to the "zero position" as indicated on the remote display - the tick was aligned with the zero.

The encoder was homed at this position. The home position readback was: 0.356 m, encoder count = 5164447. Note that this position is in alignment with the measuring tape zero mark, not pressed up against the wall.

The bridge was run to its full extreme positions in either direction to confirm proper slowdown and stopping behaviour. It appears to be functioning normally again.

Beam dump waterblocks #1 (BD Inlet) and #3 (Upper Pb Inlet) were removed as per the attached procedure on June 1-2.  The following was noted:

- The RH pole tool (TRH1244) and water tool wrench (TRH1243) fit easily over all four water block nuts and was easy to use

- The rubber nut thread tool was sometimes difficult to located in the hole on the water block (WB) lower half body, could be done after a few attempts, perhaps tool locating feature can be improved

- The rubber nut thread tool worked well, but a new one should be made as it is starting to degrade and drop pieces of rubber

- The WB upper halves must be lifted carefully with the pole tool supported well to prevent them from swinging in the east direction due to water hose stiffness

- The gasket/retainer assembly on the WB lower half is likely to become dislodged when removing the WB upper half.

- A tool must be developed for picking up the old gasket w/o damaging the WB lower half gland (could simply be a plastic hook attachement)

- A tool must be developed for placing a new gasket on the lower gland (concept in progress by Keith Ng)

- Installation of the upper water blocks (#3 and #4) may require assistance with a hook tool to get the upper WB in the correct orientation.  The lower water blocks (#1 and #2) should not

See attached procedure for full details and photographs.  More photos and videos of the procedure are stored on Isaac Earle's hard drive.

- On Thurdsay June 4th the EHDT beamline section was vented by Vacuum Group so that they could install a new pump
- After pumping down again a leak was found at the BD front flange seal around the top of the seal
- The RH clamp and Helicoflex seal were removed and an o-ring seal was installed with a band clamp
- The EHDT section was pumped down and leak check performed - no leaks

- While the EHDT section was vented both flanges were measured and found to be in spec (see attached PDF)
- The clamp jaws were also checked and were in spec (see PDF)
- Seal was inspected: delta fully crushed at bottom, but a visible ridge remained around the top

- A meeting was held on June 5, with Grant Minor, Isaac Earle, Keith Ng, and Bill Paley in attendance.  Meeting minutes copied below:

Meeting Summary:
- We suspect the leak is caused by inadequate seal compression
- The leaks on this installation may be because of the new batch of seals which are thinner (by ~0.006") and have a less pronounced delta  (all the successful installations on 2A are using the old batch of seals)
- It is possible that the recent bench tests performed with the new batch of seals also had very small leaks that were not detectable with the "Star Wars" leak detector
- The clamp must be modified to achieve the manufacturer seal compression spec (currently 0.020" short)
- We will not pursue testing of clamp closure beyond the point where the jaws are concentric (0.685" stop-ring)

Actions:
- As a temporary measure a seal from the old batch will be installed at the e-dump next Monday (Keith, Isaac, Bill)
- Modified clamp jaws, to achieve design seal compression, will be designed/ordered (Keith), and bench tested (Keith, Isaac/Bill)
- We will pursue purchase of a new leak detector for the lab.  If leak checking is required before then we will borrow a modern detector from Vacuum Group  (Isaac)
- If the old batch seal installation at the beam dump is leak tight, we will still switch to a new seal and modified clamp jaws once development is complete and an opportunity to swap presents itself (Isaac)

- Vacuum has been pumping steadily on the EHDT section since June 8, reaching 3.2E-8 Torr at 8am today (June 12)
- Leak check performed this morning by Anthony Ip: no leaks
- Vacuum vented and re-pumped, leak check repeated: no leaks
- Reached 5.0E-7 Torr by 9:20am

Installation of shielding over the beam dump will begin next Tuesday.

The following work was performed on May 27 & 28, 2015:

- The beam dump 10kW Remote Handling setup was arranged as shown in the attached procedure

- The EHDT split ring clamp was found to be installed too far downstream and the pole tool could not be installed properly;  the position was adjusted

- The cuff of the previously installed used seal was found to be damaged because it was not located properly on the EHDT side flange at the bottom when the clamp was closed.  Thorough inspection (visual from top, camera for bottom) must be used in the future to prevent this from happening again

- Flange gap was measured with the beam dump in far upstream and downstream positions:  .190" and .762" 

- Seal width is 0.255", and cuff width is 0.475", giving 0.297" clearance for installation, and .065" bellows compression when closed 

- EHDT beam pipe was adjusted approximately 0.125" downstream to give more bellows compression with seal installed and the BD advanced upstream 

- New flange gaps: 0.083" and 0.649;  New instillation clearance: 0.174"; New bellows compression: 0.172" 

- Two trial seal installations were performed according to the attached procedure (no major issues encountered)

- A new helicoflex seal was used for the final installation (also according to the procedure).  One of the clamp jaws did not seat properly around the flanges at beginning of travel; this was overcome by backing up 1/4 turn and adjusting the clamp angle to get the jaws seated properly.  After this the clamp closed normally.

- A helium leak check was performed by Anothony Ip from Vacuum Group:  No leaks found!

See attached procedure for full details and photographs (updated document uploaded June 2 to include comments from Ron K.)

 On Monday June 8 the following work was performed by Isaac Earle and Keith Ng:

- EHDT beamline vented
- Band clamp and o-ring seal removed
- Flanges cleaned with methanol and Kimwipe
- Flanges inspected visually: clean and scratch free
- New seal prepared as per TEL5568 from old 1997 batch of seals (as decided at Friday June 5 meeting)
- Seal cleaned with methanol and Kimwipe
- Seal installed remotely following procedure attached to Ariel E-Log #18 (install went smoothly, no catching of clamp jaws)
   Rocking the clamp back and forth while tightening seemed to be a good technique to avoid jaws catching on outside of flanges
   Clamp began getting stiff with around 5/8" of gap remaining to stop ring.  It gradually got stiffer as travel progressed until reaching hardstop
- Inspected visulally close up: all appeared normal
- Vacuum pumped at 10:15am, Leak check performed around 11:30am - Leak tight

- Will leave the BD under vacuum for a few days, then attempt to vent, repump, and repeat leak check (which caused failure before)
- RH bridges removed to allow water lines in north-west corner to be reinstalled
 

 As there likely won't be an opportunity to properly document the design of the beam dump insert and cooled lead shielding in design notes, a list of design reviews, released on Docushare is provided below.  These provide a reasonable overview of the design process for each item.  In addition the attached PDF of scanned notes provides detailed information on the lead shielding design.  Further notes, ANSYS documents, meeting minutes, concept reviews, etc, can be be found on Isaac Earle's hard drive.  Released drawings for each completed design are available on the PDM Works Vault.

DR-P0104-35 (Document-110856):   Design Review for the e-Linac 100kW Tuning Dump Pb Shielding

DR.P0104-23  (Document-104081):   E-Linac 100kW Tuning Dump Water Cooling Package Concept Design Review

DR-P0104-41:   Design Review for the Tuning Dump Local Shielding (10kW De-Rated)

DR.P0104-24 (Document-104082):   E-Linac 100kW Beam Dump Insert Design Review

DR.P0104-32  (Document-109104):   E-Linac 100kW Beam Dump Shielding Design Review

 Hardness testing was performed on 1 sample each of parts TBP1822 and TBP1823 (part of the 35-deg magnet stand assembly TBP1804),  They were found to be 60-60.5 Rc and 60-61 Rc respectively which is within spec.  The alloy used to fabricate these parts was AISI #8620. The testing was performed by Precision Heat Treat in Surrey who also performed the heat treatment at an earlier date.

Assembly of two complete bender stands was completed on Friday June 2nd as well as installation of new hardware on the dipole magnets for support, adjustment, and seismic restraint.  All parts were installed according to drawing TBP1804.

One of the frames was assembled with the caster wheel configuration.  This frame was pushed from the proton hall B2 level to its final installation location in the ARIEL tunnel.  The frame was a tight fit around the first corner around BPM 26 but it could still pass by without having to remove any items including the electrical boxes on the right side of the tunnel (when facing towards ARIEL).  Part of the grouting for the BPM 26 support stand and the next three stands after that was ground away to allow more clearance for the frame.  The nut/bolt on the frame casters on one side were swapped which also provides an additional ~1/8" clearance.  After these modifications the stand was pushed out past this area and then back to its installation spot confirming that there is now ample clearance.

The other frame was assembled in the configuration with stand legs.  This frame has been moved to the proton hall extension loading bay to be used for magnet field testing.

Both dipole magnets have been assembled with the new adjuster blocks and support legs.  For the magnet labeled “No.01” the original support legs were removed, cleaned in the ultrasonic cleaner, and then reassembled with way oil  The support leg support pads (TBP1822) were replaced with new parts, but all other parts were reused.  For the other magnet, labeled “No.03”, new support legs were fabricated because it was supported differently in its previous location and did not have these parts.  The fasteners attaching the adjuster blocks and support legs to the magnets were torqued to the recommended torque for each fastener based on the fastener grade and size.

Various minor changes to the design were made since the release of drawings, primarily to improve ease of manufacture.  As-built drawings will be released after the magnets have been installed on the stands in case additional changes arise.

Adjustment blocks were installed on the second dipole bender today (labeled "No. 03" "C15-III-57/15").  The mounting holes on the magnet were not aligned properly, so modification was required for two of the blocks.  The counterbored holes on TBP1809 were slotted 0.10" vertically, and on TBP1808, 0.06" horizontal slotting was required.  A stress analysis was performed to confirm that the blocks are still strong enough to withstand the seismic loads (PDF attached).

 BL4N 35-deg bender magnet "No. 1" has been installed onto the magnet stand with "stand leg" configuration in the Proton Hall Extension loading bay area.  The magnet fit as expected, and with the support legs resting on the ball transfers the magnet position could be easily adjusted by turning one of the adjuster leg fasteners (with the others loose).  After experimenting with position adjustment, the fasteners were torqued to 70ft*lbs.

The engineering analysis (Document #138415) as well as drawings TBP1804, 1805, 1806, 1811, and 1820 are in the process of being updated to reflect all as-built changes.

 The beam dump and upper lead shield flexible hose assemblies have been replaced with smaller diameter versions to allow for easier remote handling.  The new beam dump hoses are TEL5501 (Rev A) & TEL5502 (Rev A).  The new upper lead hoses are TEL5503 (Rev B) and TEL5504 (Rev B).  All Swagelok joints were installed 1-1/4 turns past finger tight as per Swagelok instructions.  The new Swagelok connections have not been leak tested yet.  This will be done after the remote handling test of the vacuum seal and water block which is scheduled to begin on May 27th.

A leak test was performed on the beam dump water system on June 9 in the afternoon.

- Pipe segments tested: The entire HAW system except for the expansion tank, air separator and HAW pump
- Test medium: air
- Test pressure and duration: 60 minutes at 50psi with no loss in pressure
- Swagelok joints and VCR joints around the beam dump which had been opened since last test were sprayed with Snoop: no bubbles

On Dec 2 the cables from the BD service stand area to the junction box were traced to establish which sensors correspond to which cable number in the junction box.

The beam dump thermocouple probe cable numbers are as follows (as labeled on the beam dump and the TC block upper half):
TC#1: T44,  TC#2: T55,  TC#3: T11,  TC#4:  T22,  TC#5: T66,  TC#6: T77
 

The service stand water sensor cable numbers are as follows:
Inside Tray, East Side: 44
Inside Tray, West Side: 22
Under Tray, East Side: 33
Under Tray, West Side: 11

On March 29, 2017, a 9 tonne steel shield block was transferred from the ARIEL Target Pit and placed into a 
wood container on the Target Hall B1 level with the overhead crane main hoist in Local Mode without incident. 
Afterwards, the overhead crane was switched into Test Mode (which is the same as Remote Mode but without the 
Target Hall interlocked) and an attempt was made to transfer the shield block from the wood container on the B1 
level to a wood container in the Target Pit remotely with the main hoist. At 11:51:09, after lifting the shield 
block ~1 m above the B1 level, a "136. Main Hoist West Drum South Motor Drive Fault (900 VFD)" alarm pop-up was 
shown on the overhead crane HMI in the crane control room which disabled the controls on the remote console. 
The reset button on the remote console was pressed and the remote lifting operation was resumed briefly until 
the same fault occurred at 11:51:42 and the reset button was pushed once again. While attempting to lower the 
shield block back down to the ground this fault-reset sequence reoccurred at 11:57:25, 11:58:16, 11:58:28, 
11:58:43, 11:59:27, and 12:00:27, at which point the remote crane operation was aborted and the shield block 
was lowered down to the Target Pit floor with the main hoist in Local Mode, without incident. The Test Mode 
faults did not appear to depend upon the speed/acceleration of the lift, nor did they appear to be spaced apart 
by a fixed time interval. Upon closer inspection of the alarm history screen in the HMI (shown below) and the 
exported alarm log (attached below), almost every time the fault #136 occurred, the following three additional 
faults were logged simultaneously in the alarm history (but were not displayed as a pop-up on the main HMI 
screen):
"103. Main Hoist East Drum North Motor Drive Fault (700 VFD)" 
"104. Main Hoist East Drum South Motor Drive Fault (800 VFD)" 
"135. Main Hoist West Drum North Motor Drive Fault (1000 VFD)" 

On March 31, 2017, the overhead crane main hoist was operated once again in Test Mode; however, no load was 
connected to the hook block to determine if the faults that occurred two days earlier could depend on the load. 
The main hoist hook block was remotely lowered ~3 m below the upper 'home' position, and then remotely raised 
as high as possible to function test the upper limit switch in remote mode; at 14:21:05 immediately after 
initiating the 'hoist up' motion, the same four faults occurred simultaneously. This incident shows that these 
specific faults do not depend on what load is connected to the hook block. Note: the crane position data from 
March 31 is attached below, however the times shown are 1 hour fast due a DST adjustment error.

Follow up with the crane supplier, COH, is required to obtain a index and troubleshooting guide for these (and 
all other) fault codes.

2017-04-06 update: Sylvain Raymond of COH has been assigned to resolve these crane faults by Maxime Dubé-Blanchet 
of COH.

A spare pendant for the overhead crane was procured from COH. The pendant's functionality is the same as the original one's. The pendant was tested today by Adam Newsome - all functions behave as expected.

Important - to change to the spare pendant in the case of failure of the original one, insert a battery into it, and transfer over the small black transmitter card shown in the attached picture. The pendant will not pair with the receiver without this card. There is nothing else that needs to be set up for it to work.

The spare pendant is kept in a labeled box on top of the electrical cabinets located in the crane control room (L1 floor).

Today while operating the crane with load, the crane stopped moving. Upon investigating, all safety signals appeared to be OK. Fault messages regarding drive faults for various VFDs were present, which seemed to stem from an ethernet adapter card fault (see attached photo). It is unknown how this occurred, but suspected that it was due to a brief blip in network communications or the external drive power supply control signal. It is worth noting that the diesel generator tests took place today, and there could have been some affect from a power surge because of this.

The crane was power-cycled using the main disconnect, and safety system reset. The faults disappeared. The crane was operational again.

If this issue occurs again, it should be investigated more thoroughly. It would be worth checking if there were any generator tests or other things which could cause some sort of power surge.

Dec 10, 2024

Testing completed:
 - Used hydraulic scissor jack cart to test raising/lowering service tray onto front-end, with only manipulators, placement of jack table done by hand because it isn't freely moving on the plane of the lift table.
 - Removal and insertion of the center post pin with indirect view to FE.
 - Application and removal of VCR gaskets on HVFT water connection array with 3D printed tool, only for 1/2" size (service tray side of VCR joints).
 - Checking whether the VCR joints can be done up with the service tray 'lifted' (not fully connected but the screws on the HVFT bracket are slid onto their slots)


Observation/notes:
 - Lift table slope creates some difficulty bringing the service tray up.
 - Effective misalignment of service tray changes with the degree in which it is 'brought up' because the ribbon connectors start to compress and exert load, tipping the service tray. There isn't a 'CG' that we can place the table under which will balance the service tray throughout the attachment operation.
 - Service tray is large and will not be fully supported by the base jig without custom jig on top.
 - Using a clamped piece of 2x4 wood on the jack cart worked to increase the supported region during testing, something similar with the base jig may work.
 - The service tray needs to be brought up such that the HVFT is ~1" from being fully engaged before the screws on the bracket can be upturned and start to engage. Likely the bus bar connectors will have started engaging before this is achieved (bus bar connectors roughly 2" in depth), this can create complications because the loading on the base jig will be really uneven at that point.
 - The pin for the center post can be easier to handle if we added a handle or an extender. A makeshift handle was made using tape and scrap U-channel nearby.
 - We managed to remove and attach the pin with the HTV table facing East using a remote camera view, but in practice it would be ideal if we could rotate the front end with service tray supported by some jig between orientations where the HVFT and center post are more easily accessed. This will require the ribbons and the alignment cylinders on the HVFT to transmit some force onto the lift table to overcome any friction the base jig may have on the lift table during rotation.
 - With the brackets on the HVFT on, we were able to start and even tighten the VCR joint closest to the corner bracket (using low clearance wrench, no photo).
 - Difficult to get at all brackets on HVFT and do up, will need cameras irrespective of the orientation, did not do up the bracket yet so we don't know how careful we need to be when inching each up and establishing the HVFT connection.
 - Difficult to get at and rotate screws on HVFT bracket, with torque tool due to proximity with HVFT structure, a longer bit on the torque tool will be beneficial. Note, using an Allen key with the manipulator gripper is difficult because of the same issue.
 - VCR wrenches slippery without catching features, will add pin for better grip
 - If 'fence' on HVFT for water lines is taken off it is quite easy to loose track of where the lines are supposed to return to, should have markings/labels for where the water lines need to return.
 - HTV side ribbons bend inward instead of outward.

Recommendations/follow up items/questions + answers as appropriate:
 - Consider adding grabbing features and an extender attachment for the center post pin: (Dec 16, 2024) Michael agreed to cut the tab and cross-pin the center post pin to match the HTV water connector pins.
 - Can we change the screws used on the HVFT bracket to be longer so it can engaging before the bus bars? (Dec 16, 2024) Michael will look into.
 - Can we add a lip to the HVFT top brackets to keep the screws in place and not fall out during tightening? (Dec 16, 2024) Michael will look into.
 - Consider more items that may help simplify the brackets on the HVFT
 - Is it possible to re-orient the center post holes to be toward the HVFT instead of aligned with the HTV platform axis, this may avoid the need for re-orienting the FE when raising/lowering the service tray. (Dec 16, 2024) Michael will look into.
 - Need to capture effect of bus bars connection in future testing. (Dec 16, 2024) Albert will design and send something to the shop to work with Phoenix's mock up.
 - Need to repeat service tray testing with base jig.
 - Check if ribbons are bending in the right direction. (Dec 16, 2024) Yes.
 - Perform full service tray coupling with actual machined brackets to inform coupling operation (3D printed brackets currently not strong enough and deflect unrealistically).(Dec 16, 2024) received spares from Michael.
 - Need modification to wrench to prevent slippage. (Dec 16, 2024) Albert and Aaron working on this (will simply add cross-pin)
 - VCR gasket tool for smaller size VCR's to be made.(Dec 16, 2024) Chad to do.
 - Real deal VCR gasket tools to be made out of soft metal to prevent scratching sealing surfaces in operation
 - If not possible to do with base jig, possibly a suspended plate with turnbuckles instead will be sufficient to support the service tray during attachment/removal operations. (Dec 16, 2024) Discussed with Michael the possibility of changing the HVFT 'cables' to threaded rod to also facilitate ejection of the service tray on the HVFT side (necessary to disconnect bus bar connections).

 

We successfully performed a removal and replacement of a power busbar stabuli connector on the front end plate where the HTV connects to:

• The middle-lower connector was tested as the others are more straightforward to work with.
• It may be a good idea to use a 3D printed jig to wedge into the connectors without damaging the flexures/pins.
• A longer hex bit on the hot cell torque tool would greatly help this operation.
• Even without special tooling the bottom connector returned and mated back onto the locating features relatively easily with just the manipulators.
• Longer hex bits purchased, 3D printed too left for future.
• Screws and washers are effectively captive in the connectors which helps

The APTW front end was moved into the hot cell, on the lift table, following procedures outlined in Document-244862.

The mock-up frame was transferred from the east turntable to the west turntable above the front end. The east turntable is covered with the aluminum plate. During covering we accidentally broke the o-ring for the turntable plate flange. The new o-ring seal should be made ~1" longer in circumference to avoid difficulties with seating in the o-ring groove.

When we attempted to move the front-end with the manipulator, we noticed that the front end tended to carry on sliding down the slope of the hot cell (see TRI-DN-23-20 / Document-238536). The manipulators were subsequently unable to arrest the front end, likely because they cannot apply a load towards the CG of the front end. Therefore, for heavy-duty jigs in the hot cell it is advisable to avoid using wheels/rollers that allow the heavy assemblies to move freely on the lift table.

--------------------------------------------------------------------------------

UPDATE Nov 21, 2024

• FE attachment related tests completed:
  • replacement of shim plates
  • mock-up alignment of FE with shield plug (adjustment made in person, hot cell operator instruct and give direction with remote camera views
• Difficulties encountered:
  • keeping track of which hole/screws are seen by the cameras during alignment was difficult for the operator
  • shim plate awkward to handle if not familiar
  • incompatible coupling screw and nut threads (M24 course vs fine threads) prevent completion of coupling and uncoupling tests
  • 'loose' service tray requires separate alignment check when raising the FE with the lift table
• Lessons learned:
  • shim plate replacement easier if FE is semi-attached (screw lifts FE, leaving small gap for shim plate to be inserted)
  • need a cover plate to prevent dropping shim plate and associated screws
  • rotation clearance of FE checked, will clear
  • need to also check service tray alignment when raising
  • magnetic cameras would be beneficial for this operation
• Follow up items:
  • crane-based positioning of FE for replacement to be tested after concrete pours/hand-testing/when APTW is exchanged for AETE.
  • future design of protective covering when performing shim plate removal
  • optionally implement magnetic camera array to check hole alignment by looking directly at the holes

At end of shift, mock up and FE was separated, markings made on floor to specify where FE needs to be to couple.

--------------------------------------------------------------------------------

UPDATE Nov 25, 2024

Replacement nuts arrived (M24x3) for the coupling screws. Tests were completed to try and couple/uncouple the front end to the cart/mock up.

• For taking the FE on/off the cart the cart should be able to rotate with the FE so that we can secure the coupling screws.
• For dropping the FE off from the shield plug, we should make use of the alignment features (cup and cones), once screws are undone and the FE rests on the cones on the cart, it should be secured.
• If markings on floor is made to assist with alignment, we need to do two sets; one for unloaded cart, one for loaded cart, this is because the lift table will tilt differently when there is a load.
• The threads on the coupling screws are fine threaded in the real case, there is a slight concern with cross-threading when turning them onto the nuts remotely (from above).
• Existing camera views sufficient to check for clearance between coupling plates and FE structures.
• To allow the FE to guide freely into the alignment features (cup/cone), it may be a good idea to still use the air skates, but supplement it with structural 'stopping' features to keep it from rolling off the table.

--------------------------------------------------------------------------------

UPDATE Nov 26, 2024

We returned the front-end to the cart to allow the shield-plug mock up to be rotated by the target hall crane (turntable still not functioning as of this date).

During this operation we noticed that the front end did not fully return to the alignment cones on the cart (see images), somehow the contact pad screws made contact first, and so the two-faced alignment cone did not come into contact.

For the real support frame we should use a minimal number of contact points. Also,more clearance at the coupling screws between the cart to the front end should be added.

--------------------------------------------------------------------------------

UPDATE Nov 27, 2024

We rotated the mock-up frame manually to have the HTV side face the hot cell window. During which the o-ring fell and we decided to cut it for convenience, this should be replaced with an equivalent o-ring but made ~1" longer in circumference.

--------------------------------------------------------------------------------

UPDATE Nov 28, 2024

Today we attempted to re-couple the front end to the mock up frame in the orientation where the HTV faces the hot cell window. The misalignment between the FE on the cart to the mock-up frame is worse in this orientation than in the previous (90 CCW facing down). There was approximately a 1" gap difference between the opposite ended screws. Factors contributing to the misalignment include uneven seating of the FE onto the bosch frame and uneven 'brake' engagement on the bosch frame wheels. During the attachment process the the screws had to be tightened very unevenly, with the HTV side being tightened far more than the extraction electrode side.

Additionally, the service tray shifted significantly from handling in the previous days and it was difficult to align the locating pins/cylinders. This further complicated the coupling process, in the future the service tray attachment should be made a separate operation to the process of coupling the  FE to the shield plug.

Under these conditions, during tightening, the inner screw at the HTV-side somehow jammed against the nut and the nut conversely jammed into the bracket. Subsequently, that screw could not be tightened further and required great difficulty to be removed, even after removing the bracket. In the aftermath, the nut bracket became forced apart (see picture) and the threads on the screw deformed beyond use. This is a critical failure mode for this coupling system. Note that the screw was hand started onto the nuts on the brackets prior to fully tightening the screws.

We believe the factors contributing to this failure include:

1. bracket gap being too large and allows the nut to wedge itself during tightening,
2. screw threads not being hardened/of proper grade,
3. tightening the screws too unevenly and sharply (too large turns per-screw when bringing the FE up, 1/2-1 turn) / allowing some screws being slack,
4. high misalignment (pitch and roll) between the FE plate and the mock-up frame,
5. the brackets not being able to accommodate the observed misalignment,
6. hole for screw is ~short and creates possibility for jamming when there is misalignment (pitch and roll),
7. aligning the service tray locating features while aligning the screw holes for the FE coupling was difficult,
8. possibly the extra lead in (chamfer) on the coupling screws is excessive and a non-standard design, which may cause problems starting the nut, likely a standard chamfer on the end of a standard screw would be sufficient for this operation

In the real operation, the long length of the screw will help prevent this failure from happening but some things to keep in mind/improve on would be:

1. bracket re-design to use standard wrench/nut gaps to avoid nut jamming
2. use hardened threads
3. try to see if no-lead in/chamfer/using standard screw profiles is sufficient
4. re-design the coupling system to not require a nut at the bottom and avoid cross-threading/thread jamming in the hot cell (move threads and nuts all above the FE assembly)
5. extra: the screw should not be fine threaded in the real case to avoid cross threading
6. minimize misalignment when trying to couple in the future (rotate turntable to minimum misalignment orientation)
7. tighten the screws more incrementally to have them go together evenly, don't allow screws to be fully slack if possible to prevent jamming
8. fully remove the service tray and attach only after the FE is attached

Of the above recommendations we strongly recommend re-designing the nut bracket - even when coupling was smooth (without misalignment) the nuts made a visible dent onto the bracket at the highest point (see image). A smaller gap (standard wrench gap) would prevent such a mark from forming.

We replaced the deformed screw with a standard (off the shelf) one to keep the FE secure to the mock-up.

We also noted after completing coupling that the extraction electrode, farthest out screw had damaged threads (see image).

It is recommended to perform repeated coupling/decoupling operations in the hot cell after some process/design changes are made/implemented to work out any possible failure modes with this operation.

The four water connections on the front end plate of the APTW that will connect to the HTV were tested for replacement with the manipulators:

• The pin on these connectors were fairly easy to remove and replace with the old pin detent tool.
• The horizontal VCR joint on the DRIVE BEAM CONE (ATA3674) could be undone with the manipulator and standard wrenches, it is advisable to use 'semi-closed' wrenches on the nut to prevent it from dropping when torquing or undoing the joint.
• Of the four water lines, only the top line could be taken out and returned by hand, testing with manipulator still to be done.
  • It would be nice for this top most line to have a clamp or something to keep the VCR nut on the bottom U-bend from falling.
• The second line from the top interferes with the bus bar when trying to be removed by hand.
• The second line from the bottom has a VCR connection obstructed by the same bus bar when trying to remove by hand.
• The bottom line catches on the other lines when trying to remove by hand, the other lines likely need to be removed first to allow this line to be exchanged.
• is the intent for the bus bar need to be removed to exchange these lines?

 Testing will resume in the following week for these water lines.

The four water connections on the front end plate of the APTW that will connect to the HTV were tested for replacement with the manipulators:

• The pin on these connectors were fairly easy to remove and replace with the old pin detent tool.
• The pin detent tool could also be used to manipulate the water lines while protecting the sealing face.
• The horizontal VCR joint on the DRIVE BEAM CONE (ATA3674) could be undone with the manipulator and standard wrenches, it is advisable to use 'semi-closed' wrenches on the nut to prevent it from dropping when torquing or undoing the joint.
• Of the four water lines, only the top line could be taken out and returned by hand, testing with manipulator still to be done.
  • It would be nice for this top most line to have a clamp or something to keep the VCR nut on the bottom U-bend from falling.
• The second line from the top interferes with the bus bar when trying to be removed by hand.
• The second line from the bottom has a VCR connection obstructed by the same bus bar when trying to remove by hand.
• The bottom line catches on the other lines when trying to remove by hand, the other lines likely need to be removed first to allow this line to be exchanged.
• is the intent for the bus bar need to be removed to exchange these lines?
• The VCR nuts on the water lines located by the bottom of the bus bars will require the turntable to be raised most of the way up to access with the manipulators.

 Testing will resume in the following week for these water lines.

November 27, 2024

Testing completed:

• Removal and re-insertion of 2x multi-pin coupling cable for HTV (see pictures, left most and right most, middle had no wire at the time).
• Tested using 'wire' method to pull cable once removed back through the original path.
• Test without rotating table, on cart, some obstruction that does not reflect reality in operation, rotated cart by hand, will require rotation during operation.

Observations/notes:

• Right connector has wires come across and may interfere with the middle connector, will require removal of multiple connectors to exchange one depending on configuration.
• Locating pins on high voltage multi-pin connector needs to be short for voltage bias reasons.
• Right-most black multi-pin cylindrical connector has higher risk of machined block end catching when fishing from the HTV side.

Recommendations:

• May be a good idea to add a holder connector to go into the multi-pins and give the manipulators a better grip for handling. Directly grabbing on the cylinder of the multi-pin connector is ok though.
• Some strain relief at the machined connector blocs (service tray side) will help prevent damage during wire replacement/routing.
• Possibly re-route some of the electrical connectors to the back side of the HTV column for easier access and shorter length.
• Will need chart mapping where the cables go and indexing different connections for future hot cell work (will be updated on SW model).
• Locking pins on multi-pin connectors can be removed and replaced manually with the manipulator.
• Adding a 'slippy' sheath onto the replacement cable for routing and to prevent catching would be a good idea in the future.

 -----------------------------------------------------------------------

Dec 02, 2024

Testing completed:

• Removal and re-insertion of 1x ceramic-ended wires specifically the one obstructed by the gas line on the right side of the HTV connection array as viewed from the hot cell window.
• Removal and re-insertion of main multi-pin connector cable bundle from the HVFT connector array on the service tray.
• Removal and re-insertion of the gas line obstructing the right-side ceramic electrical connectors << very difficult/impossible to do (recommend modifications + tooling).

Observations/notes:

• Electrical wires/connectors generally straightforward to exchange.
• Plastic/ceramic components on connectors are easy to damage during exchange operation.
• Most connectors require the metal/cylindrical bits to be 'grabbed' by the manipulators if no custom tool is used
• Rectangular multi-pin connector bracket if single is difficult to return to slot since not supported on both sides
• Need documentation/reference material to make sure connectors get returned to where they need to be
• Screws on connector are deep into the FE assembly, creates viewing difficulty
• Cameras hard to use for these screws because of beam dump being highly active when FE is in operation
• Ceramic (mass marker) connectors fine to grab on the conductor part
• When trying to re-align the ceramic bodies to line up the screw holes, found that it was really easy to damage/break the ceramics, avoid using hard tooling/manipulators on the ceramic parts
• Plastic components on multi-pin rectangular brackets got damaged after handling with manipulators
• Full sized pin detent tool not compatible with smaller pins, should make smaller sized pin detent tool, smallest clearance found on HVFT side of multi-pin connector bundle
• Routing HVFT side of multi-pin bundle through wires poses risk of damaging exposed pins

Recommendations:

• Should buy longer bits/ends for torque control tool to get better view angles on screws.
• Maybe captive screw for the gas is a good idea to prevent the screw from dropping.
• Torque tool should be set properly (torque and rotation rate) before performing screw exchanges involving the HTV connectors on the front end
• Return of the gas line (on bracket) to its location on the FE is difficult, suggested modifications include:
  • Changing orientation of cutout on bracket to let stainless bent/welded tube to be returned separate from the bracket.
  • Changing screws for the stainless part on the gas line to be standard size (M6) for hot cell exchange operations.
  • Changing the unused screw hole on the FE to be pinned and allow for better alignment of the bracket onto the FE
  • Removing burr on sheet metal part on hose/wire opening at the bottom to prevent the braided hose from catching.
• Should make a rotator tool (3D printed) to help adjust the ceramic end of the mass marker connector and have the screw hole and thread aligned
• Maybe plastic covers for water/gas connectors to prevent scratching of outer surface
• Make smaller pin detent tool or settle for old tool already made
• Possibly design cover to protect exposed pins on multi-pin bundle during replacement

 -----------------------------------------------------------------------

Dec 12, 2024:

Testing completed:

• Tested removal and return of the gas line obstructing some ceramic electrical cables on the right side of the HTV connector array on the front end, now with 6mm pin (McMaster 97493A162) threaded into the previously unused hole to help guide the previously  unused hole to help guide the bracket.

Observations/notes:

• Chad Fisher commented that even without the pin it should be possible to complete the removal and return operation if a 3D printed (soft )tool is made to grab onto the tubes and guide it with the bracket into the alignment hole/slot.
• Old recommendations still stand though + maybe make the pin longer/custom with more lead in.

Recommendations:

• Remove the retaining tab at the bottom to allow the hose to be positioned more freely.
• De-burr the sheet metal part to prevent catching on the braided hose.

After a recent power cycle, the y-axis referencing was lost for the 1000 kg crane. The position readout was also incorrect, somewhere on the order of > 30,000 mm. On 2024-11-29, A. Newsome re-referenced the y-axis. The position readout correctly reset to zero, and both +y and -y motion is functioning correctly, but the y-axis position readout on the HMI constantly displays 0 and does not change. To be investigated.

Update 2024-12-02:

After going online with the PLC, it was determined that the reason for the display of 0 as the position is that the two values used for calibration of the +y and -y limits were actually the same, meaning the scaling factor (the difference between these two values) was 0, which resulted in the displayed value being 0. The root cause of this is that the encoder was not functioning correctly so its value was not changing when the crane moved and it was stuck at one value. Upon investigation of the encoder input card, the red "ERR" light was on. This indicates the encoder signals are not properly reaching the input card. Once this was discovered, it was remembered that this happened in July 2024 as well (no e-log was written). In July, the root cause was identified as being a loose encoder signal wire in a junction box. Junction box CJB1-BC, located on the bridge crane near its disconnects, was opened and investigated. Upon checking each wire, it was determined that the red wire seemed not to be making full contact. The wire was removed and re-inserted, and the "ERR" indicator on the encoder card turned off. The crane's +y and -y limits were re-referenced. The crane is functioning normally after re-referencing. (Note: if something like this happens again, during the re-referencing process, the displayed value on the HMI will be incorrect.. this is because the PLC's scaling factor is not fully adjusted until both +y and -y limits are reached. The actual encoder measurement taken at those limits is used for the scaling factor. This is not an ideal way to program the system, but this is how it works with all ARIEL hot cell subsystems. So incorrectly displayed values can be ignored, in general, until full referencing is completed).