Fault 16710 was initially assigned to Remote Handling: IBOP0206 giving false positive - Al-ALCW water pressure shows "off" when it isn't; The safety system is reporting that Al-ALCW water pressure is "off" (page SVG) when the system is still on and at normal operating pressure.

2024-04-10: initial inspection by A. Newsome yielded the following (email from A. Newsome to K. Genge):

1. First, on an unrelated note, there's a thermometer mounted to the Al-ALCW pipe which is loose and rattling due to vibration of the pipe. There's a little bit of water leak in this area. I don't want to mess around with it but I suggest someone tighten it soon! 
2. I looked around for sensors on the Al-ALCW pipe and I think I found the water pressure sensor which is giving the faulty reading. I have three suggestions for what to look into, in order of importance:

1. The cable for this sensor has a portion of it which is electrical-taped together. I didn't mess with it, but I suspect underneath the electrical tape it could just be disconnected. This would be a super quick check and quick fix. Suggest connectorizing it in the future with a simple Molex connector or similar - let me know if you want us to do that. 
2. The pressure transmitter itself could have failed or could have some sort of internal issue. Suggest disassembly to inspect. First, water will need to be turned off and the isolation valve turned off. If no spare readily available, suggest swapping with another transmitter of the same model to see if that is in fact the issue before ordering one (I think there's one nearby for the Meson Hall water system, beside the electrical panels). 
3. Somewhere along the line, there could be a cable degradation issue, or the cable could be disconnected/pinched/cut. Suggest looking into this last as it is the most tedious and also least likely.
   

2024-07-16: J. Ableseth confirmed the pressure transmitter (3400T Series) appears to be in working condition.

2024-07-24: A. Newsome and J. Zhang investigated the elevating system control panel located in B3 level. The following are findings (email from A. Newsome to K. Genge):

1. Our elevating system panel accepts an overall interlock summary signal from an unknown external source (probably a safety panel located elsewhere). There's no manipulation of the signal at all - it just enables/disables the system from running. 
2. The indicator lights on top of the elevating system panel do not have any electronics nearby - the light wiring comes from an external source via multiconductor cable. They are just indicators and are not connected to any electronics inside our panel at all. In fact this isn't even in our drawing package. 
3. We traced the light signal multiconductor cable out to the tunnel on B3 level - the cable runs along the middle cable tray. Did not follow all the way, but we assume it comes from the safety panel in B2 that Kathleen pointed out. In this panel, there's an exact duplicate of the indicator light display! This one, too, showed the "CYC H2O OFF" light as being on (false logic since the pump is active). It appears that the wiring for these lights is connected to a bank of relays right beside it. My suspicion is that one of these relays has failed, which then causes both of the indicator lights to be stuck in the ON position (this is the "safe" position). Given that there's also a similar cyropanel-related faulty signal, this makes even more sense - the relays are probably very old and/or there was some external issue that could have caused both to fail. Seems more likely than two totally unrelated sensors failing at the same time, that just happen to be routed through the same panel and relay bank. 

• Kevin Ardron investigate the relays in that panel... if it is not obvious the relay has failed, easy thing to do is just swap it with an adjacent one that is known to work and see what happens.
• Probably a good idea to just replace all of them if they are all the same age, because we'll likely see others fail. I think it is a relatively inexpensive and straightforward thing to do that could save some headache and beam trips in the future. 
• If the relay appears to be fine, or if the relays turn out to be totally unrelated to the actaul signal itself, continue tracing the signal back to its ultimate source. This panel on the B2 level is most likely where we'll find the issue.
  
  

[Update] 2024-07-26: Email from K. Genge:

An update from Safety System’s findings re: elevating system interlocks -

1. Very difficult to test the relays given the design/location of them and the cables connecting to them.
2. Kevin A. managed to trace the cryopanel elevating system related fault (#17020) over to the vacuum racks on SAB2 where he coincidently ran into Dimo, Vacuum Group Leader. Turns out that the sensor that gives this signal is connected to old cyclotron cryogenics/vacuum equipment that is no longer in use (and therefore providing the elevating system interlock system with the right info!). During the shutdown, Dimo and his team will move this sensor to the correct location so that it’s providing the correct info. That fault has been redirected.
3. The water ok signal goes to a “water system box”. We don’t know where this box is, but Kevin is willing to provide additional cable info to Joe. I recommend that the next step is for Joe and Kevin Ardron to connect and figure out where this cable goes.