The resistor/varistor combinations across the target + / -, tube + / - and target- / tube + have been remade and moved to the back of the power supplies to limit the corona discharges at higher voltages. Pictures attached.

I have removed the resistor/varistor combinations that go between the poles of the target and tube heaters, and between those two supplies. I tested all the components to make sure they were still working after the sparks - for the record the varistors clamp at 23V, not 33V as implied by the schematic.

Tuesday, March 06, 2018, 10:48  BIAS/EE/EZL = 59.5/-1000/29.5  There was some kind of spark, the current on the bias supply went up to 400uA ( normally at 40 +/- 5 ) and the vacuum jumped a bit ( but still in the 10e-7 range ) but I didn't hear anything. It took out TP6 again. See first attachment.

Tuesday, March 06, 2018, 10:54  BIAS/EE/EZL = 60/-1/30

...

Problems

...

Tuesday, March 06, 2018, 12:00 BIAS/EE/EZL = 60/-1.5/29

Tuesday, March 06, 2018, 12:37 BIAS/EE/EZL = 62/-1.5/30

Tuesday, March 06, 2018, 14:11 BIAS/EE/EZL = 64/-1.5/31 No sparks but occasional ticking sounds from either the EZL or behind where the EE is... see second screenshot

Tuesday, March 06, 2018, 14:40 BIAS/EE/EZL = 65/-1.5/33

Test stand has been sitting at 65kV for about an hour now. Some small increases in bias power supply current but nothing significant (40uA). Some small sparks on the way to this voltage, and I ramped up very slowly. The corona discharges seen before seem to be related to the resistor/varistor combos since there are none now that I have removed them. Will redesign and reinstall.

Turning up bias, no corona discharge at 60kV but a spark at 61.5kV bias, 31kV EZL, -800V EE

Thursday, March 01, 2018, 10:26: BIAS / EZL / EE @ 65 / 32.5 / 3.2 kV

Thursday, March 01, 2018, 10:32: Spark* Knocked out turbo pump TMS : TP6 (Restarted) Communications restarted. RPM0A restarted.

Thursday, March 01, 2018, 10:44: BIAS / EZL / EE @ 61 / 30.5 / 3.1 kV

New parts installed. Corona Shield, brackets, and board/spark gap orientation.

Wednesday, February 28, 2018, 11:48: Power on. Ready to test

Wednesday, February 28, 2018, 14:00: BIAS / EZL / EE @ 30 / 13 / 1.5 kV

Wednesday, February 28, 2018, 14:06: BIAS / EZL / EE @ 40 / 17 / 2.0 kV

Wednesday, February 28, 2018, 14:11: BIAS / EZL / EE @ 55 / 24 / 2.8 kV

Wednesday, February 28, 2018, 14:16: BIAS / EZL / EE @ 60 / 28 / 3.1 kV

Wednesday, February 28, 2018, 14:18: BIAS / EZL / EE @ 62 / 30 / 3.2 kV

Wednesday, February 28, 2018, 14:21: BIAS / EZL / EE @ 63 / 31 / 3.2 kV

Wednesday, February 28, 2018, 14:26: BIAS / EZL / EE @ 65 / 32.5 / 3.2 kV

Wednesday, February 28, 2018, 14:32: BIAS / EZL / EE @ 66 / 33 / 3.3 kV

Wednesday, February 28, 2018, 14:35: BIAS / EZL / EE @ 66.5 / 33.5 / 3.3 kV ***2 sparks***

Wednesday, February 28, 2018, 14:37: BIAS / EZL / EE @ 66 / 33 / 3.3 kV

Wednesday, February 28, 2018, 14:41: BIAS / EZL / EE @ 66.5 / 33 / 3.3 kV

Wednesday, February 28, 2018, 14:44: BIAS / EZL / EE @ 67 / 33 / 3.3 kV

Wednesday, February 28, 2018, 14:47: BIAS / EZL / EE @ 68 / 33 / 3.3 kV

Wednesday, February 28, 2018, 14:49: BIAS / EZL / EE @ 68.75 / 33 / 3.3 kV ***Spark***

Wednesday, February 28, 2018, 14:51: BIAS / EZL / EE @ 68 / 33 / 3.3 kV

Wednesday, February 28, 2018, 14:57: *** 2 sparks ***

The BIAS was pushed to 69 kV however the resulting sparks shut down the communications with the test stand computer.

RPM0B was put into a continuous running cycle and had to be shut off manually.

The voltage was brought back down remotely via a separate computer. Turbo pump TMS : TP2 was also restarted.

1. Al corona shield installed over end of the HV duct to suppress discharges from the sharp edge of the duct.

2. Some moving and shortening of cables to keep them from running close to different voltages.

3. Changed the angle bracket on the 3M bias-EE resistor chain to a plate, same position.

4. Moved the 164K EE resistor chain to sit flat against feedthrough K.

5. Moved the bias-EE spark gap to sit flat against the back of feedthrough K, required tapping a hole in the back of the copper clamp.

6. Cap and top of rack vacuumed.

7. Piece of shielding removed from top of HV rack

Friday, February 23, 2018, 08:50

Friday, February 23, 2018, 08:53: BIAS / EZL / EE @ 62.5 / 29 / -1 kV

Friday, February 23, 2018, 08:56: Spark* Turbo pump TMS:TP6 restarted,

Friday, February 23, 2018, 09:13: Bias sitting at 61kV for about 15mins now. Still corona discharges from the area of the EE, but the area of the duct seems fine.

Tuesday, February 20, 2018, 09:01: Sparks at 62.5kV after a couple minutes. Sounds like they were in the EE spark gap but don't appear on the EE read current. Ozone smell around 61kV, so there are still some discharges.

Turned back up to 62.5kV but no sparks. Put it up to 63.5kV and there was a spark, but not in the EE spark gap as expected. Took down TP1B but everything is back up and seems fine.

The test stand holds up to 63kV, however at voltages over 54kV there are small discharges, rising to a continuous level around 60kV. The best guess right now is that these are coronal discharges coming from the end of the HV duct to the faraday cage. The only way to fix this would be to round out the edges of the duct, or to move the duct farther away. Since I have heard small discharges in other places, we may need to make a variety of modifications. Things that have had no effect:

1. Changing the EZL/EE voltages - break down is happening only between HV bias and ground

2. Cleaning the faraday cage

3. Locating sparks with a thermal camera

4. Conditioning - break down always happens at the same point

Found TMSTP6 off, restarted it, seems fine now (drawing 0.8A)

I vacuumed inside the HV cage, though it has many small areas that are difficult to access so I am not sure how great a job I did.

Turned the bias up and again at 55kV I hear small sparks near the end of the HV duct that brings the cables from the rack. Cannot see anything. If it is really sparking where it sounds like sparking, it must be from the edge of the duct to the faraday cage.

Changing the EZL voltage and the EE voltage has no effect on where it starts sparking.

Sparks at 62kV on the bias.

Turned it down, turned it back up and got a spark at 60kV.

Now up to 63kV, no sparks so far (5 mins). Left EE @ -3100V and EZL @ 28.5kV

There is the sound of a low level continuous discharge, like HV power lines, and a very strong ozone smell coming from the HV duct that sticks into the cage and carries the cables from the HV rack. Also seems to be present near the EE insulating standoff. Can't see anything though. Maybe just moisture in the air? Starts at 55kV on the bias, does not change with EE voltage.

Turned EZL up to 29kV, bias stable at 63kV for 11mins.

Sparks at 63.6kV in the EE spark gap, EE @ -3.1kV.

Ramped up to 60kV with the new power supply, same as what we did last time with the standard test stand bias supply (see entry #627 ). Much more instability on the bias current readout (see attached screen shot), develops around 54kV. As well, the old supply read out 37uA at 60kV while the new supply reads out ~85uA. This could just be an EPICS read back issue though.

Friday, February 09, 2018, 08:25    Disconnected the AC power chain from the old bias supply but now cannot turn on the new bias supply in EPICS because the "TSGBIASSAFETY ok" interlock is tripped. No idea what this means - maybe it checks for AC power?

Friday, February 09, 2018, 08:48    Reconnected power to old bias supply, does not fix problem. Talked to Mike, he thinks it is PLC related, so will call Gelo later.

Friday, February 09, 2018, 11:38 TSGBIASSAFETY ok interlock problem seems to have solved itself, it now appears to be working fine. Will turn off power for now and continue tests on Tuesday. (note: turns out Mike told Dave about the problem and he solved it. No one knows what this interlock is for, but it used to be reset using the Global Reset button and now the RST button for the power supply should also reset it.)

Thursday, February 08, 2018, 16:54

Testing the HV bias I found that the einzel lens was behaving strangely. When I tried to put it higher than 1kV, the current would start spiking from 12uA to > 100uA. The voltage would jump around quite a bit as well (+/- 100V). Everything seems the way it was before, except the EZL power supply is still connected in parallel with the old bias power supply, which is no longer powered. Maybe one of the transorbs connecting line and neutral on the bias side is fried? I will unhook the connection to the old PSU and try again.

The 75kV power supply is now in EPICS under the usual TSG:BIAS controls. The upper limit has been set to 70kV to protect the transformer.

Wednesday, February 07, 2018, 08:40: A 75 kV Glassman power supply was installed in the rack for use in further HV testing.

-The 75kV power supply is linked into the keyed interlock system. The key & switch labelled BIAS/EZL will unlock it.

-The PS is currently not connected to the epics controls and can only be adjusted manually.

-The old Glassman supply is disconnected and removed from the cage.

Monday, February 05, 2018, 09:10: the epics program was in 'White-out'. Turbo pumps tripped.

Unplug, re-plug PLC.

Monday, February 05, 2018, 09:16: Restart Turbo pumps on chamber & beamline.

Monday, February 05, 2018, 09:21: Ion gauges on.

Tuesday, February 06, 2018, 09:00: TSG:CB1 noted to be red. Attempts to restart/reconfigure failed. Alive displays red MAJOR. Fault submitted.

Wednesday, January 31, 2018, 12:53: Power/sources on.

Wednesday, January 31, 2018, 12:58: BIAS / EZL / EE @ 40 / 17 / 2

Wednesday, January 31, 2018, 13:02: BIAS / EZL / EE @ 40 / 17 / 2

Wednesday, January 31, 2018, 13:05: BIAS / EZL / EE @ 50 / 22 / 2.5

Wednesday, January 31, 2018, 13:08: BIAS / EZL / EE @ 55 / 24 / 2.8

Wednesday, January 31, 2018, 13:10: BIAS / EZL / EE @ 57.5 / 27 / 3.0

Wednesday, January 31, 2018, 13:14: BIAS / EZL / EE @ 60 / 28 / 3.1

Wednesday, January 31, 2018, 13:34: No Sparks.

Wednesday, January 31, 2018, 14:14: No sparks after one hour.

Wednesday, January 31, 2018, 14:44: Spark free at 1-1/2 hours.

Wednesday, January 31, 2018, 14:45: Bringing down voltage.

Wednesday, January 31, 2018, 14:56: BIAS / EZL / EE @ 0

Wednesday, January 31, 2018, 14:57: Sources off.

Wednesday, January 31, 2018, 09:50: A wire (B - F) was too close (Almost touching) to the EZL and had visible sparks during HV tests 1 & 2. The wire was adjusted to sit higher. and away from the EZL

Tuesday, January 30, 2018, 06:50: BIAS / EZL / EE @ 30 / 13 / 1.5

Tuesday, January 30, 2018, 06:52: Auto ramping TGHT / TBHT to 580 / 200 A @ 2A per min.

Tuesday, January 30, 2018, 06:58: Optics on / set

Tuesday, January 30, 2018, 06:59: IV4 opened.

RGA switched completely off and unplugged.

Tuesday, January 30, 2018, 13:15: BIAS / EZL / EE @ 40 / 17 / 2

Tuesday, January 30, 2018, 13:20: BIAS / EZL / EE @ 50 / 21.8 / 2.5

Tuesday, January 30, 2018, 13:50: Half hour wait. Ok. No sparks.

Tuesday, January 30, 2018, 13:55: BIAS / EZL / EE @ 55 / 24 / 2.8

15 minute wait. No sparks.

Tuesday, January 30, 2018, 14:10: BIAS / EZL / EE @ 57.5 / 27 / 3.1

Tuesday, January 30, 2018, 14:23: BIAS / EZL / EE @ 60 / 28 / 3.1

Tuesday, January 30, 2018, 14:35: No sparks.

Tuesday, January 30, 2018, 15:05: BIAS / EZL / EE @ 0

Tuesday, January 30, 2018, 15:06: Auto-cooling started.

Wednesday, January 31, 2018, 06:59: Power/sources off.