Turns out the power supply that came with my Commodore Plus/4 is junk. I’m very lucky it didn’t damage the computer during the time I had it plugged in. It’s now been replaced with an adapter to make the plus/4 work with my modern C64 power supply