It seemed like it was frozen. I has testing using $d016,x not noticing I was using x in the loop as well, so everything from d016+ got set to $c0.

But in the debugger, none of the code in the irq was running. Only the jmp outside the irq.