I see. High speed rate updating GUIs are a bottleneck in Vanilla's performance, but I doubt that GOPs are.
I tried with 476 of those abstractions, and everything runs smoothly.
This is my [pd color]:
The color fade might not look satisfying yet, but [pipe 0], or maybe try [pipe 5] - detatches it from the deterministic chain, it's urge of updating the colour before sth else gets computed down the chain.
As you are using ints exclusively, put the [int] on top, right after the pipe. Also maybe put a [change] right after the [int]. This way there are less frequent updates and less computations.
I really believe that the expensive part of your patch is sth else,
but ultimately you could also try to use [speedlim] (there are several: iem_vanilla, cyclone, maxlib) to further limit the rate (color only, not actual volume changes).