I am playing a sound file in reverse sometimes in a fast rhythm and I am getting a lot of clicks and pops.

My attempt to eliminate the clicks and pops is not so great.
I have a screen shot so you can see what I am doing.
When I bang the button an audio file is played for 2 seconds. If I press the button before the end of the 2 seconds I get a pop because the audio that was playing is cut off and the audio file playback jumps to another location and starts over.

If you see in the red box on my screen shot, I am trying to use line~ to have the volume go to 0 and ramp back up to 1, but it degrades the sound quality at the beginning of the audio file playback. Also, I need to ramp down the volume to 0 first and then ramp the volume back up, and that is what I am missing in my version.

Can anyone please suggest a way to create a silent volume fade at the beginning of when the audio file is played? And it should account for the line~ being interrupted and the file being played again. Let me know if anyone has any suggestions. Thank You.

Here's another strategy: make 2 voices that accept play/stop commands and then toggle between them, e.g.
This sends the stop command to one voice and the play command to the other, so that the voices effectively crossfade. The voices should fade up on start and fade out on stop, and if a stopped voice receives a stop command, it should keep quiet. This scheme will still pop if you bang twice within the crossfade period, but you could prevent that using a lock-out timer.

Thanks for the suggestions. The 20 ms ramp down then ramp up works really well. It's completely silent. Thank You.
I am adding a screenshot as well.