Some say they don’t matter or matter as much. I find they really do and are in fact in the signal path. If one doubts that, then remove the parallel cap and listen 🤓. Yes, you can save money here and not get the very best. If it’s an electrolytic, then replace as it may have dried out over time.
Don’t forget resistors. Some nice $5-$7 Mills MRAs will be a very nice sonic improvement for relatively little money.