When you open this door, what will happen is that every improvement you make will involve moving further away from Silver with a Judges splash and into Judges with a bit of Silver support. That's just the way of it. If you want the best deck possible, that's one thing, but if you just want a Silver deck with a bit of Gold, decide where you want to draw the line of sacrificing power for theme.