I have not been to Silverton since right after the mine closed, so I don't know how things are now, but having gone, and stayed in town at the Imperial several times between 1966 and 1992, I have to say that I really enjoyed the town after the trains left. You had all of the time in the world to stroll about town, see what you wanted to see, shop where you wanted to shop and eat where ever you chose. I know that it was not really good for business, but you also got in lots of interesting conversations with the business owners and the people who lived in town.
Of course, I can say the same thing about Telluride between 1966 and 1976 as well.
I hope that this works out and lots of other folks get the chance to experience Silverton in the evenings and the early mornings, without the train crowd.