While geography has something to do with it, I'm sure, Phillips is by no means in the middle of nowhere. They are on the way to the year-round playground of Rangeley Lakes area, so plenty of people drive by the town on their way north. Nevertheless, it is quite a haul from out of state.
I've heard that the SR&RL group used to have 1000 members (like the WW&F) many years ago when they were growing, building track and the like. They were stopped when they tried to cross the little street by their depot, the landowner on the other side refused them passage. If they had been able to get through, they had access to several miles of ROW. Now they have around 200 members. They could really use people's support.