The northern part of the Gorge roadbed is privately owned. As someone else said, they are used to fans asking for permission to hike in, and are pretty accomodating when the kids aren't around.
The southern part is partly a county road, partly an overgrown path. The two portions are separated by the "double bridge tunnel."
JAC