The Pittsburgh & Castle Shannon RR was the first common carrier narrow gauge in U S, forty inch gauge, common carrier status from 1871, ran till 1912, row survives as a light rail line in Pittsburgh. The line existed before the 1870's as the Baily coal rr, no steam untill 1871, from Dawson & Bailey National Works in Connellsville. Pittsburgh had steam powered narrow gauge industrial lines back to civil war days. Pretty sure Hilton recognised the P&CS as the first.
"Urban lore" before the streetcar line was rebuilt to light rail standards was that the P&CS rail was kept and used as a guard rail by Pgh Railways for the broad gauge streetcar line. With the tracks being rebuilt its doubtful any original P&CS rail still exists. If you would have asked 25 or so years ago, there probably would have been some on the row. So as far as rail itself, your sample will be hard to beat, although I have a sample of pear shaped british rail used on the Manns Creek in West Virginia, thats pretty old, but no confirming date.
brian b