Scott was born in 1919 to Nettie and Floyd Griswold and raised in Canton, PA where he lettered in both basketball as a guard and football at the position of end.
A lean-built Scott was once asked how he was able to score so many touchdowns, he replied with a smile, "I had to run like lightning to keep from getting “killed” by those big guys on the other side!”