Schaffer was a three-sport standout during one of the golden ages of Hillsdale College athletics, playing football, basketball and baseball from 1957-61. During his time with the Dales, Schaffer was the basketball team's starting point guard for four years and was the MVP and team captain of the 1960-61 squad. He was a starting defensive back in football and led the undefeated 1958 Hillsdale team in interceptions. In baseball, Schaffer was an All-MIAA selection following the 1960 season. After his prolific athletic career at Hillsdale, Schaffer went on to an outstanding career coaching high school basketball, spending most of his time at Three Oaks River Valley. He won 473 games as a prep basketball coach and led Three Oaks to the 1979 Class C state championship. His teams in 1981 and 1997 were state runner-ups and he was named the state of Michigan's Coach of the Year in Class C twice. Schaffer is also a member of the MIchigan High Schoool Coaches Association Hall of Fame and the Basketball Coaches of Michigan Hall of Fame.