Toby Chandler was born in Groesbeck, Texas and worked on Texas oilfields as a teenager. Chandler was an expert marksman at Texas A&M and later served in U.S. Army Intelligence Corps. Chandler was commissioned by the Los Angeles field office of U.S. Secret Service in 1959 and transferred to Washington field office in January 1961. Special Agent Chandler worked the Inauguration and joined President Kennedy's Detail in March of 1961.
On November 22, 1963, SA Toby Chandler was giving the commencement address at the Secret Service School — he had just finished training with a Special Forces/Secret Service task force. That afternoon, SA Chandler answered phones at the White House and handled security for the Speaker of the House, John McCormick.
In 1980, Toby Chandler retired from the Secret Service as Assistant Special Agent in Charge, Houston, Texas.