1835, The Military and Naval Magazine of the United States First came the drum-major, that important and most peacockly personage, regulating the direction and progress of the band by the graceful flourish of the gold-headed "baton."
Source: wiktionary