Workman was a member of jazz groups led by Gigi Gryce, Roy Haynes, Wayne Shorter and Red Garland. In 1961, Workman joined the John Coltrane Quartet, replacing Steve Davis. He was present for the saxophonist's Live at the Village Vanguard sessions, and also recorded with a second bassist (Art Davis) on the 1961 album, Olé Coltrane. After a European tour, Workman left Coltrane's group at the end of the year. Workman also played with James Moody, Art Blakey's Jazz Messengers, Yusef Lateef, Pharoah Sanders, Herbie Mann and Thelonious Monk. He has recorded with Archie Shepp, Lee Morgan and David Murray. Workman, with pianist Tommy Flanagan and drummer Joe Chambers, formed The Super Jazz Trio in 1978.