Whitfield was born in Lindenhurst, New York. He is probably better known for his recordings as bandleader for both the Verve and Warner Bros. Records record labels. He has worked with Jack McDuff, Jimmy Smith, Courtney Pine and Nicholas Payton, Chris Botti, among others.