Arlie was born in Jack's Branch, Texas and graduated from Nederland High School, where "Pee Wee" Duff (as he was known then) was an All-State basketball player his senior year. Later, he served his country in the US Navy for three years during World War II. After his discharge, He continued his education and earned a Bachelor of Science degree as well as a Master of Arts in Education degree from Stephen F. Austin State College in Nacogdoches , TX. While attending college, he continued his basketball prowess, being named to the All-Conference team while being captain of the varsity team. 　　Arlie had written a number of songs - novelties, ballads and religious numbers - but never took any of them seriously until he met Gordon Baxter, a Port Arthur, Texas, disc jockey. Mr. Baxter, who had worked with Arlie on college shows, encouraged Arlie to keep on singing. 　　Arlie took his friend's advice. He did some singing with Blackie Crawford and his "Western Cherokees," and soon became a regular member. 　　He was teaching school and coaching until he wrote the country classic, "Y'all come" (originally, it was titled "You All Come"). 　　In the mid-1950s, Arlie Duff was making a name for himself in the south, in states like Texas, Louisiana and Mississippi. He was said to have a big smile and a voice to match. They wrote that every time he stepped on stage, audiences would commence to clapping their hands and stomping their feet and start shouting "Y'all Come" at the top of their lungs, singing along to his signature song, "Y'all Come".