Born and raised in Detroit, Michigan as James Moss, the son of Gospel star Bill Moss, Sr., James spent much of his childhood on tours with his father's popular group, Bill Moss and the Celestials, and his cousin's group The Clark Sisters. As an early teen, Moss was teamed with his brother Bill Jr. in the singing duo The Moss Brothers. They toured on weekends around the midwest and recorded two major label albums during their seven years together.