Bharathwaj was born in Tirunelveli in a Tamil Brahmin family and had his schooling and college education in Delhi. His father was a government official. Bharathwaj qualified as a Chartered Accountant before entering the domain of music. He studied Hindustani and Western music at Delhi.