McFerrin was the first black male soloist at the Metropolitan Opera.

He graduated from Chicago Musical College in 1946. In 1949, he appeared in William Grant Still's "Troubled Island" at New York City Opera and as Amonasro in "Aida" with the National Negro Opera Company. He joined the New England Opera Company in 1950.

In 1953, McFerrin became the first black male to join the Metropolitan Opera. In 1955, he made his solo debut as Amonasro, three weeks after contralto Marian Anderson became the first black to sing a principal role at the Met. Other roles at the Met were Valentin in Gounod's "Faust" and Rigoletto.

McFerrin also sang the role of Porgy (played onscreen by Sidney Poitier) in the soundtrack of the 1959 film of Gershwin's "Porgy and Bess".

He toured internationally as a recitalist and was also active as a teacher.

He is the father of singers Bobby McFerrin and Brenda McFerrin.