Ballew's first brush with children's music came in 2002, when he recorded and donated an album of traditional children's songs to the nonprofit Program for Early Parent Support titled "PEPS Sing A Long!" Although that was a positive experience for him, he did not consider making music for families until he met his wife, collage artist Kate Endle. Her art inspired Ballew to consider making music that "sounded like her art looked" as he has said. Ballew began writing original songs and digging up nursery rhymes and folk songs in the public domain to interpret and make his own. The first album "HERE I AM!" was recorded during the summer of 2008 and released in February 2009. Ballew has made two albums of Beatles covers as Caspar Babypants. "BABY BEATLES!" came out in September 2013 and "BEATLES BABY! came out in September 2015.
Caspar Babypants is a true do it yourself (DIY) venture with Ballew running the Aurora Elephant Music record label, booking shows, running the studio, and producing, recording and mastering the albums himself. Distribution for the albums is handled by Burnside Distribution in Portland Oregon.