The band fulfilled their contractual obligations with Vagrant with the 2004 release of Ups and Downs: Early Recordings and B-Sides, which was a collection of b-sides and also included the I'm Sorry I'm Leaving EP. It also featured a song from the band's early days under the name Sefler. The album was dedicated to former bassist Sean McGrath, who died in 2004 at age 28 after a two year battle with intestinal cancer. McGrath recorded with the band on Can't Slow Down and left during the writing of Through Being Cool. The band was relatively inactive in 2004, during which time they set up their own studio, the Electric Ladybug.