2004年，Marilyn Manson推出创团以来首张精选大碟《Lest We Forget - The Best Of》，网罗乐团地动天惊的摇滚劲歌，包括：分别翻玩80年代英伦电子摇滚代表队伍Eurythmic、Soft Cell乐团的代表作Sweet Dreams （Are Made Of This）、Tainted Love（搞笑片《非常男女》插曲），还有先后获选为电影《骇客任务》、《骇客任务：重装上阵》插曲的Rock Is Dead、This Is The New Shit,以及The Beautiful People 等爆猛大作，精选大碟同时收录全新挑战德国新浪潮电子摇滚劲旅Depeche Mode 1989年英国金榜TOP13招牌作Personal Jesus. 　　Lest We Forget: The Best Of is the first greatest hits album by Marilyn Manson. A new song was recorded to promote the album, a cover of Depeche Mode's 《Personal Jesus》. The album was released at the end of September 2004. 　　The inside booklet contains previous photo-shoots and several new pictures to hint at Manson's next era and musical/lyric direction. The album cover itself was taken from one of Marilyn Manson's watercolors, titled 《Experience is The Mistress of Fools》. The deluxe edition （now out of print） includes a DVD containing most of the band's music videos, excluding 《（s）AINT》 （although the Region 2 edition sold in the UK features this video, uncut, and the Japanese edition features a slightly edited version）， 《Tainted Love》, and 《Astonishing Panorama of the Endtimes》. The album was certified Gold in USA and was supported with the band's Against All Gods Tour. 　　Manson has been quoted as having called Lest We Forget the band's 《farewell album》 because the band will become a solo career for him; however Manson has since made three additional studio albums, Eat Me, Drink Me （2007）， The High End of Low （2009） and Born Villain （2012）。 These last three albums are not recorded as a band as the first five records, even though Manson kept members from Marilyn Manson band, to perform live and also write songs. 　　In the case of 《Eat Me, Drink Me》; Manson collaborated with Tim Skold, the two of them recorded the whole album, Manson part ways with original member Madonna Wayne Gacy, leaving the keyboards position the only instrument not replaced by any other musician. 　　For 《The High End Of Low》; Manson part ways with Tim Skold and rejoined with Twiggy Ramirez and invited Chris Vrenna to perform keys and drums on the album, reminding Ginger Fish as a live member. 　　The last album 《Born Villain》; previous the recording sessions Ginger Fish announced his departured leaving the drums duty to Jason Sutter who didn't performed for the album, and inviting a new member Fred Sablan on bass who performed on the album with Twiggy and Chris Vrenna. Vrenna is just a session member for the last two Manson's albums.