There's even more to "Modern Vampires of the City". Nearly every song has a religious/biblical theme. The narrative makes the most sense if you see it as two sides of an LP: songs 1-6 and songs 7-12. References:
God and Man on 'Modern Vampires of the City' | PopMatters;
A Glossary for the New Vampire Weekend Album -- Vulture;
Elie Lichtschein: God, Death and Modern Vampires;
New Vampire Weekend Album Is a Guide for the Perplexed – Tablet Magazine (good article!) And I also often search songmeanings.com, some commentaries sometimes have sharp ideas there, especially on these songs.
I also like "Far" by Regina Spektor. "Laughing With" is a masterpiece. Hint to the last line of the song. It's about, when someone's joking and lying "no, I was not laughing at you, I was joking *with* you." Also the album is very religious. And the song's title does the same as "Ya Hey" by VW does. Not writing "G-d". Lyrics video (English and Spanish) [video=youtube;FRUQh_7NPBE]http://www.youtube.com/watch?v=FRUQh_7NPBE[/video]
And of course "Seven Swans" by Sufjan Stevens, and also "Illinois(e)" has quite a lot biblical references, end times ("Sears Tower") etc. Sadly his latest album "Age of Adz", themes, symbolism, etc. sounds weird and like he had suffered a lot. It's not a bad idea to pray for him.
And also mentioned previously here: "Welcome to the Welcome Wagon" by The Welcome Wagon. It is really great. And the singer is or used to be Sufjan Stevens pastor. The also have a newer album: "Precious Remedies Against Satan's Devices".
PS: As always be a bit careful with any music. I also have my (huge) problems with most CCM. (Because some fellow Christians I know tend to turn off their discernment/judgement when it comes to CCM, where CCM=generally good. Careful now! It's certainly not, I even think it is easier to get corrupted because listeners are not *that* careful as with "wordly" music. Just my opinion. But with the albums mentioned above I feel there's not much wrong with them.
PPS: Sorry for my English. ;-)