Part 1: albums
Rabbit Fur Coat
1. Run Devil Run
2. The Big Guns
3. Rise Up With Fists!!
4. Happy
5. The Charging Sky
6. Melt Your Heart
7. You Are What You Love
8. Rabbit Fur Coat
9. Handle With Care
10. Born Secular
11. It Wasn't Me
12. Happy (Reprise)

Acid Tongue
1. Black Sand
2. Pretty Bird
3. The Next Messiah
4. Bad Man's World
5. Acid Tongue
6. See Fernando
7. Godspeed
8. Carpetbaggers
9. Trying My Best To Love You
10. Jack Killed Mom
11. Sing A Song For Them

I'm Having Fun Now
1. Scissor Runner
2. My Pet Snake
3. Switchblade
4. Big Wave
5. While Men Are Dreaming
6. Animal
7. Just Like Zeus
8. New Yorker Cartoon
9. Straight Edge Of The Blade
10. Slavedriver
11. Committed

Part 2: non-album songs

Can't Outrun 'Em - New song played live by Jenny & Johnny in 2010.
Cold Jordan - Cover song played on the Spring 2006 tour as the set-closing song. Also know as simply "Jordan", or with the difference split as "(Cold) Jordan", it's a traditional gospel song that Emmylou Harris and the Grateful Dead used to play. On it, Johnathan Rice handled most of the vocals, with Jenny harmonizing.
Dorothy's Song - Apparently an unreleased original song that was at one point in the running to be on Rabbit Fur Coat, but didn't make the cut. Jenny has performed it live at least once (8/23/04).
Fireplace - b-side of You Are What You Love single. Not played live.
The Highs and Lows of Being Number One - bonus track on the Japanese CD version of Acid Tongue.
Little Boxes - Cover by Jenny and Johnathan Rice of the theme song to the TV show "Weeds", used on the show on October 23, 2006.
Love Hurts - Jenny and Johnathan covered this song at her 2008 shows. It was written by Boudleaux Bryant, first recorded by The Everly Brothers in 1960, and later done by such artists as Roy Orbison, Nazareth, and Cher.
Met Him on a Sunday - Song by 50s girl group The Shirelles, later covered by Laura Nyro in the 70s. This later version is the one Jenny fell in love with when she was young. Sung at most of Jenny's '06 shows.
One of the Guys - New song played live by Jenny & Johnny in 2010.
Paradise - b-side of Rise Up With Fists single. Played live on Jenny's Spring 2006 tour.
Pelican Bay - bonus track with the iTunes and Japanese CD versions of Acid Tongue.
Under the Blacklight - Played by Jenny live once late on the Rabbit Fur Coat tour (12/08/06 Portland, OR), later to be recorded by Rilo Kiley and become the title track for their 4th album.
Untitled - An unreleased song played at most JL+WT shows in Spring 2006. Sometimes known as "(There Will Be) No Leaving Tonight" or something like that, though it's not known to have an official name.

Part 3: other songs Jenny sings on

Big Picture - Bright Eyes song with Jenny and Blake talking at the beginning
Be Still My Heart - The Postal Service song with Jenny on backing vocals
Behind the Frontlines - Johnathan Rice song with Jenny on backing vocals
Big Boat - M Ward song with Jenny on backing vocals
Bloody Murderer - Cursive song with Jenny on backing vocals
Brand New Colony - The Postal Service song with Jenny on backing vocals
Catch My Disease - Ben Lee song with Jenny on backing vocals
Clark Gable - The Postal Service song with Jenny on backing vocals
Do You Wanna Come Inside My House? {Jenny's Foxfire song} - short song sung by Jenny in a scene in that movie.
Greetings In Braille - The Elected song with Jenny on backing vocals
Inmates - The Good Life song with Jenny on backing vocals
Intentions - Whispertown2000 song with Jenny on backing vocals
Lean Back - Whispertown2000 song with Jenny on backing vocals
 Magic Man (live) - Heart cover. Jenny with Nada Surf on their tour with Rilo Kiley in August 2001. Not officially released. No known recordings.
Napoleon's Hat - Bright Eyes song with Jenny on backing vocals
 Nothing Better (live) - The Postal Service song with Jenny on additional vocals, live 2003. Not officially released, but there are recordings out there.
 Radio Campaign - M Ward song with Jenny on backing vocals
 Recycled Air - The Postal Service song with Jenny on backing vocals
Roll On - also know as "A Warm Bed Is Something", this is a song Jenny recorded with Jimmy Tamborello for Dntel. Jenny has performed an acoustic version of the song live at least once, 8/23/04.
 Sad Sad Song (live) - M Ward with Jenny on backing vocals, live July-August 2003. Not officially released, but there are recordings out there.
 Sierra - Cursive song with Jenny on backing vocals
 Sleeping In - The Postal Service song with Jenny on backing vocals
 Such Great Heights (live) - The Postal Service song with Jenny on backing vocals, live. Not officially released, but there are recordings out there.
Summer In The City - Vietnam song with Jenny on backing vocals
 The District Sleeps Alone Tonight - The Postal Service song with Jenny on backing vocals
 The Recluse - Cursive song with Jenny on backing vocals
 There's Never Enough Time - The Postal Service song with Jenny on backing vocals
 Through a Hole - Whispertown2000 song with Jenny on backing vocals
 We Will Become Silhouettes - The Postal Service song with Jenny on backing vocals
 We're All In This Together - Ben Lee song with Jenny on backing vocals
 What'll I Do - The Watson Twins song with Jenny on backing vocals
 You Again - James Figurine song with Jenny on backing vocals