New York, NY, USA. The Fiery Furnaces are Matthew and Eleanor Friedberger. Yes, you guess it, it's a brother sister duo. "Benton Harbor Blues" is out of the fourth album Bitter Tea (Amazon) which was released in 2006. Altogether, they have released seven albums.
The video below shows a gig @ Smith's Olde Bar in Atlanta. It's a bit of 60s/70s style I think. The original is much slower.
right click & save target as