Alphabetization Is Not Fit for Music Libraries

16 Responses · June 16, 2008

Wikipedia’s article on alpha­be­ti­za­tion explains:

Advan­ta­ges of sor­ted lists include:

  • one can easily find the first n ele­ments (e.g. the 5 sma­llest coun­tries) and the last n ele­ments (e.g. the 3 lar­gest countries)
  • one can easily find the ele­ments in a given range (e.g. coun­tries with an area bet­ween .. and .. square km)
  • one can easily search for an ele­ment, and conc­lude whether it is in the list

The first two advan­ta­ges are things you almost never need to do with music libra­ries. And the third has been sup­plan­ted by now-ubiquitous search boxes: if you know what you’re loo­king for, you search; and if you don’t, an alpha­be­ti­zed list is not the way to find it.

Web visio­nary Ted Nel­son (<mst3k>Dr. Ted Nelson?</mst3k>) has been paraph­ra­sed as poin­ting out that “elec­tro­nic docu­ments have been desig­ned to mimic their paper ante­ce­dents,” and that “this is where everything went wrong: elec­tro­nic docu­ments could and should behave enti­rely dif­fe­rently from paper ones.” If the fol­der metaphor is ina­de­quate for digi­tal docu­ments, no won­der it’s so piti­ful at hand­ling music. The pro­xi­mity bet­ween pie­ces of music in a library should least of all be based on the first let­ter in a band’s name – it’s as arbi­trary as sor­ting them by the vocalist’s month of birth – yet this is how it’s uni­ver­sally done.

Music library orga­ni­za­tion needs to be re-thought from the ground up. We need to con­si­der how it is that peo­ple used to lis­ten to music before it was all on their iTu­nes. How are your CDs orga­ni­zed (or disor­ga­ni­zed) on your shelf? How are they orga­ni­zed in your head? What is it that prompts you to lis­ten to what you lis­ten to when you lis­ten to it? And how can we use com­pu­ters to adopt and enhance these ways of thin­king, rather than for­cing us to think like computers?

Multi-Dimensional Sor­ting

The most natu­ral method for orga­ni­zing music (if you can escape alpha­be­ti­cal thin­king for a moment) is by simi­la­rity. Last.fm does this, and it is inva­lua­ble. When you are at an artist’s page at Last.fm, you feel that you are in that artist’s “neigh­borhood,” with links to simi­lar bands, tags, lis­te­ners, and rela­ted groups. The Last.fm archi­tec­ture was desig­ned to mani­fest orga­nic, bottom-up com­mu­ni­ties around bands and gen­res. This is an expe­rience that can­not currently be repli­ca­ted in any music pla­yer, at least not easily (with the pos­si­ble excep­tion of Ama­rok). But because Last.fm’s data is extraor­di­na­rily acces­si­ble, there are vir­tually no obs­tac­les to incor­po­ra­ting this sense of “musi­cal neigh­borhoods” into a piece of software.

If you don’t already have an artist in mind whose neigh­borhood you’d like to browse, you pro­bably at least have some idea of the kind of mood you’re after, and there are seve­ral approaches here. One (perhaps the least via­ble) is using Last.fm’s tags. These are actually less often con­cer­ned with mood than they are with genre, a taxo­nomy well-known as being incon­sis­tent and, I would argue, mis­gui­ded: When I want to lis­ten to Lulla­tone, it’s not because I want to lis­ten to elec­tro­nic music; it’s because I want to lis­ten to “whim­si­cal,” “deli­cate,” “inno­cent,” “spar­kling” music. Who cares what genre it is?

All­Me­dia­Guide began a pro­ject called Tapestry some time ago, an appli­ca­tion of their vast mood/situation/genre data­set. It is an ideal solu­tion for brow­sing music, and its inte­gra­tion into desk­top soft­ware would be hugely rewar­ding. It’s pos­si­ble to simu­late Tapestry with foobar2000 and some elbow grease, but the results are not as robust as they could be.

Again, if you already know what you’re loo­king for, it would be dif­fi­cult to find it through these chan­nels; but this is what search is for.

Per­so­na­li­za­tion

We also need to con­si­der the less objec­tive and more per­so­nal rea­sons that music beco­mes rele­vant in spe­ci­fic con­texts, ana­lo­gously to the way in which CDs become disor­de­red on one’s shelf. I, for ins­tance, usually have about 20 albums lit­te­ring the top of my recei­ver and spea­kers. These inc­lude, roughly, (a) stuff I just bought, (b) stuff I just lis­te­ned to, and © stuff I haven’t bothe­red put­ting away because I know I’ll lis­ten to it again soon.

The main obs­tacle to brow­sing in this way is a pre­va­lent short­co­ming whose symp­toms are far-reaching: the fact that music pla­yers “think” in terms of songs, not in terms of albums—or even in terms of artists, for that mat­ter: My music soft­ware doesn’t know that these 38 songs are all by Elec­tre­lane; it just knows that their artist meta­data is alpha­be­ti­cally adja­cent. Sure, you can sort iTu­nes libra­ries by data such as “last lis­te­ned” and “added”; and you can use Cover­Flow to simu­late a pale appro­xi­ma­tion of a flesh-and-blood record collec­tion; but the only way you can sort albums or artists is alpha­be­ti­cally. I’ve writ­ten about the ways in which MP3Toys addres­ses this pro­blem, and it remains a com­men­da­ble pio­neer in music mana­ge­ment, but its dif­fi­cul­ties (a steep lear­ning curve, a buggy inter­face, a rapid release sche­dule) out­weigh its advantages.

Brow­sing your own music library is a very imper­so­nal expe­rience, des­pite enor­mous poten­tial for per­so­na­li­za­tion. Rich info visua­li­za­tion “toys” such as Last.fm Extra Stats and Last­Graph are seen as novel­ties, but would, in fact, be revo­lu­tio­nary as library brow­sing envi­ron­ments. There is nothing to pre­vent this from deve­lop­ment, either; even users who are not plug­ged into Last.fm could have their lis­te­ning his­tory sto­red locally by their music soft­ware, which could then be used to gene­rate small, cached, infinite-resolution SVG his­to­grams, brow­sa­ble by zoo­ming, pan­ning, and clic­king. Far from being cum­ber­some and CPU-intensive, it would actually be rather elegant.

Con­ti­nuing on the theme of chro­no­logy, what about a sim­ple calen­dar charts view, with var­ying gra­nu­la­rity by day, week, month, quar­ter? Pre­sen­ta­tio­nally, these charts could even be made easily to resem­ble ver­ti­cal stacks of CDs, with spine art gene­ra­ted from a crop­ped cover image and over­laid text. This would arguably be eye-candy, of course, but just ima­gine how it would “feel” to see your music this way. If there’s one thing Apple’s been con­sis­tently right about, it’s that func­tio­na­lity is not at odds with a plea­sant user expe­rience, but rather that they are meant to be mutually supportive.

When I was hel­ping to esta­blish some plays­tamp tag­ging stan­dards with the foo­bar com­mu­nity in 2005, it was jokingly sug­ges­ted that when songs are pla­yed they be tag­ged with the current weather. Des­pite the sar­casm, I couldn’t help but think, “What a great idea!” I know my lis­te­ning habits are affec­ted by the weather, and I can’t ima­gine other peo­ple are not the same. There is, after all, a frequently-used “rainy day” tag at Last.fm.

What about a his­to­gram based not on play count, but on hot­ness values over time? What about artist simi­la­rity webs based not on Last.fm data, but on pro­xi­mity of play times within your per­so­nal his­tory? What about taking les­sons from the DONTCLICK.IT pro­ject, Bump­Top, and the pile metaphor for unpre­ce­den­tedly fluid user interfaces?

What Now?

All the ingre­dients are there. Ever­yone is rapidly moving towards an exc­lu­si­vely digi­tal music collec­tion, and the tech­no­logy is emba­rras­singly out­mo­ded. Music has become a major com­po­nent of com­pu­ting, at levels once reser­ved for word pro­ces­sing and gaming. Our rela­tionship with our digi­tal music collec­tions is poi­sed for rein­ven­tion, a loo­ming dif­fi­culty that has been made invi­si­ble by cus­tom and habit. Digi­tal music mana­ge­ment is hell, and users have com­pla­cently accep­ted this.

The obvious solu­tion at this point is Song­bird. Songbird’s media views (pre­sent since 0.5) allow more easily than ever for cus­tom brow­sing envi­ron­ments. Pre­viously the only way to alter your music brow­sing envi­ron­ment was to switch pro­grams enti­rely; besi­des which, nearly all avai­la­ble pro­grams simply mimic the well-known disk/directory views or iTu­nes’ brow­ser pane view (which is just a glo­ri­fi­ca­tion of a disk/directory view any­way). Song­bird, on the other hand, boasts an unpre­ce­den­ted exten­si­bi­lity, cou­pled with media atten­tion, ease-of-use, and the Mozi­lla plat­form, for which peo­ple have been deve­lo­ping exten­sions for ages (in com­pu­ter years).

The pros­pects are thri­lling and the poten­tial for inno­va­tion is vir­tually limit­less. Pro­mi­singly, there are some glimp­ses of where things might be hea­ded for Song­bird media views: Cata­lo­gue View demons­tra­tes a novel visual pre­sen­ta­tion of your library, though it doesn’t do much in the way of orga­ni­za­tio­nal pre­sen­ta­tion; and Metrics Media Page is the begin­nings of the kind of info­vis view that could be (but currently isn’t) adap­ted to allow for actual navi­ga­tion. Neverthe­less, I have a bad fee­ling that this oppor­tu­nity will be mis­sed, as the sta­tus quo con­ti­nues to obfus­cate these possibilities.

new web­site is ama sing
ps every time i lis­ten to music it is based on the weather
hi jay

sydney · June 26, 2008

Thanks snute.

The weather affects my lis­te­ning a lot, espe­cially if it’s a big change, like waking up to a gray, wet, quiet day, or the first big snow of the year. Time of day is impor­tant too. And fluc­tua­tions in the NASDAQ average.

Jay · June 27, 2008

I don’t see why we are see­mingly una­ble to have infor­ma­tion over­load in regards to meta­data. I think there’s always something more I’d like to know about a song when I’m lis­te­ning to it, but there are no real attempts at pre­sen­ting the kiloby­tes of infor­ma­tion that could be applied to a song just based on sleeve notes.

Take The Decem­be­rists, for exam­ple, maybe I’d like to see other artists simi­lar to them, other pro­jects by mem­bers, quo­ted ins­pi­ra­tions, obser­ved ins­pi­ra­tions, etc. Or maybe I’m lis­te­ning to ‘Thri­ller’ and I’d like to see what else Quincy Jones has pro­du­ced. A web based approach would have to be used in order to dis­play items I don’t have personally.+]ertyu

Walter · July 2, 2008

Wal­ter: Actually Song­bird has a Wiki­pe­dia add-on that helps to pro­vide that sort of con­text. Just the other day I was trying to come up with a bet­ter search solu­tion than that, as Wiki­pe­dia isn’t really very com­prehen­sive in the bands it covers. What if I’m currently lis­te­ning to Grou­per and I want to see, in one place, all her relea­ses, nota­ble cri­ti­cal com­men­tary, rela­ted artists, etc.? I couldn’t even think of a pro­per “jum­ping off” point, some site that has even links to all those things. Last.fm is a decent solu­tion, as part of its func­tion is to serve as a wiki for every band, in theory, but you’d have to go elsewhere for cri­ti­cal context.

Since almost every band has a MyS­pace page now, that’s actually a good start, des­pite all the things I hate about MyS­pace. Lesser-known bands espe­cially tend to link to reviews of their albums, blog announ­ce­ments about new relea­ses, and pro­vide presskit-quality art­work and bio­graphi­cal data.

There’s actually a great article about what you’re desc­ri­bing that I meant to link to in this post:

But the con­tent expe­rience on the Web is crap. Go to Aqua­rium Drun­kard, click an MP3. If you don’t get a 404, you’ll get a Save As… dia­log or the SAME GOD DAMN QUICKTIME BAR FROM 1995. OMFG. ARE YOU KIDDING ME? THIS IS ALL WE’VE ACCOMPLISHED IN 15 YEARS ON THE WEB? It makes me insane.

Jay · July 2, 2008

great article

Music · October 13, 2008

I have one easy rea­son why we all orga­nize our music alphabetically.

Because many of us are tied to that archaic crea­tion, the album. And many of us lis­ten to, and judge, musi­cians based upon that cri­te­ria. I may be an old man at 26, but when I decide I want to hear The Who I put on The Who Sell Out, or wha­te­ver album I want to hear. I don’t care that it’s most clo­sely asso­cia­ted with Brit­ney Spears and then next.

There’s some value in orga­ni­zing a music library with tags to easily create play­lists based upon mood. That can be help­ful, if you want mixed music. But why would I orga­nize my music in any way but alpha­be­ti­cally? You pro­vide an argu­ment, but no evi­dence to back it up. I want to be able to find a band/album/song easily. Anarchy belongs in the streets, not in a library or music library.

When you do your laundry do you put your clothing away by % cot­ton, or do you put it away by type of clothing. I’m sure it will be very use­ful when you’re trying to find that spe­ci­fic pair of pants and have to dig through 20 shirts that hap­pen to have a simi­lar fiber makeup.

Me · October 14, 2008

Thanks for the com­ment, “Me.”

There’s one sim­ple ans­wer to your ques­tion: If you want to lis­ten to The Who, you put your mouse in that little search box in the cor­ner and type “The Who.” If you’re using an alpha­be­ti­cal list to find artists and albums also, then that’s two tools redun­dantly ser­ving the same purpose.

I’m not tal­king about making mixes, although that’s valua­ble to some peo­ple too. I, like you, am “tied to that archaic crea­tion” as well — almost all of my lis­te­ning is by full album. In fact I even men­tion in the article that one of the short­co­mings of the most popu­lar media pla­yers is that they don’t “think” in terms of albums.

What I’m trying to address is the pro­blem of having too much music, and too diverse taste. I have 1,664 albums in my library, and I’m sure there are other peo­ple with thou­sands, if not tens of thou­sands, more. I don’t always know what I want to lis­ten to; in fact, I’d wager that most of the time, I don’t know what I want to lis­ten to. I know I want to lis­ten to something, and that that something is in there somewhere, but I don’t know what it is.

If you asked me to list, from memory, all 1,664 albums in my library, I’d pro­bably never make it past a cou­ple hun­dred, and that would take days. If I’m in a situa­tion where I have to figure out what to lis­ten to, only the artists who are most fami­liar to me will spring to mind first, but that lea­ves me trap­ped lis­te­ning to the same things over and over. What I’m after is a sys­tem that will know bet­ter than me what I want to lis­ten to, based on my lis­te­ning habits, artist simi­la­rity, etc., and which can help me to explore the things I have that won’t spring to mind.

A short story: yes­ter­day I was peru­sing my phy­si­cal CD collec­tion (gasp!) to find a spe­ci­fic album I wan­ted to lis­ten to while I wal­ked to work. While loo­king for that one album, I found another album that I rea­li­zed was more appro­priate for my mood, for the weather, for the time of day, for how long it had been since I last lis­te­ned to it…etc. Now, why didn’t I know that’s what I wan­ted to hear when I first approached my CD collec­tion? It’s because my mind is very fla­wed and very finite, and can only know so much about what my library looks like.

The Who is a very well-known band, and one that I’m sure you’ve lis­te­ned to a lot, so it’s easy for you to know that you want to lis­ten to them. But wouldn’t it be a bet­ter sys­tem if, when you’re brow­sing (not searching) your library for The Who, you’d find them adja­cent to The Rolling Sto­nes, The Kinks, and Cream, rather than Wil­son Phi­llips, Wil­der­ness, and Wes­ley Willis?

It’s like I said in the article: If you know what you’re loo­king for, you search. If you don’t, then an alpha­be­ti­zed list is not the way to find it.

And I think your laundry ana­logy actually works in my favor. Shirts go together because they are of the same type of clothing, just as The Who and The Rolling Sto­nes are the same type of music. I would never sort my clothes by their brand, for ins­tance, yet this is ana­lo­gous to sor­ting a music library by artist. I don’t care who made the clothes, I care that they are appro­priate for the weather, that they match, that I haven’t worn them recently, etc.

Jay · October 14, 2008

Hmm, I can buy the argu­ment on prin­ci­ple, but I can’t think of a good imple­men­ta­tion that wouldn’t be a ton of work to create and main­tain. My library is only 400 albums or so by 70 musi­cians, so it’s still quite mana­gea­ble by scan­ning through. Nor­mally if I’m put­ting on music from my library I do know spe­ci­fi­cally what I want to play, if I’m in just a more gene­ral mood I’ll put on a Shout­cast sta­tion or something along those lines.

To a large degree that same clas­si­fi­ca­tion can be done by good tags and a solid media pla­yer, plus it has the added advan­tage of being easy for someone else to browse and deal with on all sorts of pla­yers. If my wife is trying to play something on from my Tver­sity ser­ver on the PS3 she doesn’t need to know that I’ve clas­si­fied The Vio­lent Fem­mes as punk rather than folk, and in that case searching is incon­ve­nient. There is the pro­blem of kno­wing whether they’d be filed under T or V, but that’s more minor.

And even beyond the bands that don’t neatly fit, do you handle musi­cal style by band, album, or song? If it’s just by band something like On Every Street by Dire Straits will end up mas­si­vely misc­las­si­fied. If it’s by album how do you handle Sticky Fin­gers by The Rolling Sto­nes? And if it’s by song you then need a whole sys­tem of play­lists to rec­reate the albums themselves.

Me · October 14, 2008

I don’t agree with Ted Nel­sons com­ments. Files and fol­ders were a per­fect start and they’ve been very suc­cess­ful. His ideas are a kind of “start again from scratch” men­ta­lity, and that’s simply not pos­si­ble. We’ve gone too far already.

We need to com­ple­ment exis­ting inter­fa­ces with new acces­si­bi­lity and use the hard­ware at our dis­po­sal to do so. For exam­ple, the iphone has audio out and in, so how about analy­sing the “sound” of your music collec­tion to fit the ambient sound level, or to give clues to the “mood” of where you are? Everything is net-enabled these days, and we’re not short of meta­data to desc­ribe music. So these kind of con­nec­tions should be effortless.

Tech­no­lo­gi­cally, we’re at a won­der­ful point in time where all these things are just beco­ming pos­si­ble. We just need to get on with it and start making them. It’s almost as if music is on the verge of some audio equi­va­lent of photosynth[1] being inven­ted, and with the kind of meta­data being for­med by ser­vi­ces like pandora.com[2] there are some exci­ting and unex­pec­ted music appli­ca­tions ahead.

[1] pho­tosynth demo
[2] music genome

Adam · October 15, 2008

Thanks again for the com­ments guys.

As far as the “ton of work to create and main­tain” goes, Adam’s right in that there’s meta­data everywhere. He men­tions Pan­dora, which is kind of a top-down approach to clas­sif­ying music: “experts” meti­cu­lously cate­go­ri­zing everything they can by musi­cal “genome.” I pre­fer Last.fm, howe­ver, with its empi­ri­cal, bottom-up approach to clas­si­fi­ca­tion, based on trac­king actual lis­te­ning habits. That, and they have a long his­tory of making their meta­data free and acces­si­ble with public XML ser­vi­ces for just about everything. So, in short, you wouldn’t have to do anything; your music pla­yer would know which artists should be grou­ped together automatically.

I sup­pose when it comes to a mouseless/keyboardless inter­face like the PS3 (or a por­ta­ble pla­yer, come to think of it), alpha­be­ti­cal lists do make searching easier than having to “type” artists’ names; so in those cases, I’d have to con­cede that you’re right, Me. And I sup­pose what I’m desc­ri­bing will be use­ful only to peo­ple with large libra­ries like myself. But for those of us who have those large libra­ries, mining our collec­tions is inc­re­dibly frus­tra­ting, espe­cially when you rea­lize that there are so many oppor­tu­ni­ties to create brow­sing envi­ron­ments that are not only more intui­tive and func­tio­nal, but fun as well.

Adam’s also right that these kinds of inno­va­tions should be “effort­less,” yet it seems as though nobody’s inno­va­ting. Nobody has been thin­king beyond the alpha­be­ti­zed list until recently, with Apple’s “Genius” fea­ture and Microsoft’s “Mix­View” — and both of these seem to be efforts to sell music, not pri­ma­rily to make your library more dynamic.

All it would take is a room of user-interface experts expe­ri­men­ting with dif­fe­rent models to “push” your music to you in inte­res­ting new ways, based on artist simi­la­rity, based on your lis­te­ning his­tory, based on mood, based on time of day, based on time of year — hell, based on the weather and on news feeds. It wouldn’t merely be flashy; it would, I think, pro­foundly change the way you inte­ract with your music library.

Jay · October 15, 2008

All it would take is a room of user-interface experts expe­ri­men­ting with dif­fe­rent models to “push” your music to you in inte­res­ting new ways, based on artist simi­la­rity, based on your lis­te­ning his­tory, based on mood, based on time of day, based on time of year — hell, based on the weather and on news feeds. It wouldn’t merely be flashy; it would, I think, pro­foundly change the way you inte­ract with your music library.

The ground­work has sort of been laid for that already. There are many music ser­vi­ces that offer tai­lo­red experiences…rate a song up and you get it more often (some­ti­mes even simi­lar songs more often). Rate it down and you never hear it again.

You could create a per­so­na­li­zed sys­tem where you iden­tify your mood, or what sort of music you’re inte­res­ted, or what color socks you’re wearing…then rate songs up or down. In theory, with time, it could simply train itself to serve music based upon those fac­tors on just your hardware.

To do it well would be expen­sive, a cen­tral data­base could com­bine the data from peo­ple, perhaps sort it by ove­rall pre­fe­ren­ces (for ins­tance, some­ti­mes I like The Distillers…so perhaps my opi­nion is held to be less rele­vant on when I want to hear Paul Simon for someone who just lis­tens to light rock).

I think the pro­blem is that a truly inte­lli­gent, easy to use, ser­vice would take a mas­sive amount of infras­truc­ture. It would have to deal with music on a song, album, and artist level…tying all of those to musi­cal taste and emo­tio­nal desc­rip­tion. It would either have to be based upon a sales model, or be done by a com­pany with enough mar­ket pene­tra­tion (Read: Goo­gle) to mine data at a very mas­sive rate.

Me · October 15, 2008

Oh, and I should admit there’s one huge rea­son I cling to a sim­ple alpha­be­ti­cal artist\album\songs clas­si­fi­ca­tion system.

I dual boot, and like run­ning very strip­ped down music pla­yers. I detest iTu­nes. On my Linux par­ti­tion I like XMMS. Windows…I’ll admit I still love Winamp. I haven’t bro­ken free from that inter­face. I know there are all sorts of library based music pla­yers for Linux, such as Ama­rok. I know there are all sorts of fancy library based pla­yers for Windows…but I don’t know that I’ll ever get past straight­for­ward music players.

Me · October 15, 2008

This is a very inte­res­ting article, but I feel that the pro­blem is akin to orga­ni­sing books.

If you asso­ciate artists, how do you link bands like (just taking the first one I think of) The Beat­les? Are they close to the Beach Boys, the Sta­tus Quo, ELO, the Mon­kees, and even Brit­pop like Oasis? Are they close only to some? The Beat­les star­ted out with Please Please Me and Help!, but finished with Sar­gent Pepper’s… If one con­si­ders the Beat­les as a whole, they become lin­ked to so many bands there’s little point in lin­king them in such a way… I only like their Psyche­de­lia albums, and I defi­ni­tely don’t like their early pop tunes. I have no inte­rest in the Mon­kees, but I like the Sta­tus Quo and the Beach Boys. To go back to the author com­pa­ri­son I made ear­lier, who is Wilde close to? The Por­trait of Dorian Gray and the Ballad of Rea­ding Gaol are so dis­si­mi­lar (and then there are all his plays that are once more a dif­fe­rent tone) that he can be lin­ked with far too many peo­ple to make any links use­ful to someone who is only inte­res­ted in the Ballad of Rea­ding Gaol (or the Por­trait of Dorian Gray).

So what about albums? That’s already a bet­ter pro­po­sal, since it would make an artist’s evo­lu­tion clea­rer. “Help!” and “Sar­gent Pepper’s” can be lin­ked because it’s the same band, but at least groups like the Mon­kees will be kept away from Ser­geant Pepper’s.

Unlike you, I lis­ten more to just one track of an album at a time. Create play­lists, play them. So I wouldn’t be very inte­res­ted by grou­ping music by album. After all, I feel that bet­ween Lucy in the Sky with Dia­monds, She’s Lea­ving Home, A Day in the Life and Ser­geant Pepper’s Hearts Club Band, there are dif­fe­ren­ces so great I don’t always feel like lis­te­ning to all of them one after another (or in such a short time frame). So I’d be a pro­po­nent of lin­king each song… I think you can see where this is going. It’s going to be a night­mare to link songs indi­vi­dually, and even har­der to recog­nise if said link is worth it (how many hun­dred of thou­sand of songs imi­ta­ted Lucy in the Sky With Dia­monds’ sound, and how many were any good?).

The pro­blem is that liking or dis­li­king (or being indif­fe­rent) to a track seems to me as something very sub­jec­tive. I think a lot of peo­ple (or at the very least myself) like music that is very diverse. From Joy Divi­sion to the Happy Mon­days, Dizzy Gilles­pie to Bill Haley, and count­less others, with each time tracks that I like more and others that I like less… What does “bleak/cold” mean when tal­king about Louis Arms­trong? Is it the same as for A.I.R and Grand­mas­ter Flash? All these appre­cia­tions are ulti­ma­tely extre­mely per­so­nal. Last.fm sug­gest I lis­ten to Alain Souchon, Luke, Renan Luce, Cali, BB Bru­nes, Fran­cis Cabrel and Bruel… Except I already know all of them and I dis­like them. Yes, they sound like some artists I lis­ten to (fun­nily enough, not artists I lis­ten to a lot, so perhaps last.fm’s ran­king sys­tem needs to be re-tuned), and lots of them have fans who are also fans of bands I like. But when my top fif­teen only has three french-language artists (accor­ding to last.fm), why sug­gest so many french bands, and –NO– english-language bands (nine of those fifteen)?

These ideas are very inte­res­ting, but I think I’ll stick to making my own play­lists, and every now and then either going straight to a track/album/artist I want to lis­ten to, or just put­ting on the shuf­fle mode.

I’ve drif­ted away from the book com­pa­ri­son I star­ted with, but I do find it simi­lar. We don’t rank books by the author’s name, and orga­ni­sing music by the name of the composer/performer is also not the best. Howe­ver, once the topic is broadly defi­ned (novels, refence books, psycho­logy, phi­lo­sophy or rock, clas­si­cal, elec­tro­nic) it beco­mes slightly futile to attempt to con­ti­nue clas­sif­ying them since any further divi­sion will likely prove more con­fu­sing for the user than help­ful. If Vic­tor Hugo’s books were sepa­ra­ted more than bet­ween “plays”, “novels” and “poetry”, would it be use­ful? In my opi­nion, no. (Howe­ver, I still find these dif­fe­rent “orga­ni­sa­tions” migh­tily inte­res­ting, and perhaps one day I’ll feel com­pe­lled to use them and find them brilliant!)

Shazback · October 17, 2008

Thanks Shaz­back. One rea­son that we’ve had to stick to alpha­be­ti­zing books is that, in most collec­tions, there’s only one copy of each of them. So if you were to want to sort by “genre,” you would have to make very sub­jec­tive choi­ces in orga­ni­za­tion. What’s great about digi­tal collec­tions is that they lend them­sel­ves to what’s called a “flat hie­rarchy” — something I talk about with regards to music elsewhere here and here. Items can be dupli­ca­ted with alia­ses and pla­ced under mul­ti­ple cate­go­ries. Kind of like if you’re loo­king in the new relea­ses sec­tion at Block­bus­ter and some­body has taken the extra step of making a shelf of old clas­sics by the same direc­tor of a new release, or with the same lead actor. It’s those rich cross-sections that are mis­sing from our music libraries.

Ideally under a sys­tem like this you will find The Beat­les next to The Beach Boys and next to Oasis. Or, if we want to get really tricky, all three of those bands will have the same X and Y values, but Oasis may have a dif­fe­rent Z value as a result of their being influen­ced by ’60s pop, and not a part of it them­sel­ves. A 3D map­ping like this makes things a little more com­pli­ca­ted than is prac­ti­cal, but it’s worth thin­king about.

Last.fm may be recom­men­ding bands to you that you don’t like, but if the Last.fm simi­la­rity data were applied to your own library, then you would only be pre­sen­ted with things you pre­su­mably like (since you own them). And, although Last.fm may not be per­fect, it’s pro­bably the most tho­rough and avai­la­ble data­set out there — and, in my opi­nion, it’s pretty damn good.

If you pre­fer to lis­ten on a song-by-song basis, then yes, I admit that this beco­mes a more dif­fi­cult pro­blem to handle. All­Mu­sic and Pan­dora do pos­sess mood-centric meta­data at the song level, but don’t make it publicly avai­la­ble. Without their coo­pe­ra­tion, per­so­nal tools might be the only way to attack this pro­blem, such as Moody for iTu­nes or (the now defunct) Mood­Lo­gic.

On the album level we only have mood-centric meta­data from All­Mu­sic. This is sub­jec­tive, of course, and even dea­ling with full albums on a mood-based level is metho­do­lo­gi­cally ques­tio­na­ble, since many albums are all over the place in terms of mood. So we either (a) just accept that this is a fun­da­men­tal pro­blem with desc­ri­bing albums by mood, or (b) devise some algo­rithm to apply the moods of every song on an album to the album as a whole, which would make an album’s inc­lu­sion under a par­ti­cu­lar mood not binary — i.e., either it is or is not “sad” — but on a gra­dient — i.e., it is 80% “sad.”

Per­so­nally, with my hack-ish imple­men­ta­tion of these moods on the album level in foobar2000, I find that I get very good results. And though there are albums that are emo­tio­nally all over the map, there are also many that are emo­tio­nally pretty sta­ble; think about Love­less or Slan­ted and Enchan­ted. Further­more, even if every song on an album is not per­fectly desc­ri­bed by the moods used to desc­ribe the album, I would argue that in most cases, albums as a whole, even if they vary in mood, either do or do not com­ple­ment the mood of a situa­tion. All­Mu­sic will often desc­ribe albums that are emo­tio­nally erra­tic as “cere­bral” or something, rather than strictly “bleak.” Check out the full list of AllMusic’s mood desc­rip­tors and you’ll see that it’s actually an admi­rably nuan­ced system.

On the artist level, this is where mood breaks down. Although sum­ming up an album by mood is a dodgy but via­ble endea­vor, the same can’t be said for artists. Brow­sing artists by mood would be fruit­less, so I don’t really pro­pose it. This is why a 2D genre/style map is in my opi­nion the best way to orga­nize artists. Last.fm already does this with their “Islands of Music” expe­ri­ment, which, as an inter­face to a desk­top music appli­ca­tion, would be bliss.

Grand­mas­ter Flash is desc­ri­bed by All­Mu­sic as being: Bois­te­rous, Brash, Party/Celebratory, Con­fi­dent, Bra­vado, Play­ful, Vis­ce­ral, Freewhee­ling, Ener­ge­tic, Gritty, Intense, Exu­be­rant, Omi­nous, Pro­vo­ca­tive, Aggres­sive, Rou­sing, Som­ber, Con­fron­ta­tio­nal, Cathar­tic, Dra­ma­tic, Searching.

Louis Arms­trong is desc­ri­bed by All­Mu­sic as being: Warm, Lively, Freewhee­ling, Care­free, Amiable/Good-Natured, Earthy, Cheer­ful, Joyous, Play­ful, Bois­te­rous, Ear­nest, Roman­tic, Glee­ful, Rou­sing, Ener­ge­tic, Fun, Con­fi­dent, Whim­si­cal, Exu­be­rant, Ele­gant, Rollicking.

Where would this put these artists in AllMusic’s more gene­ral mood cate­go­ries like “Fun/Good-Natured” and “Slick/Smooth” from their Tapestry pro­ject? I don’t know — that’s too much data to extra­po­late a quick guess from. But even if they were neigh­bors in mood, so what? Like I said, if you have a decent mood cate­go­ri­za­tion sys­tem, genre beco­mes irre­le­vant. Hell, right next to each other in this image I have cLOUD­DEAD (expe­ri­men­tal hip-hop) and Cyann & Ben (psyche­de­lic folk-rock) under Bleak/Cold. And I can tell you, yes, both of those albums are pretty bleak and pretty cold, and if one would com­ple­ment my mood at a given moment, there’s a good chance the other would as well, des­pite the two being from vastly dif­fe­rent genres.

This con­ver­sa­tion too has stra­yed from another major point I was trying to make in the article, which is that your own per­so­nal play his­tory within your music pla­yer pro­vi­des a very rich data­set to be exploi­ted. I myself have spent some time deve­lo­ping an algo­rithm to desc­ribe what I call “Hot­ness,” which looks at how fre­quently and how recently you’ve lis­te­ned to any given song to give you a snapshot of the artists that are more or less your “current favo­ri­tes.” And des­pite being admit­tedly rudi­men­tary, it still pro­du­ces vastly more inte­res­ting results than sim­ple “last pla­yed” and “num­ber of plays” sor­ting or “smart play­lists” (“smart” — hah!). And I’m sure some­body smar­ter than myself could invent far more com­pe­lling ways to look at your library that are based on your play history.

There are a lot of ways this could all go, and none of them is per­fect. But I think it’s impor­tant to start thin­king about this, and for peo­ple to start at least attemp­ting to create a richer, more dyna­mic inter­face to our libra­ries. I’m not an expert pro­gram­mer by any means, and am just now trying to verse myself more tho­roughly in Javasc­ript and XUL to start wor­king with Song­bird. But I was hoping to at least ins­pire con­ver­sa­tion with this post, and to poten­tially reach the right per­son who both sha­res my ideas about what these solu­tions might look like, and knows enough to imple­ment them somehow.

Jay · October 17, 2008

One rea­son more hasn’t been done along those lines might be that anyone who had the know­ledge and talent to do something like that on a large scale would be tre­men­dously valua­ble to the adver­ti­sing industry.

Perhaps that’s somewhere to look for ins­pi­ra­tion in the design. On the sur­face a sys­tem like Goo­gle Adsense seems unre­la­ted, but their sys­tems do the sort of large scale data mining and heu­ris­tic processing.

Me · October 17, 2008

Leave a Comment or Subscribe