Foro » Feedback and Ideas

Request: Library Export Feature

 
  • Request: Library Export Feature

    It would be great to have a "Library Export" feature that exports all tracks in a user's library in XML format. A great deal of time has been spent building up a library, and many new artists found using the excellent recommendation feature. Having a Lib Export feature would go a long way toward providing the piece of mind that the time spent wasn't time wasted.

    Basic attributes required would include the following:


    Must Have
    Artist Name
    Album Name
    Track Name
    Loved (Y/N)
    User Tags (names of all user tags applied to track)
    User Playlist Names (names of all user playlists assigned to track)

    Nice To Have
    Artist MBID
    Album MBID
    Track MBID
    Playcount


    I realize that 3rd party tools exist that supposedly do the task. But, to my knowledge, none of them work appropriately (or include the info requested) due to LFM public API constraints. As such, I suspect external party import routines are flawed as well. Having access to a full lib feed would be extremely useful.

    • [Usuario eliminado] escribió...
    • Usuario
    • 1 Jul 2009, 8:14
    For now I just worked around this by using File->SaveAs...HTML on every page in the http://www.last.fm/user/<USERNAME>/library/recent collection, as well as the loved tracks, playlist, tags (for each), grapevine, replytracker, and profile pages.

    I can then re-interrogate last.fm if necessary for album info if there's anything I want to buy, and (when I get round to it) write some VB hack to transform the HTML into CSV and import to excel or appleworks or whatever.

    (OK I'm assuming there's no hidden system state, or its loss would be insignificant, such as playcount, MBID guids etc.)

  • Yup, I've got a kluge as well... but it gets pretty wild as the tags/playlists and overall lib size grow.

    They've got a basic feed which is close to suitable for the purpose already. Just a bit of modification and the feature is in place.

  • How to export last.fm library? Still, no solution?

    I would like to export to an excel page a list:

    -including all tracks that I added, even if the ones that have 0 counts.


    Could someone who works at Last.fm actually answer if there´s plans to incorporate this simple feature, or let others do it?

    I know there are some applications out there that can do part of this but none can export the HOLE library.

    This is a basic, useful, easy, feature that should have been incorporated long time ago.

    I need it to have a backup, and to be able to print out the list and clean the song list effectively.

    Please let us know what are the prospects.
    Thanks

    Editado por Patriushko el 1 Dic 2009, 15:59
    • lijemo escribió...
    • Usuario
    • 1 Dic 2009, 15:58
    This 3rd party site: http://build.last.fm/item/36 has a feature that allows you to export your last.fm library info in Excel format. (I don't remember exactly which fields are included)

    Edited: darn, that seems to just be per-artist and per-artist-per-week counts, which won't be helpful if you want to export individual scrobbles.

    \mXm/ R.I.P (Rock in Peace) Ronnie James Dio 1942 - 2010 \mXm/
  • lijemo said:
    This 3rd party site: http://build.last.fm/item/36 has a feature that allows you to export your last.fm library info in Excel format. (I don't remember exactly which fields are included)


    Thank you but I think I saw this before and couldn´t extract all the data.
    If someone has a suggestion please include the precise link.

    • lijemo escribió...
    • Usuario
    • 1 Dic 2009, 16:06
    Thank you but I think I saw this before and couldn´t extract all the data.
    Yup, I noticed that and added my "Edited: Darn," addendum before you even had a chance to finish posting your response =^).

    Hope you find something!

    (I've been meaning to request an API key and start playing around with the API-- if I do, I'll keep this thread in mind and see if I can come up with something. Nobody hold your breath though, very much a when-and-if-I-get-around-to-it thing.)

    \mXm/ R.I.P (Rock in Peace) Ronnie James Dio 1942 - 2010 \mXm/
  • thanks, i stay tuned...

    • percy74 escribió...
    • Usuario
    • 1 Dic 2009, 17:45
    Have you tried this? I think it will do what you want, although there's no easy-to-use UI and it does require you to have Perl installed on your computer (the links for everything you need are included in this journal entry). Once I figured out how to work it, it worked quite well. It may take a while to run (my library took about 20 minutes to extract) but I found the library.getAlbums / library.getArtists / library.getTracks data was very complete. Hope this helps.

  • Dang... resurrected thread from the dead!

    I'll throw a 2nd out there for toc-rox's utils. They get right to the point and do the job well, and there's plenty of doc's to get you going.

    • onno escribió...
    • Usuario
    • 2 Dic 2009, 9:22
    is this useful: http://www.last.fm/api

    " they said the classics never go out of style, but they do, they do "
    • akrde escribió...
    • Suscriptor
    • 3 Dic 2009, 17:20
    onno said:
    is this useful: http://www.last.fm/api


    Nope, mainly because of this:

    limit (Optional) : Limit the amount of tracks returned (maximum/default is 50).

    And API had to be extended to get user tags, user playlist names, and so on...

  • Note there's also a 'page' parameter – you can get a user's entire track history in blocks of 50 tracks if you so wish.

    • akrde escribió...
    • Suscriptor
    • 3 Dic 2009, 19:40
    acreature sagte:
    Note there's also a 'page' parameter – you can get a user's entire track history in blocks of 50 tracks if you so wish.


    Ah yes, you are right. Overlooked the page parameter there...

  • What if this happens to us? When we will have a solution, or an answer from Last.fm?


    "They sold out on Dec. 8th.” Users are particularly upset about losing their playlists"


    Why we don´t have this simple feature? designed for everyone not just computer savvy people? Should we create a group to lobby for it?

    MySpace Continues To Get Trashed Over Imeem Shutdown
    http://fon.gs/mydata/

  • I love http://mcm69.org.ua/lastfm/

    It goes through your entire library.
    So you can just copy&paste, and alphabetize (http://alphabetizer.flap.tv/), and have a list of it. It's your charts/library, without all the data/numbers.

  • +1 from me :)

  • I'd love to have that feature, too!

    • toc-rox escribió...
    • Usuario
    • 15 Ene 2010, 14:56
    Maybe helpful:

    How to collect your scrobbling history:
    perl lfmCOL.pl -xmlfile=JoesRecentTracks.xml method=user.getRecentTracks limit=50 user=JustSomeOldJoe

    How to collect your music library (tracks):
    perl lfmCOL.pl -xmlfile=JoesMusicLibrary.xml method=library.getTracks user=JustSomeOldJoe

    Works on Windows, Unix and OS X.
    And you can do much more ...

    Link to utility and documentation: lfmCOL.pl

    Editado por toc-rox el 22 Ene 2010, 10:45
  • Thanks, Klaus... I was actually going to throw up a link to your tool.

    Folks, if you want to export your lib -- and you should -- get yourself over to toc-rox's page, download his lfmCOL tool, and run it. It's well doc'd, takes minimal effort, and it works!

    • [Usuario eliminado] escribió...
    • Usuario
    • 15 Ene 2010, 18:19
    Ooh! Bookmarking this one to check out at the weekend. Thanks!

  • short feedback on lfmCOL.pl:

    for 139 library pages (ca. 2500 artists) I got a 5.3 MB xml file with:
    perl lfmCOL.pl -xmlfile=Erkan.xml method=library.getTracks user=Erkan-Yilmaz


    perceived problems so far:

    1. missing packages at first start:
    Can't locate XML/Simple.pm in @INC (@INC contains: /etc/perl /usr/local/lib/perl/5.10.0 /usr/local/share/perl/5.10.0 /usr/lib/perl5 /usr/share/perl5 /usr/lib/perl/5.10 /usr/share/perl/5.10 /usr/local/lib/site_perl .) at lfmCOL.pl line 52.
    BEGIN failed--compilation aborted at lfmCOL.pl line 52.

    solvable with installing missing package: perl -MCPAN -e 'install XML::Simple'

    2. not complete library exported (?)
    atm I have 144 pages, but the tool just read 139
    I guess this may be due to a database not being yet synced? must check


    test system:
    download version: lfmCOL.pl - Generic last.fm Data Collector (last.fm -> xml), Rel. 0.4.0 - 2010-02-10
    Debian 5.0.5 (lenny64)
    perl 5.10.0

    last.fm tools: music soulmates, recommender for: bands, last.fm groups, trends, ...
  • toc-rox said:
    Maybe helpful:

    How to collect your scrobbling history:
    perl lfmCOL.pl -xmlfile=JoesRecentTracks.xml method=user.getRecentTracks limit=50 user=JustSomeOldJoe

    How to collect your music library (tracks):
    perl lfmCOL.pl -xmlfile=JoesMusicLibrary.xml method=library.getTracks user=JustSomeOldJoe

    Works on Windows, Unix and OS X.
    And you can do much more ...

    Link to utility and documentation: lfmCOL.pl





    lfmCOL sounds great. I have tried to install it but I failed (see details below).

    Any tip for a non-IT expert please?

    Many thanks,

    E.


    -------------


    I am using Windows Vista.


    I have
    - followed the link and read the documentation
    - downloaded and unzipped lfmCOL.pl,
    - downloaded and installed ActivePerl,
    - typed in the following text in command prompt to collect the tracks from my library:
    perl lfmCOL.pl -xmlfile=epiciocchiMusicLibrary.xml method=library.getTracks user=epiciocchi

    but it replied:
    can't open perl script "lfmCOL.pl": No such file or directory



    Mind you, I did not understand the following paragraph from the instructions, so maybe I missed a step to do with unicode (all I did was to type "mode con" in command prompt, and it showed: Code Page 850).


    Technical notes:
    - The utility comes with a configuration file (lfmCOL.cfg).
    - You typically configure your "terminal encoding" and "proxy setting".
    - lfmCOL.pl has full unicode (utf8) support.
    - You have to configure the terminal encoding according to your codepage setting.
    - Windows: eg. "cp850" / use "mode con" to find out your codepage setting.
    - Linux / OS X: eg. "utf8" / have a look at your terminal configuration.
    - Proxy support and configuration is possible.
    - HTTP timeout configuration ist possible.

    • percy74 escribió...
    • Usuario
    • 13 Ago 2010, 15:53
    You've almost got it. You just need to change the directory to the folder where the file is located. To do that type "cd" followed by a space and the directory the file is in.

    For example, if the file is in

    C:\Documents and Settings\YourName\My Documents\lfmCOL-20100210

    you type this:

    cd C:\Documents and Settings\YourName\My Documents\lfmCOL-20100210

    Then press Enter and you are now in the folder where the file is. Then run the program as you did before:

    perl lfmCOL.pl -xmlfile=epiciocchiMusicLibrary.xml method=library.getTracks user=epiciocchi

  • percy74 said:
    You've almost got it. You just need to change the directory to the folder where the file is located. To do that type "cd" followed by a space and the directory the file is in.

    For example, if the file is in

    C:\Documents and Settings\YourName\My Documents\lfmCOL20091107

    you type this:

    cd C:\Documents and Settings\YourName\My Documents\lfmCOL20091107

    Then press Enter and you are now in the folder where the file is. Then run the program as you did before:

    perl lfmCOL.pl -xmlfile=epiciocchiMusicLibrary.xml method=library.getTracks user=epiciocchi



    Thanks very much. I am getting really excited. I am now in the right directory. But I get the reply:
    Error opening logfile "lfmCOL.log" : Permission denied

    Any idea please? I feel I am near...

    E.

Los usuarios anónimos no pueden escribir mensajes. Para participar en los foros inicia sesión o crea una cuenta.