Log inRegister an accountBrowse CSDbHelp & documentationFacts & StatisticsThe forumsAvailable RSS-feeds on CSDbSupport CSDb Commodore 64 Scene Database
You are not logged in - nap
CSDb User Forums


Forums > CSDb Questions > Bulk download?
2009-03-28 15:24
Wonder-Boy
Account closed

Registered: Apr 2007
Posts: 3
Bulk download?

Hi, is there a way to download a number of releases at the same time? Downloading every release individually can be a bit of a chore. I would like to be able to download for instance "all C64 demos from 2007" in one go.
2009-03-28 15:27
Jammer

Registered: Nov 2002
Posts: 1289
well, csdb server can go down due to frequent refreshing ('edge of disgrace' panic i.e.) thus this option would freeze it totally, i guess.
2009-03-28 15:32
iAN CooG

Registered: May 2002
Posts: 3132
Quote: Hi, is there a way to download a number of releases at the same time? Downloading every release individually can be a bit of a chore. I would like to be able to download for instance "all C64 demos from 2007" in one go.

There are such things called "batch downloaders": wget, flashget and getright are some of those. An handy plugin for Firefox is Down them all.
Just be gentle to the servers, abuse of these programs lead to server overloads. Allow only one download at a time, and you're done.
2009-03-28 16:07
Wonder-Boy
Account closed

Registered: Apr 2007
Posts: 3
Thank you, I will check that out.
2009-03-28 23:23
Wonder-Boy
Account closed

Registered: Apr 2007
Posts: 3
I tried Down them all, and it seems it only works if you have download links on the page, which you get if you use the simple search function. But if you use the advanced search in order to find e.g. demos from a particular year, you do not get these download links on the results page, so I think these batch downloaders won't work for me. Thanks anyway.
2009-03-28 23:32
assiduous
Account closed

Registered: Jun 2007
Posts: 343
yes there should be the disk icon with a download link next to titles in an advanced search result.
2009-03-29 01:02
iAN CooG

Registered: May 2002
Posts: 3132
strangely enough, I batch-download every day from here and other c64 sites without any problem with both down them all and flashget =)
*download.php* is the key ;)
2009-03-29 14:58
Zone
Account closed

Registered: Nov 2002
Posts: 7
Come to think of it: It would be cool if some group started to release stuff focusing on certain historical periods of the C64 scene.

For example, imagine a collection of all the releases from the party in Bergen 1990, along with some extra features like pictures, charts and contemporary mag reports. Or let's say, memorabilia from cracker wars of 1990! Pure nostalgia put together to celebrate and remember, and not least to educate and inspire us assholes who missed out on all the fun back then. :)

Anyway, I also do batch downloads from CSDb and I fully acknowledge that site admins are usually not very happy about this! I put in a few seconds of random delay between downloads, sometimes even minutes, to be nicer to the server, but still.
2009-03-29 15:02
iAN CooG

Registered: May 2002
Posts: 3132
I have noticed that csdb already has a multiple download prevention check, 2 downloads don't start from the same ip, the 2nd download starts only when the 1st is almost finished.
2016-03-01 09:30
Earthshaker

Registered: Sep 2002
Posts: 118
Quote: strangely enough, I batch-download every day from here and other c64 sites without any problem with both down them all and flashget =)
*download.php* is the key ;)


How exactly does this work? Everytime i try to do this i get a "you are creating a huge load" warning. I tried DTA and have set it to only do 1 file at a time. I eventually would like to download all the releases here, but without creating problems for the site.
2016-03-01 16:21
chatGPZ

Registered: Dec 2001
Posts: 11108
set a proper delay between requests, like a couple seconds or so
 
... 41 posts hidden. Click here to view all posts....
 
Previous - 1 | 2 | 3 | 4 | 5 | 6 - Next
RefreshSubscribe to this thread:

You need to be logged in to post in the forum.

Search the forum:
Search   for   in  
All times are CET.
Search CSDb
Advanced
Users Online
csabanw
Exile/Anubis
Guests online: 131
Top Demos
1 Next Level  (9.8)
2 Mojo  (9.7)
3 Coma Light 13  (9.7)
4 Edge of Disgrace  (9.6)
5 Comaland 100%  (9.6)
6 No Bounds  (9.6)
7 Uncensored  (9.6)
8 The Ghost  (9.6)
9 Wonderland XIV  (9.6)
10 Bromance  (9.6)
Top onefile Demos
1 It's More Fun to Com..  (9.8)
2 Party Elk 2  (9.7)
3 Cubic Dream  (9.6)
4 Copper Booze  (9.5)
5 Rainbow Connection  (9.5)
6 TRSAC, Gabber & Pebe..  (9.5)
7 Onscreen 5k  (9.5)
8 Wafer Demo  (9.5)
9 Dawnfall V1.1  (9.5)
10 Quadrants  (9.5)
Top Groups
1 Oxyron  (9.3)
2 Nostalgia  (9.3)
3 Booze Design  (9.3)
4 Censor Design  (9.3)
5 Crest  (9.3)
Top Diskmag Editors
1 Jazzcat  (9.4)
2 Magic  (9.4)
3 hedning  (9.2)
4 Newscopy  (9.1)
5 Elwix  (9.1)

Home - Disclaimer
Copyright © No Name 2001-2024
Page generated in: 0.044 sec.