| |
Wonder-Boy
Account closed
Registered: Apr 2007
Posts: 3 |
Bulk download?
Hi, is there a way to download a number of releases at the same time? Downloading every release individually can be a bit of a chore. I would like to be able to download for instance "all C64 demos from 2007" in one go. |
|
... 41 posts hidden. Click here to view all posts....
|
| |
iAN CooG
Registered: May 2002
Posts: 3137 |
Quote: Hi, is there a way to download a number of releases at the same time? Downloading every release individually can be a bit of a chore. I would like to be able to download for instance "all C64 demos from 2007" in one go.
There are such things called "batch downloaders": wget, flashget and getright are some of those. An handy plugin for Firefox is Down them all.
Just be gentle to the servers, abuse of these programs lead to server overloads. Allow only one download at a time, and you're done.
|
| |
Wonder-Boy
Account closed
Registered: Apr 2007
Posts: 3 |
Thank you, I will check that out. |
| |
Wonder-Boy
Account closed
Registered: Apr 2007
Posts: 3 |
I tried Down them all, and it seems it only works if you have download links on the page, which you get if you use the simple search function. But if you use the advanced search in order to find e.g. demos from a particular year, you do not get these download links on the results page, so I think these batch downloaders won't work for me. Thanks anyway. |
| |
assiduous
Account closed
Registered: Jun 2007
Posts: 343 |
yes there should be the disk icon  with a download link next to titles in an advanced search result. |
| |
iAN CooG
Registered: May 2002
Posts: 3137 |
strangely enough, I batch-download every day from here and other c64 sites without any problem with both down them all and flashget =)
*download.php* is the key ;) |
| |
Zone
Account closed
Registered: Nov 2002
Posts: 7 |
Come to think of it: It would be cool if some group started to release stuff focusing on certain historical periods of the C64 scene.
For example, imagine a collection of all the releases from the party in Bergen 1990, along with some extra features like pictures, charts and contemporary mag reports. Or let's say, memorabilia from cracker wars of 1990! Pure nostalgia put together to celebrate and remember, and not least to educate and inspire us assholes who missed out on all the fun back then. :)
Anyway, I also do batch downloads from CSDb and I fully acknowledge that site admins are usually not very happy about this! I put in a few seconds of random delay between downloads, sometimes even minutes, to be nicer to the server, but still.
|
| |
iAN CooG
Registered: May 2002
Posts: 3137 |
I have noticed that csdb already has a multiple download prevention check, 2 downloads don't start from the same ip, the 2nd download starts only when the 1st is almost finished. |
| |
Earthshaker
Registered: Sep 2002
Posts: 118 |
Quote: strangely enough, I batch-download every day from here and other c64 sites without any problem with both down them all and flashget =)
*download.php* is the key ;)
How exactly does this work? Everytime i try to do this i get a "you are creating a huge load" warning. I tried DTA and have set it to only do 1 file at a time. I eventually would like to download all the releases here, but without creating problems for the site. |
| |
chatGPZ
Registered: Dec 2001
Posts: 11146 |
set a proper delay between requests, like a couple seconds or so |
| |
AlexC
Registered: Jan 2008
Posts: 293 |
Why not provide periodically a dump of whole release database? This may be later distributed as Torrents or uploaded to AWS servers for example.
Just my 2 cents... |
| Previous - 1 | 2 | 3 | 4 | 5 | 6 - Next |
