Log inRegister an accountBrowse CSDbHelp & documentationFacts & StatisticsThe forumsAvailable RSS-feeds on CSDbSupport CSDb Commodore 64 Scene Database
You are not logged in - nap
CSDb User Forums


Forums > CSDb Questions > Bulk download?
2009-03-28 15:24
Wonder-Boy
Account closed

Registered: Apr 2007
Posts: 3
Bulk download?

Hi, is there a way to download a number of releases at the same time? Downloading every release individually can be a bit of a chore. I would like to be able to download for instance "all C64 demos from 2007" in one go.
 
... 41 posts hidden. Click here to view all posts....
 
2009-03-29 15:02
iAN CooG

Registered: May 2002
Posts: 3128
I have noticed that csdb already has a multiple download prevention check, 2 downloads don't start from the same ip, the 2nd download starts only when the 1st is almost finished.
2016-03-01 09:30
Earthshaker

Registered: Sep 2002
Posts: 118
Quote: strangely enough, I batch-download every day from here and other c64 sites without any problem with both down them all and flashget =)
*download.php* is the key ;)


How exactly does this work? Everytime i try to do this i get a "you are creating a huge load" warning. I tried DTA and have set it to only do 1 file at a time. I eventually would like to download all the releases here, but without creating problems for the site.
2016-03-01 16:21
chatGPZ

Registered: Dec 2001
Posts: 11088
set a proper delay between requests, like a couple seconds or so
2016-03-01 22:20
AlexC

Registered: Jan 2008
Posts: 293
Why not provide periodically a dump of whole release database? This may be later distributed as Torrents or uploaded to AWS servers for example.

Just my 2 cents...
2016-03-01 22:28
hedning

Registered: Mar 2009
Posts: 4550
CSDb is already available as bulk, with weekly updates. I am not sure the collection is available publically yet, though. I like the idea to have the database mirrored and available for bulk download elsewhere.
2016-03-02 01:55
Thierry

Registered: Oct 2009
Posts: 47
Quote: CSDb is already available as bulk, with weekly updates. I am not sure the collection is available publically yet, though. I like the idea to have the database mirrored and available for bulk download elsewhere.

+1 !!
2016-03-02 16:06
Earthshaker

Registered: Sep 2002
Posts: 118
Quote: +1 !!

+1
2016-03-02 16:22
Smasher

Registered: Feb 2003
Posts: 510
wtf is this lame "+1" mania? can't we change that in a better proper nerd syntax? like "INX" or "ADC#$01" ? :)
2016-03-02 18:04
chatGPZ

Registered: Dec 2001
Posts: 11088
first sane post in this thread :)
2016-03-02 18:06
Moloch

Registered: Jan 2002
Posts: 2884
/me clicks the Like button
Previous - 1 | 2 | 3 | 4 | 5 | 6 - Next
RefreshSubscribe to this thread:

You need to be logged in to post in the forum.

Search the forum:
Search   for   in  
All times are CET.
Search CSDb
Advanced
Users Online
ϵʟʞ/ₐтₐ
Low Spirit
Inge/HVSC
McMeatLoaf
bugjam
TMA/Abyss-Connection
Laurikka
Krill/Plush
Holy Moses/Role
celticdesign/G★P/M..
t0m3000/ibex-crew
Shogoon/Elysium/MSL
Yugorin/Samar Produc..
Guests online: 323
Top Demos
1 Next Level  (9.8)
2 Mojo  (9.7)
3 Coma Light 13  (9.7)
4 Edge of Disgrace  (9.6)
5 No Bounds  (9.6)
6 Comaland 100%  (9.6)
7 Uncensored  (9.6)
8 The Ghost  (9.6)
9 Wonderland XIV  (9.6)
10 Bromance  (9.6)
Top onefile Demos
1 Party Elk 2  (9.7)
2 Cubic Dream  (9.6)
3 Copper Booze  (9.5)
4 Rainbow Connection  (9.5)
5 TRSAC, Gabber & Pebe..  (9.5)
6 Onscreen 5k  (9.5)
7 Dawnfall V1.1  (9.5)
8 Quadrants  (9.5)
9 Daah, Those Acid Pil..  (9.5)
10 Birth of a Flower  (9.5)
Top Groups
1 Booze Design  (9.3)
2 Nostalgia  (9.3)
3 Oxyron  (9.3)
4 Censor Design  (9.3)
5 Crest  (9.3)
Top Swappers
1 Derbyshire Ram  (10)
2 Jerry  (9.8)
3 Violator  (9.8)
4 Acidchild  (9.7)
5 Starlight  (9.6)

Home - Disclaimer
Copyright © No Name 2001-2024
Page generated in: 0.05 sec.