Log inRegister an accountBrowse CSDbHelp & documentationFacts & StatisticsThe forumsAvailable RSS-feeds on CSDbSupport CSDb Commodore 64 Scene Database
You are not logged in - nap
CSDb User Forums


Forums > CSDb Discussions > Anyone producing "updates" from CSDB?
2014-04-30 01:35
Style

Registered: Jun 2004
Posts: 498
Anyone producing "updates" from CSDB?

Hey all

I have a problem looking for a solution - like many others, I have an 1541U with games and demos (mainly from gamebase and some demo collections I forget) but I have no way of keeping it updated.

Is anyone producing an "offical" CSDB image in some way, if only for demos? Would be really nice maybe to have a read-only SVN server backed onto the CSDB database or similar so we can all resync every now and then?

I could rape the CSDB front end, but Im sure itd violate some user policy somewhere and it's a nasty thing to do.

Thanks!
 
... 11 posts hidden. Click here to view all posts....
 
2014-06-05 12:36
Mr. SID

Registered: Jan 2003
Posts: 424
Why is that problematic? What would you expect the XML output to look like for that release?
2014-06-05 15:27
chatGPZ

Registered: Dec 2001
Posts: 11350
Quote:
There might be reasons against my suggestion

how much time are you willing to spend on a regular basis into making it happen ? :=P
2014-06-05 22:41
Feltzkrone

Registered: Oct 2013
Posts: 4
@Mr. SID: "&amp;lt;--&amp;gt;" should be "&lt;--&gt;". Apparently here first the < and > and characters have been translated to the &lt; and &gt; entities. What's wrong is that there is a subsequent translation of the & characters to &amp; - it's valid XML but it's wrong data.

@Groepaz: If it's possible to run Java code on the server (or even a Tomcat webserver / servlet container) I'm happy to offer my help by providing SOAP webservice(s) which queries the database and provides results in flawless XML using a well defined interface and message contract. Querying data release by release and playing with the depth levels isn't exactly performant if somebody wants data for all releases. Here a webservice which allows querying multiple releases or a database dump would come in more handy and efficient while being gentle regarding server resources.

And I could also provide tools which create database table snapshots and even provide the delta between two snapshots (although I don't think that it's necessary with a database which takes a tiny fraction of the size a Discogs snapshot is). Both are things which I'm dealing regularly with at work since years. For example a db table made up of customer ID, product ID, sales, proceeds, amount for example is processed at about 200,000 records per second on my workstation computer. Nowadays Java isn't exactly slow anymore. ;)

PHP is not my cup of tea by the way, here are some reasons (not written by me but I share the author's opinion in many cases): http://eev.ee/blog/2012/04/09/php-a-fractal-of-bad-design/

:P
2014-06-06 20:09
Perplex

Registered: Feb 2009
Posts: 255
Well, SOAP isn't exactly a shining example of great, modern webservice design either. ;-)
2014-06-06 22:46
Feltzkrone

Registered: Oct 2013
Posts: 4
But at least it's standardized. :) What would you recommend instead?
2014-06-07 08:21
Perplex

Registered: Feb 2009
Posts: 255
Some RESTful interface using HTTP GET with response status and headers for metadata and the body reserved for the actual payload serialized as JSON would be nice.
2014-06-07 11:27
Merman

Registered: Dec 2002
Posts: 140
What about a monthly update by torrent?
2014-06-07 20:30
Feltzkrone

Registered: Oct 2013
Posts: 4
In my opinion all the info stored in the DB is at least as valuable as the files themselves (thanks to the work done by so many people), having all the files alone would be nice but it's a rather incomplete "backup" then.

SOAP or RESTful: Not much experience with REST but I'm sure this wouldn't be a problem... so why not offer both? :)

I hope that Perff will sooner or later post a reply. Provided he would trust me and give me a backup of the DB (or a datawise stripped-down-version) plus the server architecture would allow for Java then most of the work could be done without taking up too much of his time. Of course the DBMS would have to be accessible using JDBC.
2014-06-08 08:38
TDJ

Registered: Dec 2001
Posts: 1879
Considering SOAP vs. REST; both have its merits, but in this particular case I would recommend the latter, as its hypermedia aspect fits the structure of csdb perfectly. Also, end-to-end security and reliable messaging are not really a factor.
2014-06-10 22:16
bepp

Registered: Jun 2010
Posts: 265
+1 for REST
Previous - 1 | 2 | 3 - Next
RefreshSubscribe to this thread:

You need to be logged in to post in the forum.

Search the forum:
Search   for   in  
All times are CET.
Search CSDb
Advanced
Users Online
wil
Gregfeel/Lepsi De, S..
Retroluzzer/Quantum
Jason/Antic
Youth
Guests online: 124
Top Demos
1 Next Level  (9.7)
2 13:37  (9.7)
3 Coma Light 13  (9.7)
4 Edge of Disgrace  (9.6)
5 Mojo  (9.6)
6 Uncensored  (9.6)
7 Wonderland XIV  (9.6)
8 Comaland 100%  (9.6)
9 Fishbomb  (9.6)
10 No Bounds  (9.6)
Top onefile Demos
1 Layers  (9.6)
2 Party Elk 2  (9.6)
3 Cubic Dream  (9.6)
4 Copper Booze  (9.6)
5 Libertongo  (9.5)
6 Rainbow Connection  (9.5)
7 Onscreen 5k  (9.5)
8 Morph  (9.5)
9 Dawnfall V1.1  (9.5)
10 It's More Fun to Com..  (9.5)
Top Groups
1 Performers  (9.3)
2 Booze Design  (9.3)
3 Oxyron  (9.3)
4 Nostalgia  (9.3)
5 Censor Design  (9.3)
Top Coders
1 Axis  (9.8)
2 Graham  (9.8)
3 Crossbow  (9.8)
4 Lft  (9.8)
5 HCL  (9.8)

Home - Disclaimer
Copyright © No Name 2001-2024
Page generated in: 0.066 sec.