| |
Nafcom
Registered: Apr 2002
Posts: 588 |
Implement http://ftp.pokefinder.org/ into CSDb
Implement http://ftp.pokefinder.org/ into CSDb for alternative download link search!
Opinions? |
|
... 74 posts hidden. Click here to view all posts....
|
| |
Nafcom
Registered: Apr 2002
Posts: 588 |
Quote: Probably old. :)
When the upload file feature was first made, the files was uploaded to an external ftp-site to spare space on the server CSDb runs on. That however often went offline for long periods of time, so I found out that it was ok to use a bit more space on the same server as CSDb runs on, where the files are now stored. That makes it a bit easier to make a backup. :)
Another reason to encourage people to upload the files instead of only linking to external sources! |
| |
Seven
Registered: Jan 2002
Posts: 202 |
Quote: Another reason to encourage people to upload the files instead of only linking to external sources!
Why is that a reason to upload files to CSDb?
The only thing that show is that, if you want an FTP server to host the files, choose a reliable one.
You don't get it, do you? Doing a backup of an FTP site is the easiest you can get.. provided you have an FTP client and don't try downloading file by file with your Internet Exploder. And that way _anybody_ can make a backup, and not just Perff.
Why do I sometimes get the feeling that I'm talking to walls in here... 8r
|
| |
Nafcom
Registered: Apr 2002
Posts: 588 |
Quote: Why is that a reason to upload files to CSDb?
The only thing that show is that, if you want an FTP server to host the files, choose a reliable one.
You don't get it, do you? Doing a backup of an FTP site is the easiest you can get.. provided you have an FTP client and don't try downloading file by file with your Internet Exploder. And that way _anybody_ can make a backup, and not just Perff.
Why do I sometimes get the feeling that I'm talking to walls in here... 8r
I have a DVD full with backups of FTP servers, just for your information =)
But not everybody has backups of all FTPs and often there are also linked to other sources than FTPs, e.g. http sources. Often they change (perfect example OOO releases) and then they are lost, while files uploaded to CSDb never will be lost because:
a) They are now stored on CSDb server, no longer on another external server.
b) Perff has updates of all such hosted files!
--
I want to thank at this moment, to all the sceners that send me PMs and coorperate to get sources for releases added to CSDb.
I try to reply to all in a timely manner.
Other than that, feel free to email me if you need to send files. |
| |
chatGPZ
Registered: Dec 2001
Posts: 11384 |
the point is that file should be stored decentralized and redundant. if everything is at one place there is a good chance that at one point everything will get lost at once.
and ofcourse, downloading stuff from csdb is painful, while downloading from ftp is fast and easy. |
| |
Nafcom
Registered: Apr 2002
Posts: 588 |
Quote: the point is that file should be stored decentralized and redundant. if everything is at one place there is a good chance that at one point everything will get lost at once.
and ofcourse, downloading stuff from csdb is painful, while downloading from ftp is fast and easy.
painful? It's only a few KBs per release and even if CSDb is in its very slow times, downloads anyway take only seconds because of small file sizes.
You must have been sarcastic here! :D
Apart from that, thanks for agreeing on the redundancy point! :) |
| |
cba
Registered: Apr 2002
Posts: 935 |
Quote: painful? It's only a few KBs per release and even if CSDb is in its very slow times, downloads anyway take only seconds because of small file sizes.
You must have been sarcastic here! :D
Apart from that, thanks for agreeing on the redundancy point! :)
He means that downloading for example every demo from
Crest is very slow here !, doing it from a FTP server is
just way easier.
Niels |
| |
Seven
Registered: Jan 2002
Posts: 202 |
@nafcom:
So files uploaded to CSDb will never get lost, because there's one person in the world who has a backup.
If you have the time, please come up with an explanation how that is safe and redundant.
... or better yet, next time think before you post. I'm still waiting for even a vague hint that you actually understood what we're talking about. |
| |
TDJ
Registered: Dec 2001
Posts: 1879 |
Quote: he.
I already did that - removing non alphnumeric characters if you havn't noticed. (Perhaps not all of them - had a small problem making a simple php-routine that removes all non alphanumeric chars, but not special letters like æøåôêá and what different contries have thought up. Anyone got a 100% idiot-proff thing to do that?)
I could just see where it was going. Removing simple chars is one thing. Next search for special abrivations and remove them or convert them. Also look for other words like preview, fix etc. and do stuff to them too. The next post would probably have sounded a bit like "Make a routine that understands the meaning of the title, and make a smart search from that understanding." ;)
.. or perhaps it's just me who is lazy.. hmm.. :):)
The funny thing is: you're describing one of the biggest problems at the project I'm currently working on (not for c64, but for my jon). I work at a directory service (biggest one in Holland, actually we're related to TDC which should be known to Scandinavian people as well), and there it's very important to somehow transform the user input into a query which will give just the right type of results. For that we use many different techniques, like synonyms, stopwords but also fuzzy search logic etcetera. Some of this we do ourself, for other parts of this system we use the expertise of an American partner.
So based on experience I can tell you: you've got your work cut out for you ;) The bright side is ofcourse that your quest is a lot easier than ours :) |
| |
Nafcom
Registered: Apr 2002
Posts: 588 |
Quote: @nafcom:
So files uploaded to CSDb will never get lost, because there's one person in the world who has a backup.
If you have the time, please come up with an explanation how that is safe and redundant.
... or better yet, next time think before you post. I'm still waiting for even a vague hint that you actually understood what we're talking about.
I don't see a reason why not to trust Perff here |
| |
tlr
Registered: Sep 2003
Posts: 1790 |
Quote: Why is that a reason to upload files to CSDb?
The only thing that show is that, if you want an FTP server to host the files, choose a reliable one.
You don't get it, do you? Doing a backup of an FTP site is the easiest you can get.. provided you have an FTP client and don't try downloading file by file with your Internet Exploder. And that way _anybody_ can make a backup, and not just Perff.
Why do I sometimes get the feeling that I'm talking to walls in here... 8r
@seven: I agree with your point. It would be great to have external backups.
Something might, god forbid, happen to the backups that Perff keeps for instance...
What I don't agree with is how it should be done.
I would find it a bit tedious (and probably others with me) to upload the files to one place (several), then add the entries to another, and add a link to the first. The result would probably be exacly what it is today: some upload to the ftp-servers, and some upload here.
What I have suggested in a previous post is a mirror by exporting all files from csdb to multiple ftp-servers.
I would also like to see the full database mirrored (read-only ofcourse). This could be in the form of database dump in a tar-archive, just so the information won't get lost. Somebody could put up a mirror site later.
Obviously there are a lot of conflicting opinions about this, and Perff is the one who has to implement it, so
it's his call. But I think this would solve many of the problems/risks discussed here. |
| Previous - 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 - Next |
