Log inRegister an accountBrowse CSDbHelp & documentationFacts & StatisticsThe forumsAvailable RSS-feeds on CSDbSupport CSDb Commodore 64 Scene Database
 Welcome to our latest new user santa ! (Registered 2020-05-31) You are not logged in 
CSDb User Forums


Forums > CSDb Discussions > Loader Benchmarks
2020-05-04 13:51
Sparta

Registered: Feb 2017
Posts: 21
Loader Benchmarks

I do not intend to stir up the mud, but it’s been 5 years since the performance of commonly used fast loaders was last compared in this thread. Since then, Lft has updated Spindle, Krill has practically rewritten his loader, HCL has released ByteBoozer 2.0, Bitfire is past version 0.6, and I have released Sparkle (AKA “Chinese clone” :D, apologies to the Chinese sceners). I have been running tests for my own entertainment and figured I’d update Bitbreaker’s benchmark with the latest loader versions using his test files.

The graph below compares the following loader+packer combinations: Sparkle V1.4 and Spindle 2.3 using their own packers, Krill’s loader v184 with TinyCrunch 1.2 (TC), Bitnax (BN), and ByteBoozer 2.0 (B2), BoozeLoader 1.0 with ByteBoozer 2.0, and Bitfire 0.6+ downloaded from GitHub on April 9, 2020 with Bitnax. The sole purpose of this benchmark was to examine how fast these loaders can load and decompress 728 blocks of data in 18 files under different CPU loads (i.e. it does not test disk zones separately). I spent quite some time optimizing each loader’s performance as much as I could with preliminary trial runs in VICE with warp mode to find the best parameters. Thus, Spindle disks were built with the fast serial transfer protocol and in the case of Sparkle, Krill’s loader, Bitfire, and BoozeLoader, a custom interleave was implemented. Finally, the disk drive’s motor was left running during the tests with BoozeLoader and Bitfire. For each test I used the interleave that proved to be the fastest in the preliminary runs. All tests were performed the same way: the executable installs the loader and loads a small program from track 1, sector 0 (this way, seek time to track 1 is not included in the test) with a raster IRQ routine that blocks 0%, 25%, 50%, or 75% of the screen while loading and depacking. None of the files are loaded under the I/O area. Sparkle packed the files from 728 blocks to 442 (60.7%), Spindle to 456 (62.6%), TinyCrunch to 447 (61.4%), ByteBoozer and Bitnax to 390 blocks (53.6%). D64 images were transferred to the same floppy using Luigi Di Fraia’s IECHost connected to a 1571 disk drive. Each column in the graph represents the average ± 2SD of 10 consecutive tests on my C64C PAL + 1541-II disk drive combo (except for Krill+ByteBoozer in which case for some reason the test crushed 3 times requiring additional runs).



Interleaves (note: the files only occupy the first two speed zones on the disk):
Loader		0%		25%		50%		75%
Sparkle		4-4-4-4		5-4-4-4		7-4-4-4		7-4-4-4
Spindle		default		default		default		default
Krill		4-4-4-4		5-4-4-4		7-7-7-7		11-10-10-10
Bitfire		5-5-5-5		6-6-6-6		9-9-9-9		6-6-6-6
BoozeLoader	4-4-4-4		5-5-5-5		7-7-7-7		11-11-11-11

Feel free to interpret the data the way you want. Obviously, the authors of the other loaders and packers are way out of my hobby coder league, so I will not attempt to draw conclusions or pretend to have answers. But if anyone is interested, I’d be happy to share my test disk images and spreadsheets. Also, let me know if you want to see any other loader’s performance in the benchmark.

Finally, I am sure many of us do similar tests, so please feel free to post you own benchmarks with some description here.

Cheers, stay healthy and safe,
Sparta/OMG
 
... 12 posts hidden. Click here to view all posts....
 
2020-05-05 01:10
Krill

Registered: Apr 2002
Posts: 1440
Oh, and the same drive should be used both for writing the disks and running the tests.
2020-05-05 08:58
HCL

Registered: Feb 2003
Posts: 692
I don't like representing the brown column in those graphs, it's not my preferred choice of color and does not reflect to Booze Design in general. .. ;)
2020-05-05 10:01
Oswald

Registered: Apr 2002
Posts: 4569
nice to see the competetiveness still in you guys :D
2020-05-05 10:58
Krill

Registered: Apr 2002
Posts: 1440
Quoting HCL
I don't like representing the brown column in those graphs, it's not my preferred choice of color and does not reflect to Booze Design in general. .. ;)
Which of the 16 shades of brown we have on display is your preferred choice, then? :)
2020-05-05 18:05
Sparta

Registered: Feb 2017
Posts: 21
Quoting HCL
I don't like representing the brown column in those graphs, it's not my preferred choice of color and does not reflect to Booze Design in general. .. ;)

OK HCL, tell me the color of your Booze and I will... Never mind. ;)
2020-05-07 10:29
HCL

Registered: Feb 2003
Posts: 692
Despite the brown.. It would be kinda interesting to see the compression ratio in this comparison. I guess the three to the left are all using crippled compression due to tiny search window, or?
2020-05-07 11:06
Krill

Registered: Apr 2002
Posts: 1440
Quoting HCL
Despite the brown.. It would be kinda interesting to see the compression ratio in this comparison. I guess the three to the left are all using crippled compression due to tiny search window, or?
OP did mention the compression ratios for this particular corpus.

And for tinycrunch, look here: https://codebase64.org/doku.php?id=base:compression_benchmarks - it's in the 60% compressed size cluster, while ByteBoozer 2 is in the 45-ish% cluster.

But for demos, compression ratio doesn't matter so much as overall throughput. Disk images are cheap. :D
2020-05-07 11:21
Frantic

Registered: Mar 2003
Posts: 1413
Flipping disk( image)s when watching demos is hard work though.
2020-05-07 13:18
tlr

Registered: Sep 2003
Posts: 1289
Quote: Flipping disk( image)s when watching demos is hard work though.

Not compared to serial party copying using 15 Seconds Copy 35 Tracks V2.36 after being awake 48 hours. ;)
2020-05-08 12:26
Danzig

Registered: Jun 2002
Posts: 400
Quote: Not compared to serial party copying using 15 Seconds Copy 35 Tracks V2.36 after being awake 48 hours. ;)

Avantgarde houseparty 1995: Robocop and Jack Alien copying box after box after box... 25y ago already...
Previous - 1 | 2 | 3 - Next
RefreshSubscribe to this thread:

You need to be logged in to post in the forum.

Search the forum:
Search   for   in  
All times are CET.
Search CSDb
Advanced
Users Online
AlexC
psych858o/MSL/Elysiu..
Logiker/VCC
Thundax
Frantic/Hack'n'Trade
Zirias/Excess
Guests online: 101
Top Demos
1 Coma Light 13  (9.7)
2 Edge of Disgrace  (9.7)
3 Comaland 100%  (9.7)
4 Uncensored  (9.7)
5 Unboxed  (9.6)
6 The Shores of Reflec..  (9.6)
7 Remains  (9.6)
8 NGC 1277 100%  (9.5)
9 Lunatico  (9.5)
10 C=Bit 18  (9.5)
Top onefile Demos
1 Dawnfall V1.1  (9.6)
2 Crystal Gazer  (9.6)
3 The Tuneful Eight [u..  (9.5)
4 Smile to the Sky  (9.5)
5 Instinct  (9.5)
6 Rewind  (9.5)
7 Bad Boy  (9.5)
8 Daah, Those Acid Pil..  (9.5)
9 Gumbo Revised  (9.4)
10 Tribute to Ben - Las..  (9.4)
Top Groups
1 PriorArt  (9.6)
2 Oxyron  (9.4)
3 Booze Design  (9.4)
4 Censor Design  (9.4)
5 Performers  (9.4)
Top Coders
1 Bjørn Røstøen  (10)
2 ZeroPaige  (9.9)
3 Axis  (9.8)
4 Sparta  (9.8)
5 Graham  (9.8)

Home - Disclaimer
Copyright © No Name 2001-2020
Page generated in: 0.059 sec.