vgmrips

The forum about vgm files
It is currently 2020-09-25, 22:50:05

All times are UTC + 1 hour [ DST ]




Post new topic Reply to topic  [ 12 posts ] 
Author Message
 Post subject: A better rating system?
PostPosted: 2016-07-19, 0:22:33 
Offline

Joined: 2016-02-22, 20:26:34
Posts: 7
I find that the way ratings work are a bit odd... Judging from the "Top rated packs" list, it seems that the prioritized packs are the ones that have five star ratings, whether it be 3 five star votes or just 1 vote. So if a pack has 3 votes that are all five star, but then get one four start vote, the pack will be put lower than ALL the five star votes, even the ones with just one vote...
It just doesn't seem to make much sense to me, shouldn't the ratings have a combined score instead? Like, a pack with only one five star vote = 5 points, while a pack with three five star votes + one four star vote = 19 points?
Maybe this is known, and is something that can't be fixed now, but I thought I could at least ask about it. Thanks for your time.


Top
 Profile  
 
 Post subject:
PostPosted: 2016-07-19, 0:28:48 

Contributors Contributors
Offline
User avatar

Joined: 2015-08-30, 14:24:00
Posts: 73
Location: Scotland
I agree with you; the rating system indeed is flawed. I recall vampi once saying on IRC that he was going to fix the issue, though I'm not sure when the changes will occur.

_________________
I'm HarmoDevil. Formerly Dr Devil, but I still use the drdevil username here.

Check out my Soundcloud.

I might get back to VGM ripping someday.


Top
 Profile  
 
 Post subject:
PostPosted: 2016-07-19, 8:47:40 

Contributors Contributors
Staff Staff
Reverse engineers Reverse engineers
Offline
User avatar

Joined: 2013-07-17, 23:32:39
Posts: 438
There has been talk earlier about the ratings. The main problem is that we don't have enough votes on all packs to establish a 'stable' average rank on each pack. If we were to hide ratings for packs that don't have enough votes (10 votes minimum maybe?), then we would not only have more accurate ranking, but we might also create an incentive to vote on packs, but on the other hand we would have few complete ratings as most packs currently have 0-5 votes...


Top
 Profile  
 
 Post subject:
PostPosted: 2016-07-19, 10:47:03 

Contributors Contributors
Offline
User avatar

Joined: 2012-01-03, 2:10:28
Posts: 281
"Five-star" rating of think the outdated, I think it is better to "Like button".
Personally, Negatively Ratings is not needed. (Because the music is there are likes and dislikes)


Top
 Profile  
 
 Post subject:
PostPosted: 2016-07-19, 12:24:11 

Staff Staff
Programmers Programmers
Contributors Contributors
Ball Fondlers Ball Fondlers
Offline
User avatar

Joined: 2014-01-28, 5:51:54
Posts: 714
We could order by a weighted rating, which takes into account the number of good ratings. It would be slightly more organic than the current sorting system.

I have something like this:

Image

_________________
vampi.tech


Top
 Profile  
 
 Post subject:
PostPosted: 2016-07-19, 13:23:33 

Staff Staff
Programmers Programmers
Contributors Contributors
Ball Fondlers Ball Fondlers
Offline
User avatar

Joined: 2014-01-28, 5:51:54
Posts: 714
We can also fiddle with the weights:

Image

_________________
vampi.tech


Top
 Profile  
 
 Post subject:
PostPosted: 2016-07-19, 14:46:25 

Contributors Contributors
Bug catchers Bug catchers
Offline
User avatar

Joined: 2011-12-28, 19:52:40
Posts: 206
Location: Paris, France
The "scoreboard" really should exclude any pack with less than five voters, simple as that. In my opinion five is a good start, 10 votes is too much because I don't think a single pack gathered that many ratings, but on the other hand with the current system any soundtrack with just one 5-star rating can claim the top position, which is silly.

_________________

Sega PCM [1985/1989] | Namco C140 [1987/1990] | Hudson HuC6280 [1987/1995] | Yamaha YM2608 [1988/1996] | Oki MSM6295 [1988/1998]


Top
 Profile  
 
 Post subject:
PostPosted: 2016-07-19, 15:53:17 

Staff Staff
Programmers Programmers
Contributors Contributors
Ball Fondlers Ball Fondlers
Offline
User avatar

Joined: 2014-01-28, 5:51:54
Posts: 714
Kaminari wrote:
The "scoreboard" really should exclude any pack with less than five voters, simple as that. In my opinion five is a good start, 10 votes is too much because I don't think a single pack gathered that many ratings, but on the other hand with the current system any soundtrack with just one 5-star rating can claim the top position, which is silly.


What are you talking about? There are two places where there is rating-based sorting - on the front page, "Top rated packs", and the top rated packs listing. They are currently sorted by average rating and number of ratings. So the top pack has the most 5 star ratings. It is impossible for a pack with one 5-star rating to get to the top, because there are packs with more 5-star ratings above it.

There is another section on the front page "Latest high rated" which simply shows the packs that were recently rated 5 stars by any user.

I believe the weighted sorting system that I proposed will fix things well enough.

_________________
vampi.tech


Top
 Profile  
 
 Post subject:
PostPosted: 2016-07-19, 23:25:25 

Contributors Contributors
Bug catchers Bug catchers
Offline
User avatar

Joined: 2011-12-28, 19:52:40
Posts: 206
Location: Paris, France
"Scoreboard" = "Top listing"

Quote:
It is impossible for a pack with one 5-star rating to get to the top, because there are packs with more 5-star ratings above it.


It was an example. And technically, yes it was perfectly possible for a pack with one 5-star rating to get on top if all other packs above it had a global score of less than 5, which was precisely the problem discussed in this topic. I see you've modified the system and it behaves much better now, although there's still the odd case (like Ridge Racer, which has eight 5-star ratings, but is stuck at the fifth position).

_________________

Sega PCM [1985/1989] | Namco C140 [1987/1990] | Hudson HuC6280 [1987/1995] | Yamaha YM2608 [1988/1996] | Oki MSM6295 [1988/1998]


Top
 Profile  
 
 Post subject:
PostPosted: 2016-07-20, 10:46:45 

Staff Staff
Programmers Programmers
Contributors Contributors
Ball Fondlers Ball Fondlers
Offline
User avatar

Joined: 2014-01-28, 5:51:54
Posts: 714
I guess we can tweak it later on.

_________________
vampi.tech


Top
 Profile  
 
 Post subject:
PostPosted: 2016-07-20, 10:57:05 

Staff Staff
Programmers Programmers
Contributors Contributors
Ball Fondlers Ball Fondlers
Offline
User avatar

Joined: 2014-01-28, 5:51:54
Posts: 714
I have done more testing, it works fine now.

_________________
vampi.tech


Top
 Profile  
 
 Post subject:
PostPosted: 2016-07-20, 13:12:49 
Offline

Joined: 2016-02-22, 20:26:34
Posts: 7
Yeah, this looks a lot better right now, thanks!


Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 12 posts ] 

All times are UTC + 1 hour [ DST ]


Who is online

Users browsing this forum: No registered users and 2 guests


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
cron
Powered by phpBB® Forum Software © phpBB Group
[ Time : 0.274s | 19 Queries | GZIP : On ]