3
$\begingroup$

I have noted that the vote mechanism assign the same score for one vote up/down independently by the user score. In my opinion this is not fairly as high scored users has a deeper understanding of the subject discussed. I think that a better way would be assign a score by this formula

vote up/down = +/- int(log(user score))

what do you think?

$\endgroup$
4
  • 7
    $\begingroup$ Re: "as high scored users has a deeper understanding of the subject discussed" - that certainly isn't true. If Brad Efron joined our site tomorrow, his reputation would be '1'. Does that mean you or I have a deeper understanding of the bootstrap than he does? $\endgroup$
    – Macro
    Commented Jul 3, 2012 at 12:22
  • $\begingroup$ yes i know, but this is a temporary situation. In the long time my statement is true. Is the same problem of entry level elo ranking in chess. $\endgroup$
    – emanuele
    Commented Jul 3, 2012 at 12:25
  • 4
    $\begingroup$ ELO is based on a model of competition. It is difficult to see how that could be adapted to voting or a collaborative reputation system, which is what this site is based on. $\endgroup$
    – whuber Mod
    Commented Jul 3, 2012 at 13:13
  • 1
    $\begingroup$ Yes you right, indeed i am talking about the entry level ranking problem. I am not saying that Elo ranking would be a better method to rank the vote. $\endgroup$
    – emanuele
    Commented Jul 3, 2012 at 14:23

3 Answers 3

18
$\begingroup$

The proposal is intuitive and appealing. It appears predicated, though, on the implicit assumption that high-rep people provide better information than low-rep people about the quality of questions and answers. This appears derived from equating reputation with knowledge, capability, or capacity for judgment. That equation is debatable.

(On our site there are users with enough reputation through sheer activity alone to have earned tag badges in subjects where they are not very knowledgeable. I will, with some diffidence, hold myself out as example number one: purely because many questions are tagged with , I earned a tag badge for before knowing enough about that software to even offer an R-based answer to any question! On the face of it, then, my votes on R-tagged questions and answers ought to count less, not more, than those of experienced R programmers.)

A deeper concern I have is that differential voting power could create an insular clique of high-rep people who effectively control the scores of questions and answers. I worry that this could narrow the site to reflect only the interests of its most active users.

When proposing significant changes to how this site works, we should always ask ourselves, what higher purpose would the change achieve? In this case, would we attract or retain more users? Probably not. Attract high-quality users? On the contrary, such people might be put off by having relatively little influence despite attaining demonstrably high levels of expertise. Improve the ratings of questions and answers? Perhaps--although that depends on assuming reputation (which measures activity) reflects the capacity to judge quality, as I discussed in the opening paragraph.

An interesting way to pursue the original idea would be to implement an alternative reputation/score measure in parallel with the existing one. At first this could be done invisibly and experimentally (by making the measure visible only to a few experimenters). If at some point evidence arose that the alternative were beneficial, then the alternative scores could be displayed to the world.

$\endgroup$
1
  • 6
    $\begingroup$ +1 For "I worry that this could narrow the site to reflect only the interests of its most active users". $\endgroup$
    – user10525
    Commented Jul 3, 2012 at 16:02
1
$\begingroup$

It is natural to apply such a weighting and I like the idea, but consider the challenge that the reputation a user has earned is bound to the tags of the answered questions. This can be included into the score model by setting the weight of a user vote to 0 if no reputation has been earned in this tag and normalization per tag otherwise, but what shall be done in case of rare tags ?

What shall be done if a question has multiple tags and the user has not earned (enough) reputation in all of these ?

In summary, such a change, although appealing and certainly more correct, might introduce more problems than it does solve (occam's razor).

Another solution could be to drive more responsible users to this site. If every question get the attention it deserves it is not necessary anymore to apply weighting to improve the meaning of answers with a small number of votes.

$\endgroup$
3
  • $\begingroup$ I am not sure that this is a true problem. Indeed reputation is a sort average over the tags score. Another solution may a wider ladder on voting system. eg: very bad, bad, neutral, good, very good $\endgroup$
    – emanuele
    Commented Jul 3, 2012 at 14:25
  • 6
    $\begingroup$ "although appealing and certainly more correct" - the bolded part just isn't true. This is putting complete faith in numerical reputation. See meta.stats.stackexchange.com/questions/1218/… - for a discussion of how numerical reputation is not always a great measure of quality. If all you want to do is get a ton of points, that's not so difficult. Just answer as many questions as possible. As long as your answers aren't complete nonsense, you will have lots of rep in no time, even if you receive more downvotes than upvotes. $\endgroup$
    – Macro
    Commented Jul 3, 2012 at 14:50
  • $\begingroup$ thanks @Macro for the comment. I see the point. However, any system which relies solely on the numerical rep points has this problem, may it be the current one or the suggestion of the OP. My point was to make it less broken by extension (as gung suggests in the linked question). Thanks again for the comment. $\endgroup$
    – steffen
    Commented Jul 3, 2012 at 21:17
1
$\begingroup$

While it is an interesting suggestion (with which I have some misgivings), I think this is a solution in search of a problem that isn't there. One thing that is worth bearing in mind here is that there is already a species of de facto weighting, from the empirical fact that users with higher reputation use the site more often/consistently and therefore cast more votes. For example, at the time of writing this post, our highest reputation user is listed as having cast 32,216 votes on CV.SE and another 1,433 votes on CV.SE.meta. (Using the simplifying assumption of 10 points per vote, that is 336,490 score contributed by that user.)

Consequently, while an individual vote from a high reputation user is treated as giving the same score as an individual vote from a low reputation user, high reputation users have generally contributed far more score to questions/answers merely from higher numbers of votes cast, which follows from their generally higher level of participation on the site.

$\endgroup$

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .