Questions tagged [rating]

"A rating is the evaluation or assessment of something, in terms of quality (as with a critic rating a novel), quantity (as with an athlete being rated by his or her statistics), or some combination of both" (Wikipedia).

The "rating" and "valuation" tags refer to the same concept: "valuation" is the process of assigning numbers, scores, or ranks to options or outcomes to reflect relative preferences or to create a composite score.


Problems that involve the optimization of multiple criteria must make trade-offs between having more of one characteristic and less of another. A "valuation" or "value function" quantifies those trade-offs. Either a valuation is made explicit in order to solve the problem or else it will be implicit in any solution.

Examples include

  • Deciding between a product that has a high average user rating based on only a few reviews and another product with a lower average rating based on many reviews.

  • Determining the worth of players on a team or some group of experts based on multiple skills.

  • Identifying optimal investments based on expected return and volatility.

  • Creating an "index" for a market or other collection of varied objects, especially when they might not be directly comparable.

See Wikipedia at Multiple-criteria decision analysis for a general overview.

146 questions
11
votes
6 answers

Rating system taking account of number of votes

I need an idea for a new rating system.. the problem in the ordinary one (just average votes) is that it does not count how many votes... For example consider these 2 cases: 3 people voted 5/5 500 people voted 4/5 The ordinary voting systems just…
Betamoo
  • 293
7
votes
2 answers

General principles for extending the Elo system to games in which the margin of victory matters

Note I am a first-time user of this site, and am not sure what determines how broad a question is. I consciously limited the question to general principles in order to avoid making it too broad (by asking for examples, etc.). Nevertheless, if it is…
7
votes
3 answers

How would YOU compute IMDB movie rating?

I'm doing this only for learning purposes. I've no intentions of reversing the methods of IMDB. I asked myself I owned IMDB or similar website. How would I compute the movie rating? All I can think of is Arithmetic Mean For a movie data provided…
claws
  • 13,715
5
votes
3 answers

Dissimilarity rating experiment: how to analyze the results

Study: I simulated some surfaces materials at audio and haptic level, and I asked subjects to evaluate on a 9-point Likert scale the degree of coherence between the two stimuli. For example there are stimuli with metal at auditory level and snow at…
L_T
  • 1,713
1
vote
1 answer

Make Score Value to evaluate social popularity (from fb likes count)

I have a list of websites and Facebook likes count for each of them. Count varies from 0 to millions. For each website I want to make up some Score Value from 0 to 10, which would represent sites' social popularity. Any thoughts how to deal with…
1
vote
0 answers

A Rating Formula that Combines Two Metrics

If I have two metrics, - number of reviews and the rating out of 5, and I want to combine them into a single meaningful rating that can rank a list, how can I do that? For example, let's say I have the following: BeachName-#Reviews-Rating Pantai…
Simon
  • 11
1
vote
2 answers

Comparing ratings & statistical difference

I have a dataset where I'm comparing overall ratings between multiple "products." It looks something like this: Product 1: 3.5 Product 2: 4.1 Product 3: 3.7 ... Product 7: 3.3 What I'm doing is comparing Product 1 to all the others and I'd like to…
DD1229
  • 111
1
vote
1 answer

Creating a scoring model when different variables have higher or lower as better

I created a scoring model based on 4 metrics. Currently I have them weighted as such: 50%, 20%, 20% and 10%. After calculating and ranking I realized this may not work. The issue I'm facing is that for metric 1 higher is better and metrics 2-4 lower…
0
votes
2 answers

How to get an "averaged" score?

Assume a game wherein a character's "power" is made up of several factors, like speed, weight, body build, etc. And let's say that each of these factors were scored 0, 1, 2 wherein 0 means average, 1 means slightly above average, and 2 means above…
0
votes
1 answer

How would I calculate value with negative numbers?

I have a dataset of basketball player salaries and an estimation of how many wins they contributed to their teams over the season. So a reasonable thing to do with those numbers would be to divide the wins with their salary to get a number showing…
0
votes
0 answers

Finding an estimate of value from rated examples

Given a sample of items with known monetary values, say 10 cars, and a person rating each car in turn as being more or less valuable than their own, what would be the best way of estimating the value of that person's car? The rating that they choose…
Blob45
  • 11
0
votes
2 answers

Sorting products by reviews considering the number of reviews

I have a big amount of products and a lot of reviews for these products, including a rating of the product. My problem is that every product does not have the same amount of reviews. For example, one product can have 125 reviews with an average…