Enhancements to Ratings and Reviews in Software Center

Registered by Gary Lasker on 2011-05-03

The ratings and reviews feature was introduced in Software Center in 11.04. In this session we'll discuss ideas for enhancing and refining this feature for Oneiric.

Specification: https://wiki.ubuntu.com/SoftwareCenter/RatingsAndReviews

Blueprint information

Status:
Not started
Approver:
Steve Langasek
Priority:
Medium
Drafter:
Michael Vogt
Direction:
Needs approval
Assignee:
Michael Vogt
Definition:
Approved
Series goal:
Accepted for oneiric
Implementation:
Unknown
Milestone target:
None

Whiteboard

WORK ITEMS:
write code that can visualize the distribution of the ratings as a bar chart (eventually needs to run on the server directly), lp:software-center/test/graph/plot-review-spread.py: DONE
support pagination in software-center (for more reviews): DONE
SRU pagination support: DONE
[mpt] design how to present "show more reviews in different languages": DONE
implement displaying reviews in different languages (using LANGUAGE env?): POSTPONED
[mpt] research weighting/ranking for reviews: DONE
default sort by reviews for s-c search to use the above weight (server side): DONE
support reviews for downloaded debs (using a uniqe identifier ĺike sha1 or (pkgname, version): POSTPONED
[mpt] design UI for suggesting review of used but not yet reviewed apps (see also bug #779316): DONE
[mpt] consider changing the stars location from right to left (or under the title) as the icon is on the left but the stars potentially on the very right): DONE
support edit/update a review (for a certain time?): DONE
support deleting my own review: DONE
Check piston-mini-client if it supports transparent gz of the review stats (yes, defalte and gzip): DONE
Provide the ability to easily refresh/update "classic" reviews (those that have garnered high usefulness ratings) when new major versions happen so that such reviews don't get lost due to being pushed late in the list: POSTPONED
Send out call for help for the review moderations team: TODO
[isd] Send out a mail when a review was flagged and include the flag feedback and info to contact rnr-moderators mailing if that is a issue: TODO

------------

[Includes postponed work items from https://blueprints.launchpad.net/ubuntu/+spec/packageselection-foundations-n-ratings-and-reviews-in-software-center]

aaronp, 7/5/2011: linked existing branch with a start on the delete/modify review functionality as well as two bug reports for the server to support delete/modify.

aaronp, 8/5/2011: linked bug # 779316 and added item to Client/Server section above.

== UDS session notes ==

Review rating system:
* Star based rating (1 to 5) => We have many 5 star or 1 star apps, but few ones in the middle
* Like / unlike buttons (like in Youtube)
* Only Like (or similar : +1) (used in Facebook and Google Search)

Youtube ratings changed from "5 star" based to Like/Unlike one.
>> Why:
http://youtube-global.blogspot.com/2009/09/five-stars-dominate-ratings.html
http://www.takadesigns.com/blog/2010/04/20/online-review-ratings-5-stars-or-like-dislike/

Is there any graph for the ratings in the Software Center like this one:
http://goo.gl/sTPS1

== Client/Server ==
 * Support pagination (download/display 20 reviews at a time)
 * Add ability to only display reviews in one's own language
   - Could we (1) show "There are 168 reviews in other languages", and when clicked display paginated results with the one best review from each language. Each result could have a "Show me more reviews in <lang>" (and we could obviously ensure certain languages appeared first).
 * Sort by ratings in list view
 * Search results ranked by ratings
 * Ability to display all reviews by a given reviewer (suggested by bdmurray)
  * Be able to keep track of your "friends", possibly show your friend's favorite apps/latest reviews on the front page (contacts list? empathy friends?)
   * need a server API to get a list of "friends", or just return list of reviews for a given user and get the "friend" from contacts
   * might be better to be able to pick your friends directly rather than use your contact list just because your interests may not match at all
   * reviewers with similar voting patterns will probably give more useful results than friends, if the user has voted enough to have any patterns yet... but friends are a good fallback in case the user hasn't voted. (or while viewing a specific app, it could display a widget for "people who liked this also liked X, Y, Z...") <-- tremolux votes he likes this :)
(^^ how to know if he has like other software if he has rated it by 2 or 3 stars ?)
      * some relevant research on predicting ratings: http://en.wikipedia.org/wiki/Netflix_Prize
* have reviews on debs as well, using a unique identifier (pkgname, version, filename, sha1)
   ^^^ +1 from ToyKeeper +1 from kiwinote
 * Ensure users will actually review apps (once the novelty of the new RnR functionality wears
 off), and not just when they don't like it (see discussion on bug # 779316)
   * possibly have a "My Reviews" page that lists your reviews but also prompts you to consider reviewing other apps that you haven't yet reviewed+1 aaronp
   * show a list of apps you have tried but not reviewed, to remind people to review/rate them?
      ("You have [14 unrated apps]", click in the []'s to go to a UI for rating them)
 * Provide the ability to easily refresh/update "classic" reviews (those that have garnered high usefulness ratings) when new major versions happen so that such reviews don't get lost due to being pushed late in the list
 * make stars more visible, even column sortable like under title or on left (users currently look at icons more)

== Reviews moderation ==
 * Enhancements to the moderation UI
 * Grow the moderations team
  * when a review gets flaged, send the guy who wrote the review a mail with the flag feedback and info to contact rnr-moderatiors mailing if that is a issue

aaronp, 7/5/2011: linked existing branch with a start on the delete/modify review functionality as well as two bug reports for the server to support delete/modify.

(?)

Work Items