Enhancements to Ratings and Reviews in Software Center

Registered by Gary Lasker

The ratings and reviews feature was introduced in Software Center in 11.04. In this session we'll discuss ideas for enhancing and refining this feature for Oneiric.

Specification: https://wiki.ubuntu.com/SoftwareCenter/RatingsAndReviews

Blueprint information

Status:
Not started
Approver:
Steve Langasek
Priority:
Medium
Drafter:
Michael Vogt
Direction:
Needs approval
Assignee:
Michael Vogt
Definition:
Approved
Series goal:
Accepted for oneiric
Implementation:
Unknown
Milestone target:
None

Whiteboard

WORK ITEMS:
write code that can visualize the distribution of the ratings as a bar chart (eventually needs to run on the server directly), lp:software-center/test/graph/plot-review-spread.py: DONE
support pagination in software-center (for more reviews): DONE
SRU pagination support: DONE
[mpt] design how to present "show more reviews in different languages": DONE
implement displaying reviews in different languages (using LANGUAGE env?): POSTPONED
[mpt] research weighting/ranking for reviews: DONE
default sort by reviews for s-c search to use the above weight (server side): DONE
support reviews for downloaded debs (using a uniqe identifier ─║ike sha1 or (pkgname, version): POSTPONED
[mpt] design UI for suggesting review of used but not yet reviewed apps (see also bug #779316): DONE
[mpt] consider changing the stars location from right to left (or under the title) as the icon is on the left but the stars potentially on the very right): DONE
support edit/update a review (for a certain time?): DONE
support deleting my own review: DONE
Check piston-mini-client if it supports transparent gz of the review stats (yes, defalte and gzip): DONE
Provide the ability to easily refresh/update "classic" reviews (those that have garnered high usefulness ratings) when new major versions happen so that such reviews don't get lost due to being pushed late in the list: POSTPONED
Send out call for help for the review moderations team: TODO
[isd] Send out a mail when a review was flagged and include the flag feedback and info to contact rnr-moderators mailing if that is a issue: TODO

------------

[Includes postponed work items from https://blueprints.launchpad.net/ubuntu/+spec/packageselection-foundations-n-ratings-and-reviews-in-software-center]

aaronp, 7/5/2011: linked existing branch with a start on the delete/modify review functionality as well as two bug reports for the server to support delete/modify.

aaronp, 8/5/2011: linked bug # 779316 and added item to Client/Server section above.

== UDS session notes ==

Review rating system:
* Star based rating (1 to 5) => We have many 5 star or 1 star apps, but few ones in the middle
* Like / unlike buttons (like in Youtube)
* Only Like (or similar : +1) (used in Facebook and Google Search)

Youtube ratings changed from "5 star" based to Like/Unlike one.
>> Why:
http://youtube-global.blogspot.com/2009/09/five-stars-dominate-ratings.html
http://www.takadesigns.com/blog/2010/04/20/online-review-ratings-5-stars-or-like-dislike/

Is there any graph for the ratings in the Software Center like this one:
http://goo.gl/sTPS1

== Client/Server ==
 * Support pagination (download/display 20 reviews at a time)
 * Add ability to only display reviews in one's own language
   - Could we (1) show "There are 168 reviews in other languages", and when clicked display paginated results with the one best review from each language. Each result could have a "Show me more reviews in <lang>" (and we could obviously ensure certain languages appeared first).
 * Sort by ratings in list view
 * Search results ranked by ratings
 * Ability to display all reviews by a given reviewer (suggested by bdmurray)
  * Be able to keep track of your "friends", possibly show your friend's favorite apps/latest reviews on the front page (contacts list? empathy friends?)
   * need a server API to get a list of "friends", or just return list of reviews for a given user and get the "friend" from contacts
   * might be better to be able to pick your friends directly rather than use your contact list just because your interests may not match at all
   * reviewers with similar voting patterns will probably give more useful results than friends, if the user has voted enough to have any patterns yet... but friends are a good fallback in case the user hasn't voted. (or while viewing a specific app, it could display a widget for "people who liked this also liked X, Y, Z...") <-- tremolux votes he likes this :)
(^^ how to know if he has like other software if he has rated it by 2 or 3 stars ?)
      * some relevant research on predicting ratings: http://en.wikipedia.org/wiki/Netflix_Prize
* have reviews on debs as well, using a unique identifier (pkgname, version, filename, sha1)
   ^^^ +1 from ToyKeeper +1 from kiwinote
 * Ensure users will actually review apps (once the novelty of the new RnR functionality wears
 off), and not just when they don't like it (see discussion on bug # 779316)
   * possibly have a "My Reviews" page that lists your reviews but also prompts you to consider reviewing other apps that you haven't yet reviewed+1 aaronp
   * show a list of apps you have tried but not reviewed, to remind people to review/rate them?
      ("You have [14 unrated apps]", click in the []'s to go to a UI for rating them)
 * Provide the ability to easily refresh/update "classic" reviews (those that have garnered high usefulness ratings) when new major versions happen so that such reviews don't get lost due to being pushed late in the list
 * make stars more visible, even column sortable like under title or on left (users currently look at icons more)

== Reviews moderation ==
 * Enhancements to the moderation UI
 * Grow the moderations team
  * when a review gets flaged, send the guy who wrote the review a mail with the flag feedback and info to contact rnr-moderatiors mailing if that is a issue

aaronp, 7/5/2011: linked existing branch with a start on the delete/modify review functionality as well as two bug reports for the server to support delete/modify.

(?)

Work Items