The iTunes App Store has received a lot of praise and – lately – lots of criticism. Generally everybody seems to agree that for a "version one release" it's pretty awesome. The majority of the feedback found online has been published from an end users/customers point of view. Solving the increasing usability problems and allowing refunds and trials seem to be high on customers' wish lists.
As a developer for the iPhone OS platform I want to highlight another aspect and ask developers around the globe to join forces: Let's create an independent Review Response website. Like the iTunes music store the App Store allows customers to leave a comment and rate an application on a five star scheme.
In the very beginning everybody could submit reviews even without having purchased an application. Thanks God Apple fixed it in the meantime. But there still are a couple of problems:
Reviews are a one way street
I like customer feedback and I hate censorship. So clearly there should be no means for developers to moderate customer comments. However, from time to time there simply is a need to respond to comments. Allowing one way feedback only sort of encourages abuse and guarantees no sort of quality assurance for the content generated by users. There should be no reason to disallow the creators of a product to briefly comment on user criticism. Moreover a dialogue between customers and producers will help improving product quality and drives innovation.
Reviews versus Tech Support
In a quick and by no means statistically representative check I found that a majority of the reviews contain handling questions and sometimes valuable feedback about improving an app. Usually this stuff should be emailed to the Tech support department. In fact the App Store provides means for developers to promote a website for handling technical support questions – it's just that most customers seem to do it via the review feature. (They'll obviously never get a direct response because of the one way street nature of the functionality.) Some developers have started to abuse the App Store description to respond directly to some customer remarks. This in turn causes scattered and crappy descriptions to appear while they should solely function as advertorial content and help driving sales.
Limited Visibility
Customers might think that developers have easy and convenient access to all reviews and might wonder why they never receive any responses to their comments. Well, the problem is that as of today there is absolutely no functionality available which helps developers to keep track of the global feedback pool. iTunes Connect, the web based store back end application used to manage App Store contents, does not contain any feature which would allow me as a producer of an application to read through the review submissions. The only official option is to use iTunes and manually switch to all the local App Stores. This has forced some independent developers to create workarounds which make grabbing the reviews a bit more convenient – but it's still far from ideal.
Highjacking Reviews
Though rarely, I've seen competing producers highjacking other producers' reviews. With most of the apps at a price point below 5 US$ it's just so easy and affordable to buy your competitors app and immediately submit a 2-3 star review pointing out another app – your own – as the better one. As review authors publish under arbitrary pseudonyms there's absolutely no way for real customers to find that they've been tricked.
The Broken Ranking Maths
I don't know why but I've seen numerous examples lately where the maths behind total review scores (Apple's five star system) seemed to be totally screwed. It might have to do with batch processing App Store databases, multiple international sources and time zones or simply just another wired Apple algorithm but more often than not the average review score indicated does not equal the one which I yield manually when I run through each individual review and do the math myself. As matter of fact I've just checked the scores for Visual Dial, one of my apps. The table view of the (German) App Store on my iPhone says "3 reviews". Switching to detail view it says "2 reviews". What happened to the missing comment? Continue to check it for another one of my apps: The table view says "36 reviews" while the detail view says "8 reviews". All of the 8 reviews have full five star ratings. The average rating calculated and displayed in the App Store is a three star rating, however. Why do 8 five star reviews sum up to an average of three?
With all of the above said I'd like to build an independent web site which would encourage a customer <> producer dialogue.
I'd like to ask iPhone developers around the world to join forces and help me in creating Review Response. I've started to work on the overall concept and would love to build it in the very near future. Technology wise I'd prefer to set it up as a shared source project (Subversion managed) build on a Ruby on Rails/MySQL stack. I can provide the SCM repository, the hosting and skills in RoR, CSS, HTML and MySQL. I've also worked out a smart way how to authorize developers and securely authenticate them as the real owners of their respective App Store applications.
I'd like to establish Review Response as a well known, independent and primary site
- for customers who already purchased an app to get feedback to their reviews right from the source
- for potentially new customers to read through the reviews along with the producers responses in context
- for developers to have a one stop place to access all internationally available reviews and comment on individual feedback
If you've got some spare time and want to work with me on Review Response, please drop me an email at ralf[at]24100.net. If you're busy but like the idea, please help spreading the word by linking to this blog post and otherwise let your network know!