Return to the main Infowranglers site.
This Month
January 2009
Sun Mon Tue Wed Thu Fri Sat
1 2 3
4 5 6 7 8 9 10
11 12 13 14 15 16 17
18 19 20 21 22 23 24
25 26 27 28 29 30 31
Login
User name:
Password:
Remember me 
View Article  When Web 2.0 concepts collide: The tribal problem with Digg

It is a truth universally acknowledged that a Web site with a large user-base must be in need of some social networking features. After-all turning a Web readership into a community, which can share knowledge and opinion, benefits the Web site and the user-base alike. And hey, social networks are hot, so if you can make your site into one of those, you’re bound to boost its value. Right?

Not always: in Digg.com, we have a site where social networking is positively toxic to its core model. Yet the company continues down the social road.  

For those few who haven’t visited it, Digg is a user-driven news aggregator. That is users submit links to interesting news stories, which get voted up (dugg up) or down (buried) by the rest of the users. The ones that are most rapidly “dugg” make it to the site’s front page (that’s a simplification - the algorithm that dictates whether a story to make it to the front of the site is more complex and obfuscated than that).  Digg’s selling point is that the content that makes it to the top of the pile is dictated entirely by the crowd and the algorithm. There are no editors, moderators or overseers deciding what hot and what’s not.

So Digg is a classic embodiment of the “wisdom of crowds”. It turns out that the model works well when your crowd is amorphous and disconnected. But what happens when it starts to get clumpy? What happens when connections occur between parts of the cloud, when things get tribal? Bad things, that’s what.

Over the last couple of years the Digg team has looked to capitalise on all the information generated by the army of diggers, aiming to improve the algorithm so that each user sees what they are interested in.  One strategy adopted was to add social networking into the mix. The thinking is simple enough: if Alice spots that Bob tends to submit interesting stuff, give her an easy way of following Bob’s activities and give the two of them a way to tip each other off about interesting stuff. Consequently Digg introduced a way to build lists of ‘Friends’ - making it easy to follow what particular users are doing and what content they are digging. It also added the ability to send a message, or ‘Shout’ to Friends.

The result was twofold. Some users began digging stories based on who submitted it, rather than the intrinsic value of the content. Networks of friends have emerged that work to promote the submissions of particular users. Of course, such concerted teamwork could happen anyway through e-mail and IM. However with friends and shouts Digg has specifically created the tools that are detrimental to the site’s core mission.

“But hang on a second”, you may be thinking - “that sounds like a good idea, letting me follow someone smart and interesting improves my experience”. You’re right. But the problem with the Digg model is when a group mutually up-vote each other’s stories, the results are non-local to that group. In other words if a cluster of Bobs and Alices have a deep interest in moth-wrangling and digg each other’s stories, it doesn’t only effect the group’s results: Carol and Dave will also see the story rise through the ranks despite the fact that they are much more interested in the latest earwig-racing news.

The addition of a social element also exacerbates the “power user problem”. These are users who build large networks and therefore manage to drive large numbers of stories to the front page. The bête noir of many users are power users who   spot stories submitted by someone else and re-submit it as their own - usually leaving the original submission in the dust. It’s leads to this kind of pitch-fork rattling story from December - and Digg’s response which you can read here.

So Digg clearly takes the issue seriously and has spent significant time tweaking its design to get around the problem. An early response was to removing the list of ‘top posters’ to reduce competition for the title of “number one Digger”. Breaking the site up into topic sections was another move designed to give users an easy way to filter content.

It has also spent a lot time tweaking its algorithms to reduce the unwanted network effects and to make it harder for network-dugg stories to hit the front page.  But as the algorithm has become more sophisticated, so the conceptually simple link between number of diggs and the likelihood of hitting the front page has been lost. Users now puzzle over why some stories with large numbers of diggs never making it to the front page. The answer of course is that the stories may have been dugg, but not by the right kind of users.

Digg has tied itself in knots because of two fundamental problem with its model:

1. The number of diggs that a story receives is global - everyone sees the same number.
2. Everyone sees the same stories hit the front page (assuming they have all the sections turned on).  

Unfortunately network effects mean that while everyone sees a story as having the same number of diggs, the value of each dig varies for each user:  a digg from a Friend is more valuable to me than a digg by your Friend. An unprompted digg from someone is more valuable than someone who has been prompted by a friend. So the contents of my front page should be different to yours.  This is a fact recognised by Digg’s recommendation engine.

So how can Digg get around this? It can’t easily. Giving everyone their own individual front page would lead to confusion, as would displaying an ‘adjusted’ digg number for each user next to each story.    

Digg could simply remove the Friends and Shouts functionality and leave stories in the Upcoming voting queue anonymous until they had passed some threshold of popularity. But it won’t do that because it wants to increase its value and social networking is by far the easiest path when you have a large user-base.

Are there any major lessons here for other sites? Only this: In the vast majority of cases  giving your user-base the tools to communicate is a Good Thing. The main exceptions are: (a) when your customer service and products are so bad that letting users converse will create a lynch-mob (b) when your core model requires a user to act without being biased by other users’ activity.

Before retrofitting sociality to existing site, pause for a moment. How will is the site's mechanics be affected if a sub-set of the users start acting as a coordinated mass, rather than informed individuals?
View Article  One to watch: Content Circles - a new collaboration tool
Content Circles is an intriguing little company. A nine person outfit founded by a couple of Adobe/Xerox alumni, it has so far stayed under most peoples’ radars. There appear to be few if any blog entries about it and no mainstream news coverage. But the company does have a potentially nifty little tool for small and medium sized businesses to share files and collaborate on authoring them. It's just emerged from beta.

Content Circle’s basic concept is a familiar one. It lets you create multiple closed workspaces (it dubs them circles, of course), into which you can dump any kind of document. You can then invite contacts into the circle, so that they can view, contribute or edit the content depending on the role that you as circle creator assign them. Once in they can choose to be notified when content is added or changes, can add notes to documents, and use an in-circle IM system.

Yes, its another approach to doing away with the old e-mail attachment shuffle and there is no shortage of cheap and cheerful approaches; DropBox, Google Docs… or Sharepoint, if cheap doesn’t really appeal.

However Content Circles is unusual in it takes a peer-to-peer approach to the data and is written as a desktop Java application. So there is no central repository for the files, instead each member of the circle holds copy of the files locally in the application. Drag a file or folder into a circle window and the data is copied into the application and then synced across the network to the rest of the membership. If they are offline, then the data is synced as soon as they reappear, from whichever members are online. If everyone is offline, well it is possible to set up a machine as a dedicated store-and-forward server.

The application also hosts a real-time chat pane for circle participants as well as the ability to tag and add comments to files. Here's an annotated screen-shot from the company:



There are some nice touches - you’ll notice above that I said dragging a file on to the application copies it into the circle - so the existing file sits untouched on your machine. But what happens when the version held within CC is altered? First the application makes a new revision and keeps it with previous versions. Secondly it flags up that the version inside the application now differs from the original sitting on your machine and lets you update the original with a couple of mouse clicks.

Another nice touch is the application’s ability to link to Google Docs and Sharepoint servers, so that documents can be pulled in from those sources, edited collaboratively within Content Circles and the Synced back out.

Annoyances and questions

The 1.0.1 release has a few niggles in it: The Google Docs function won’t work for anyone in the UK or Germany simply because the application automatically appends @gmail.com to the end of username credentials. Fine, except that in the UK and Germany, Google is forced to use googlemail, not gmail. Content Circles says that this bug would be fixed in the next release.

Will it work in a corporate enterprise environment? If Content Circles reminds me of anything at all, it is of a stripped down Groove. Groove was the brainchild of Lotus Notes creator Ray Ozzie and used a peer-to-peer approach to sync files, discussions, all kinds of data between clients. Now I haven’t used Groove since both it and Ozzie were snapped up by Microsoft in, so I don’t know how Microsoft Groove has evolved 2007 . But the original free app combined a lovely idea with a somewhat flawed implementation - it was bloated and syncing often worked, but sometimes didn’t, resulting in a lot of ‘could you re-sync at your end?’ IM conversations.

I wouldn’t want to paint CC with the Groove brush, but it naturally makes me cautious. Particularly since I haven’t tested it in a proper business environment so I don’t know how it copes with traversing firewalls or how it scales or how much network traffic a large installation dumps into the corporate LAN. These are all issues that can make peer-to-peer a pig in the enterprise and can cripple an apparently good idea. On the sync'ing side at least things look hopeful. Whereas the early Groove was purely peer-to-peer, Content Circle's
firewall-traversing abilities are mediated by a "rendevous service" running on the company's own servers according to CEO Sri Chilukuri.

Another thing that will add confidence is the ability to see how others are fairing in the field. Content Circles doesn’t currently have a support forum for users to swap experiences, so you can't get an intuitive feel for how deployments are going. The company says that is set to change.

Subscription based pricing

Lastly, pricing. Content Circles is using a subscription model to sell its product. Passive “circle members” - users who merely want to partake in a circle - can use a free copy, but users who want the ability to set up new circles (be a “circle owner”) and use a few of the more sophisticated abilities such as Sharepoint integration will need to pay - $24.95 per month or $249.50 per year. New users get a 30 day trial period during which they can use all the facilites including circle creation.

Personally, I don’t mind the subscription model when I’m paying for a service, but here the subscription felt artificial when I first tested the app - my personal preference would have been for a standard software license. However
Sri Chilukuri argues that there is a substantial service element, with the important directory service (for authentication and security), as well as firewall traversal being dependent on Content Circle's servers.

You may be wondering what happens if you set up some circles, use them and then let the owners' subscription lapse. The answer - the circles are frozen; the content may be accessed, but no new content, tags, notes etc. may be added. Renewing the subscription, 'defrosts' the owner's circles once more. It's an interesting model and one that at least means that, should something befall this small company your content is at least retrievable.

This is definitely a company and a product worth watching.