Datawocky

On Teasing Patterns from Data, with Applications to Search, Social Media, and Advertising

Creating a Culture of Innovation: Why 20% Time is not Enough

Google has garnered a lot of attention and some success with its "20% time" idea, which enables every engineer to spend one day a week working on projects that don't fit in their job description. In my observation, just announcing that every engineer is expected to spend a certain fraction of their time on innovative ideas won't magically lead to innovation. Plus, it's very hard to implement the 20% time model at a startup: most startups just don't have the luxury of 20% excess engineering capacity.

At my (startup) company Kosmix, we take a somewhat different approach to create a culture of innovation, which I described to Taylor Buley of Forbes in a recent video interview. I think the video is terrific, and encourage you to watch it (it's also embedded at the bottom of this post), but there's only so much that can be said in a 90-second video. So I collected together some of my thoughts into this blog post.

At Kosmix, we don't specify a set fraction of time for people to spend on new ideas. Instead, we have focused on creating a culture that engenders new ideas and rewards innovators, encouraging them to tackle new projects above and beyond their 100% contribution to mainline company execution. The three key building blocks that we've used to create a culture of innovation at Kosmix are Team, Environment, and Incentives.

Team.
It always starts with the people. At Kosmix we are fortunate to have a team of rock-star Computer Science graduates from top universities; it's hard to throw a brick without hitting a PhD. Since CS skills are taken for granted, the interview process emphasizes creativity, problem-solving skills, and teamwork skills.

Very importantly, many Kosmixers are multi-dimensional people with interests and passions that extend well beyond work. For example, one of our Operations gurus has a deep interesting in (hold your breath) knitting, and runs knitting classes at work (they're called Knitting Knights). Our office manager also happens to teach Art History.

Environment.
There's something about the graduate school environment that seems to bring out great ideas. Many of the great technology companies (e.g.,Yahoo and Google) have been created by graduate students. We have strived to maintain a grad school environment at Kosmix. Wall around and you'll hear plenty of heated hallway discussions and intellectual free for alls; nerf gun fights erupt over details of relevance algorithms.

When I was a grad student, I used to get ideas for whole new lines of research by attending talks by other students and faculty. The Infolab, the research group I was part of Stanford, has a tradition of Friday lunches where a student leads a discussion on their ongoing work. We have copied this model at Kosmix: every Friday, we have a communal lunch gathering, and a Kosmixer leads a discussion -- either on something cool they've been working on, or on some topic that's just cool but completely unrelated to Kosmix -- such as muscle cars, alternative fuels, or astronomy.

Incentives.
Given the right environment, the next piece is incentives for people to go above and beyond the call of duty. At Kosmix the biggest reward is peer recognition through a system of awards:
  • The Kosmix Kreed award is peer recognition at its purest. Any Kosmixer can nominate any other for doing something interesting and inventive that helps Kosmix users, or for going out of their way to help out another team or person on working on a different project. Giving this award is as easy as sending an email to HR, with a clear description of the achievement that merits the award.
  • The Just Do It! award is given by management, and recognizes an individual who did a substantial project that goes above and beyond their job description. We stole this idea from Amazon.com, where some of us used to work. For example, one recent awardee dreamt up, designed, and implemented the feature that allows users to customize the Kosmix homepage, without any directive from management. Another implemented the ability to edit any topic page on Kosmix.
We also have other awards that recognize teams that execute really well on their core priorities. These awards are read out at monthly company meetings, to warm applause in front of the entire Kosmix team. Each award is also posted on the internal Kosmix blog, which is read by everyone at Kosmix. Awards carry nominal prizes, such as gift certificates; but the real prize is the peer recognition, which acts as a terrific incentive in a high-octane team.

One of the big successes of the Kosmix culture of innovation has been Meehive. A while back, a Kosmix developer thought it would be cool to take Kosmix's core categorization technology and apply it to the problem of filtering news and blogs. He worked on it for a bit to create a first version, which convinced management that this was important enough to create a full team around. We then staffed an official Kosmix project to create Meehive, a personalized newspaper, which we launched last month. You can specify your interests very easily (I have over 40, including technology and cricket), and Meehive scours thousands of newspapers and millions of blogs to create your own personalized newspaper. Early adopters love Meehive; I now use it as my main source of news every day. Check out what people are saying about Meehive on Twitter.

Oh, and by the way, the most recent Just Do It! Award went to a developer on the Meehive team who took it upon himself to create the Meehive iPhone app. It's now rising in popularity among News applications in the app store, and has been a bigger success than any of us imagined. Best of all, no told the developer to do it.

April 15, 2009 in Entrepreneurship: views from the trenches, kosmix | Permalink | Comments (12) | TrackBack (0)

Kosmix Adds Rocketfuel to Power Voyage of Exploration

Kosmix_logo_betaish  

Today I'm delighted to share some fantastic news. My company Kosmix has raised $20 million in new financing to power our growth. Even more than the amount of financing, I'm especially proud that the lead investor in this round is Time Warner, the world's largest media company. Our existing investors Lightspeed, Accel, and DAG participated in the round as well. The Kosmix team also is greatly strengthened by the addition of Ed Zander as investor and strategic advisor. In an amazing career that spans Sun Microsystems and Motorola, Ed has repeatedly demonstrated leadership that grew good ideas into great products and businesses. His counsel will be invaluable as we take Kosmix to the next level as a business.

In these perilous economic times, the funding is a big vote of confidence in Kosmix's product and business. Kosmix web sites attract 11 million visits every month, and we have a proven revenue model with significant revenues and robust growth. RightHealth, the proof-of-concept we launched in 2007, grew with astonishing rapidity to become the #2 health web site in the US. These factors played a big role in helping us close this round of funding with a healthy uptick in valuation from our prior round. Together with the money already in the bank from our prior rounds, we now have more than enough runway to take the company to profitability and beyond.

A few months ago, we put out an alpha version of Kosmix.com. Many people used it and gave us valuable feedback; thank you! We listened, and made changes. Lots of changes. The result is the beta version of Kosmix.com, which we launched today. What's changed? More information sources (many thousands), huge improvements in our relevance algorithms, a much-improved user interface, and a completely new homepage. Give it a whirl and let us know what you think.

To those of you new to Kosmix, the easiest way to explain what Kosmix does is by analogy. Google and Yahoo are search engines; Kosmix is an explore engine. Search engines work really well if your goal is to find a specific piece of information -- a train schedule, a company website, and so on. In other words, they are great at finding needles in the haystack. When you're looking for a single fact, a single definitive web page, or the answer to a specific question, then the needle-in-haystack search engine model works really well. Where it breaks down is when the objective is to learn about, explore, or understand a broad topic. For example:

  • Looking to bake a chocolate cake? We have recipes, nutrition information, a dessert burn rate calculator, blog posts from chow.com, even a how-to video from Martha Stewart!
  • Loved one diagnosed with diabetes? Doctor-reviewed guide, blood sugar and insulin pump slide shows, calculators and risk checkers, quizzes, alternative medications, community.
  • Traveling to San Francisco? Maps, hotels, events, sports teams, attractions, travel blogs, trip plans, guidebooks, videos.
  • Writing an article on Hillary Clinton? Bio, news, CNN videos, personal financial assets and lawmaker stats, Wonkette posts, even satire from The Onion.
  • Into Radiohead? Bio, team members, albums, tracks, music player, concert schedule, videos, similar artists, news and gossip from TMZ.
  • Follow the San Francisco 49ers? Players, news from Yahoo Sports and other sources, official NFL videos and team profiles, tickets, and the official NFL standings widget.


In the examples above, I'm especially pleased about the way Kosmix picks great niche sources for topics. For example, I hadn't heard about chow.com or known that Martha Stewart has how-to videos on her website. Other "gems" of this kind include Jambase, TMZ, The Onion, DailyPlate, MamaHerb, and Wonkette. Part of the goal of Kosmix is to bring you such gems: information sources or sites you have either not heard of, or just not thought about in the current context.

In other words: Google = Search + Find. Kosmix = Explore + Browse.  Browsing sometimes uncovers surprising connections that you might not even have thought about. The power of the model was brought home to me last week as I was traveling around in England. I'd heard a lot about Stonehenge and wanted to visit; so of course I went to the Kosmix topic page on Stonehenge. In addition to the usual comprehensive overview of Stonehenge, the topic page showed me places to stay in Bath, Somerset (which happens to be the best place to stay when you're visiting Stonehenge). It also showed me other ancient monuments in the same area I could visit while I was there. Score one for serendipity. 

Some of us remember the early days of the World Wide Web: the thrill of just browsing around, following links, and discovering new sites that surprise, entertain, and sometimes even inform. We have lost some of that joy now with our workmanlike use of search engines for precision-guided information finding. We built the new Kosmix homepage to capture some of the pleasure of aimless browsing -- exploring for pure pleasure. The homepage shows you the hot news, topics, videos, slide shows, and gossip of the moment. If you find something interesting you can dive right in and start browsing around that topic. We compile this page in the same manner as our topic pages: by aggregating information for many other sources and then applying a healthy dose of algorithms. Dig in; who knows what surprises await?

How does Kosmix work its magic? As I wrote when we put out the alpha, the problem we're solving is fundamentally different from search, and we've taken a fundamentally different approach. The web has evolved from a collection of documents that neatly fit in a search engine index to a collection of rich interactive applications. Applications such as Facebook, MySpace, YouTube, and Yelp. Instead of serving results from an index, Kosmix builds topic pages by querying these applications and assembling the results on-the-fly into a 2-dimensional grid. We have partnered with many of the services that appear in the results pages, and use publicly available APIs in other cases. The secret sauce is our algorithmic categorization technology. Given a topic, categorization tells us where the topic fits in a really big taxonomy, what the related topics are, and so on. In turn, other algorithms use this information to figure out the right set of information sources for a topic from among the thousands we know about. And then other algorithms figure out how to lay the information on the page in a 2-dimensional grid.

While we are proud of what we have built, we know there is still a long way to go. And we cannot do it without your feedback. So join the USS Kosmix on our maiden voyage. Our mission: to explore strange newtopics; to discover surprising new connections; to boldly go where no search engine has gone before!

Update: Vijay Chittoor has posted more details on the new product features on the Kosmix blog. Coverage on TechCrunch, GigaOM, VentureBeat. I'm particularly pleased that Om Malik thinks his page on Kosmix is better than the bio on his site!

December 08, 2008 in Data Mining, kosmix, Search | Permalink | Comments (3) | TrackBack (0)

About

  • Anand Rajaraman
  • Datawocky

Recent Posts

  • Creating a Culture of Innovation: Why 20% Time is not Enough
  • Reboot: How to Reinvent a Technology Startup
  • Oscar Halo: Academy Awards and the Matthew Effect
  • Kosmix Adds Rocketfuel to Power Voyage of Exploration
  • For Startups, Survival is not a Strategy
  • Google Chrome: A Masterstroke or a Blunder?
  • Bridging the Gap between Relational Databases and MapReduce: Three New Approaches
  • Stop Email Overload and Break Silos Using Wikis, Blogs, and IM
  • Why Google Doesn't Provide Earnings Forecasts
  • The Real Long Tail: Why both Chris Anderson and Anita Elberse are Wrong

Recent Comments

  • margaret on Creating a Culture of Innovation: Why 20% Time is not Enough
  • nataly on Creating a Culture of Innovation: Why 20% Time is not Enough
  • Datawocky on Creating a Culture of Innovation: Why 20% Time is not Enough
  • Jo Jordan on Creating a Culture of Innovation: Why 20% Time is not Enough
  • 88 India on Creating a Culture of Innovation: Why 20% Time is not Enough
  • Harry Fuecks on Creating a Culture of Innovation: Why 20% Time is not Enough
  • Dunston rocks on Creating a Culture of Innovation: Why 20% Time is not Enough
  • Michael Christensen on Creating a Culture of Innovation: Why 20% Time is not Enough
  • Harold Jarche on Creating a Culture of Innovation: Why 20% Time is not Enough
  • O on Creating a Culture of Innovation: Why 20% Time is not Enough

Archives

  • April 2009
  • February 2009
  • December 2008
  • November 2008
  • September 2008
  • July 2008
  • June 2008
  • May 2008
  • April 2008
  • March 2008

Blogroll

  • The Numbers Guy
  • Paul Kedrosky's Infectious Greed
  • Life in the Bit Bubble
  • Kosmix Blog
  • John Battelle's Searchblog
  • GigaOM
  • Geeking with Greg
  • Efficient Frontier Insights
  • Data Mining Research
  • Constructive Pessimist, Cynical Optimist

 Subscribe in a reader

Subscribe to Datawocky by Email

Popular Posts

  • Are Machine-Learned Models Prone to Catastrophic Errors?
  • Why the World Needs a New Database System
  • Why Yahoo Glue is a Bigger Deal than You Think
  • The story behind Google's crawler upgrade
  • Affinity and Herding Determine the Effectiveness of Social Media Advertising
  • More data usually beats better algorithms, Part 2
  • More data usually beats better algorithms
  • How Google Measures Search Quality
  • Angel, VC, or Bootstrap?
  • India's SMS GupShup Has 3x The Usage Of Twitter And No Downtime

Categories

  • Advertising
  • Data Mining
  • Entrepreneurship: views from the trenches
  • India
  • Internet Infrastructure
  • kosmix
  • Lewis Carroll
  • Mobile
  • Search
  • Social Media
  • Venture Capital

Twitter Updates

    follow me on Twitter