How to build a "Google Shopping" clone with Drupal 7

Purpose of this talk? To show that Drupal 7 can do mega-scale search with custom entities. (I will talk about the architecture behind www.shopcircuit.nl/search, not necessarily about my startup, but about Drupal of course.)

Siince Drupal 6 I have been on a quest to develop a Google Shopping / TheFind.com clone on Drupal. My first attempts with Drupal 6 failed due to performance issues (nodes). With the introduction of Drupal 7's entities I was able to achieve my dream: The Shop Circuit can handle tens of millions of product entities, and uses Search API with Apache Solr to do search magic.

Before DrupalCon Munich, I will have launched the US version (shopcircuit.com - soon) and stabilized the systems up to 10 million entities (currently 2 million on the shopcircuit.nl site). Currently considering MongoDB-integration for the entity tables currently in MySQL. Can also talk about that a bit.

Speaker(s): 
Track: 
Coding and Development
Experience level: 
Advanced

Comments

I'm working on the basic outline next weeks, wil submit a file soon.

If anyone has questions, comments or suggestions for this talk - feel free to point it out to me.

Hi. Have you made progress with your outline? We are currently in the process of selecting sessions. Sounds interesting to me. Focus on how Drupal 7 makes scaling easier than before.