Friday, March 6, 2009

AJAX crawler and indexer

It is hard to create good SEO for pure AJAX based websites specially those written in GWT. Is this problem solved? I am expecting that google crawler would be come sophisticated so that it would start showing relevent search results for such sites. 

As we are pushing the limits of the intenet, expectations and incentive to write usable apps should be made high. Today it is a challenge to have good SEO for pure AJAX sites.


One of the idea is to use jquery to write crawlers on the server side. I.e exploit the technique mentioned in http://ejohn.org/projects/bringing-the-browser-to-the-server/.

This could be used to crawl AJAX content, specially sites which creates dynamic content and serve to users via ajax. A search engine can be created which is specialized for searching within ajax content. I would love to see next generation web crawlers to have such capabilites (or it could already be there)

No comments: