Coming Soon...

Why are you crawling my site?

Galbot is a robot looking for content - it just loves data! We are crawling
your site to learn more about how languages and terms relate to each other,
and we plan to offer this information free to the public. Using our service
you will be able to find related content on your own pages, connect with
other people who share your interests and more.

Our service is currently undergoing heavy development. A release is planned
during early 2009.

How do I prevent you from crawling my pages?

Our crawler obey robots.txt, which is a standard for excluding pages on the Internet. Please refer to this page: www.robotstxt.org. Remember that changes to your site will not be immediately reflected in our crawler, since we only request your robots.txt every 30 minutes or so. Next time we crawl your site, we will request the file again.

If you experience unexpected problems with our crawler, you are free to send us
an e-mail: crawler@galbot.com. Please be kind so kind to attach any logs from your web servers, and describe the problem in its full detail.