The Caroline Web Crawler
Our web crawler continually searches the web for adult galleries, identifying itself with a user-agent of Caroline. If you run a website and would prefer that we do not crawl or link to your pages, add CarolineBot to the list of disallowed user-agents in your robots.txt file.
Guidelines for Webmasters
- Ensure other popular sites link to your pages. Caroline follows links from one webpage to the next.
- Don't block web crawlers in robots.txt if you want your galleries indexed.
- Photos should link directly to image files ending in
.jpgor.jpeg. - Keep the number of images reasonable (typically between 10 and 30 images per gallery).