headerIMG

B2B Articles - Nov 26, 2010 11:48:38 PM

New docs for Web designers on controlling the Googlebot

More information is now available within the Webmaster site (Google Code section) for controlling how the Googlebot crawls and indexes a website. The section is broken down into the following categories:

  • Getting Started
  • Robots.txt specification
  • Robots meta tag and X-Robots-Tag specification
  • Google’s crawlers
  • References

This new section can help give web designers information on how to, for example, prevent a  PDF file from being indexed. This new section housed on code.google.com provides web designers and webmasters a comprehensive resource for understanding the robots.txt file usage, X-Robots-Tag HTTP header directives and robots meta tags.  From basic definitions of technologies involved to instructions on how to control robots for a website, the new area brings us closer to everyday robots.

Tel 212-993-7809  

Ironpaper ®
10 East 33rd Street 
6th Floor
New York, NY 10016
Map

Ironpaper - B2B Agency

B2B Marketing and Growth Agency.

Grow your B2B business boldly. Ironpaper is a B2B marketing agency. We build growth engines for marketing and sales success. We power demand generation campaigns, ABM programs, create B2B content, strengthen sales enablement, generate qualified leads, and improve B2B marketing efforts.

Ironpaper Twitter Ironpaper Linkedin