User-agent: LinkLint-spider Disallow: /xyz User-agent: linklint Disallow: User-agent: * Disallow: /dynamic/de/contact.html Disallow: /dynamic/en/contact.html