User-agent: * Disallow: /html2/ Disallow: /images/ Disallow: /jakob/ Disallow: /media/ Disallow: /scripts/ Disallow: /shared/ Disallow: /*.jpg$ Disallow: /*.gif$ Disallow: /*.swf$ Disallow: /*.pdf$ Allow: /html/