User-agent: * Disallow: /clients/* Disallow: /common_assets/* Disallow: /common_assets_kupe/* Disallow: archived.html