User-agent:* Allow:/ Disallow: /ad* Disallow: /static/* Disallow: /api/* Disallow: /app*/ Disallow: /app