User-agent: * Disallow: /.vscode/ Disallow: /node_modules/ Disallow: /scripts/ Disallow: /assets/scss/ Disallow: /vendor/ Disallow: /assets/img/nofollow/ Disallow: /img/weather_icons/ # NE vracati "Disallow: /*?url=" — blokira Googlebota na cijelom sajtu. # Bot-prerender pravilo u .htaccess ubacuje ?url=..., a mod_dir ga onda prosljedi # u 301 Location, pa svaka podstranica za Googlebota zavrsi na ?url= URL-u. # Taj Disallow je vrijedio samo za "User-agent: *" (grupe se ne spajaju), pa su # GPTBot/ClaudeBot/PerplexityBot prolazili, a Googlebot je bio blokiran — zbog # cega nas Gemini/AI Mode uopce nije imao u indeksu. Disallow: /*.ini$ Disallow: /*.json$ Disallow: /*.lock$ Disallow: /*.md$ # AI crawleri - eksplicitno dopusteno User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: OAI-SearchBot Allow: / User-agent: ClaudeBot Allow: / User-agent: Claude-User Allow: / User-agent: PerplexityBot Allow: / User-agent: Google-Extended Allow: / Sitemap: https://zadar.travel/sitemap.xml