User-agent: * Allow: / Disallow: /api/ Disallow: /blog/preview # Agent discovery: /agents.txt /llms.txt /llms-full.txt /llms-endpoints.txt /llms.json /llms-{platform}.txt /openapi.json /skill.md Sitemap: https://www.socialfetch.dev/sitemap.xml