Marketing 3
Content briefs, SEO and campaign work with AI — prompts, output and what a human must review.
- Check Whether robots.txt Blocks AI Crawlers with Python
Blocking GPTBot doesn't block every AI bot. Parse robots.txt with Python and print an allow/block table for training, search and user-request crawlers.
Python 3.12.3 (urllib.robotparser) · OpenAI and Anthropic docs checked 2026-10-19 - Count AI Crawler Requests in an Nginx Access Log
Count GPTBot, ClaudeBot and PerplexityBot hits by User-Agent, check robots.txt status, then verify the source IPs against the vendors' published lists.
GNU awk 5.2.1 · Nginx combined-format sample log · jq 1.7 · vendor docs as of 2026-10 - Create an SEO content brief with AI
Create an SEO brief from a query and reader profile. Review the prompt and actual output, check intent, evidence and links, then compare variations.
GPT-6.1 (Codex CLI) · 2026-10-19