robots-txt-support

VS Code extension for robots.txt language support.

Features

• Syntax highlighting
• Code completion for directives and user-agents
• Hover information
• Signature help for directives
• Diagnostics and error reporting
• Quick fixes for common issues
• CodeLens for user-agents
• Formatting support
• Snippets for common directives

If you find any errors in the crawler information, please open an issue. Issues and pull requests are welcome.

Extension Settings

None.

Reference

• RFC 9309 - The Robots Exclusion Protocol
• Robots Exclusion Protocol