Automatically generate Mermaid flowchart diagrams for your Scrapy spiders using GitHub Copilot.
Features
Open any Scrapy spider .py file
Right-click in the editor or on spider file and select Generate Scrapy Spider Visual
A diagram-<spider-name>.md file is created in the same folder, containing the full spider execution flow as a mermaid fenced code block
Visualize request-callback-parse chains, pagination loops, conditional branches, and item extraction at a glance
Requirements
GitHub Copilot must be installed and signed in
A Mermaid viewer extension is needed to render the diagram visually (search "Mermaid Preview" in the Extensions marketplace)
Usage
Open a Scrapy spider Python file (or right-click it in the Explorer sidebar)
Right-click anywhere in the editor and select Generate Scrapy Spider Visual
(or use the Command Palette: Ctrl+Shift+P then type Generate Scrapy Spider Visual)
A diagram-<spider-name>.md file is created and opened in the same folder as the spider
Viewing the Diagram
The generated .md file contains the flowchart inside a mermaid code block.
With a Mermaid viewer installed, the diagram renders automatically in the preview pane
Without a viewer, open the file and copy the mermaid code to any online Mermaid renderer
Release Notes
0.0.1
Initial release of Scrapy Diagram Generator.
Known Issues
Very large spiders may produce diagrams that need manual layout adjustments
