A VSCode extension that generates markdown documentation from web pages and GitHub repositories.
If you find Docs Miner useful, please consider leaving a star ⭐ on github repository or buying me a coffee ☕ to keep me motivated to work on this project.
Features
Generate markdown documentation from any web URL or GitHub repository
Two scraping methods:
API Method (Faster but may fail on some sites)
Browser Method (Slower but more reliable)
Smart crawling that follows:
Subdirectory structure from the initial URL for websites
Repository file structure for GitHub repositories
Configurable crawling depth with precise level control
Real-time progress tracking
Stop crawling at any time
Automatically saves the markdown file in your current workspace
Opens the generated file for immediate viewing
Usage
Open the Docs Miner sidebar (look for the Docs Miner icon in the Activity Bar)
Enter the URL you want to generate documentation from:
Feedback and contributions are welcome. If you encounter any issues or have suggestions for improvements, please create a new issue on the GitHub repository.
If you'd like to contribute to the development of the extension, feel free to submit a pull request with your changes.