Resource Builder

AI-powered tool for generating Spark SQL queries from natural language input.

Features

• Spark SQL Generation: Convert natural language requests into Spark SQL queries
• AI-Powered: Uses OpenAI GPT models for intelligent code generation
• VS Code Integration: Seamless integration with VS Code chat interface
• Natural Language Processing: Simply describe what you want in plain English
• Automatic Setup: MCP server starts automatically with the extension

Prerequisites

⚠️ Important: This extension requires Python 3.8+ to be installed on your system.

Python Installation

• Windows: Download from python.org
• macOS: Use Homebrew: brew install python
• Linux: Usually pre-installed, or use package manager

Verify Python Installation

python --version
# or
python3 --version

Quick Start

1. Install Python 3.8+ (if not already installed)
2. Install the extension from VS Code marketplace
3. Extension automatically sets up the MCP server
4. Open VS Code Chat (Ctrl+Shift+I)
5. Type @resourcebuilder + your request

Example Usage

@resourcebuilder Write Spark SQL to create a temp view PolicyStateResources
@resourcebuilder Generate SQL to join users and orders tables
@resourcebuilder Create a query to aggregate sales data by region

How It Works

1. Natural Language Input: Describe your data processing needs in plain English
2. AI Analysis: Our AI understands your intent and requirements
3. SQL Generation: Automatically generates optimized Spark SQL queries
4. Ready to Use: Copy the generated SQL directly into your notebooks

Architecture

• VS Code Extension: Frontend interface and chat integration
• MCP Server: Python backend that generates SQL (starts automatically)
• Local Processing: All processing happens on your machine for privacy

Use Cases

• Data Exploration: Quickly generate queries to explore new datasets
• Report Creation: Automate the creation of complex reporting queries
• Data Transformation: Convert business requirements into SQL logic
• Learning: Understand how to structure complex SQL operations

Requirements

• Visual Studio Code 1.85.0 or higher
• Python 3.8+ installed and accessible in PATH
• Azure OpenAI service (for AI-powered generation)
• Azure Synapse or Databricks environment (for running generated SQL)

Support

• Use the chat interface for SQL generation requests
• Generated SQL is optimized for Spark environments
• All queries include comments explaining the logic
• MCP server starts automatically - no manual setup required

Privacy & Security

• No data transmitted: All processing happens locally on your machine
• No personal information logged: Extension respects your privacy
• Local MCP server: SQL generation runs in your environment
• Secure by design: No external API calls for sensitive data

Troubleshooting

Python Not Found

If you see "Python not found" error:

1. Ensure Python 3.8+ is installed
2. Verify Python is in your system PATH
3. Restart VS Code after Python installation

MCP Server Issues

If the MCP server fails to start:

1. Check Python installation
2. Ensure you have internet access for package installation
3. Check VS Code output panel for error details

Extension Not Working

1. Verify Python is installed and accessible
2. Check VS Code output panel for MCP server logs
3. Restart VS Code and try again

Future Plans

• Azure Hosting: MCP server will be available as Azure App Service
• Cloud Processing: Option to use cloud-based SQL generation
• Enhanced AI: More sophisticated SQL generation capabilities

Note: This extension generates SQL queries based on your descriptions. Always review generated SQL before executing in production environments.