Connect to Azure API Management to test and monitor AI Gateway deployments.
ℹ️ The AI Gateway Toolkit is developed and maintained by the author (Alex Vieira) and is not an official Microsoft product — it is not provided, or supported by Microsoft. THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND.
Features
🔗 Azure Connection
Seamless integration with VS Code's built-in Microsoft authentication
Connect to Azure API Management instances across tenants and subscriptions
Automatic discovery of inference APIs
📊 Analytics Dashboard - you need to configure your inference APIs with LLM Logging
Real-time AI usage metrics and monitoring with manual refresh capability
Interactive charts showing usage trends, token consumption, and latency
Model performance analysis with success rates and error tracking
Detailed request logs with drill-down capabilities
Comprehensive filtering by API, subscription, model, backend, region, and time range
One-click refresh button to update data with current filter settings
🎮 Playground
Interactive testing environment for inference APIs
Support for streaming and non-streaming responses
Request/response inspection with raw JSON views
Azure API Management trace integration
Conversation history and session management
🔧 API Management
View and manage inference APIs
Context-aware analytics filtering
🔑 Subscription Management
Create and manage API Management subscriptions
Easy key copying with one-click access
Subscription-specific analytics and playground access
🧠 Model Analytics
Track model usage from Log Analytics
Performance metrics and token consumption analysis
Model comparison and optimization insights
🔧 Backend Management
View and analyze Azure backend services from Log Analytics
Backend performance metrics including latency and error rates
Token usage tracking per backend service
Direct access to backend-specific analytics
Getting Started
Install the Extension: Install AI Gateway Toolkit from the VS Code marketplace
Connect to Azure: Click the connect button in the AI Gateway Toolkit sidebar
Authenticate: Use your existing VS Code Microsoft authentication
Select Resources: Choose your tenant, subscription, and API Management service
Start Exploring: Use the analytics dashboard, playground, and management features
Requirements
VS Code version 1.104.0 or higher
Azure subscription with API Management service
Inference APIs configured in Azure API Management
Log Analytics workspace connected to API Management (for analytics features)
Configuration
The extension uses VS Code's built-in Microsoft authentication provider and requires the following Azure permissions:
Read access to Azure subscriptions
Read access to API Management services
Read access to Log Analytics workspaces
Usage
Analytics Dashboard - you need to configure your inference APIs with LLM Logging
Access real-time metrics and usage trends
Filter data by time range, API, subscription, model, or region
Drill down into specific requests and responses
Export data for further analysis
Playground
Select API, model, and subscription
Configure streaming and tracing options
Send test prompts and view responses
Inspect raw requests, responses, and trace data
API Management
Browse available inference APIs
Access API-specific analytics
Open playground with pre-selected API
Subscription Management
View all API Management subscriptions
Copy primary and secondary keys
Create new subscriptions with custom scopes
Support
For issues, feature requests, or contributions, please visit our GitHub repository.
