SAS Dataset Viewer for VS Code

A powerful VS Code extension for viewing and analyzing SAS7BDAT and XPT (XPORT) dataset files directly in your editor. Features TypeScript-first architecture with 600x performance improvement and enhanced filtering capabilities. No SAS installation required!

✨ Features

📊 Dataset Viewing

• Open and view SAS7BDAT and XPT (XPORT) files directly in VS Code
• Professional tabular display with pagination
• Support for large datasets (tested with 12,000+ rows)
• Real-time data loading with visual feedback
• Full XPT/XPORT support:
  • v5/v6 files (FDA submissions): Native TypeScript reader for maximum speed (~1.5s load time)
  • v8/v9 files (modern SAS): Automatic Python fallback with pyreadstat
  • Smart header-based version detection for instant format recognition
  • Automatic label row skipping for clean data display

🔍 Advanced Filtering

• WHERE Clause Filtering: Use SAS-style WHERE conditions
  • Fully case-insensitive: age > 30 works the same as AGE > 30
  • Support for operators: =, >, <, >=, <=, !=
  • Logical operators: AND, OR, &, |
  • Example: AGE > 30 AND COUNTRY = 'USA' or age > 30 and country = 'USA'

📝 Variable Management

• KEEP/DROP Variables: Quick variable selection by typing
  • KEEP: Specify variables to include (comma-separated)
  • DROP: Specify variables to exclude (comma-separated)
• Checkbox Selection: Click to select/deselect individual variables
• Select All/Clear All: Quick selection buttons
• Display Modes: Show variable names, labels, or both

🎯 Smart Features

• Unique Values Extraction: Get unique values for categorical variables with counts
• Multi-column Unique: NODUPKEY equivalent for multiple variables
• Enhanced WHERE Filtering:
  • Case-insensitive string comparisons
  • Compound conditions with AND/OR
  • SAS-style operators (EQ, NE, GT, LT, GE, LE)

🎨 Modern UI Design

• Clean Interface: Streamlined layout with no redundant information
• Dataset Metadata Modal: Quick access to dataset information
• Variable Metadata Modal: Detailed variable properties in a popup
• Three-Column Control Layout: Organized controls for filtering, unique values, and display options
• Variable Icons: Visual indicators for data types
  • 📝 Character variables
  • 🔢 Numeric variables
  • 📅 Date variables
  • 🕐 DateTime variables
  • 💰 Currency variables
  • 📊 Percentage variables

🚀 Performance

• 600-700x faster than v1.0 with TypeScript-first architecture
• Native TypeScript reader using js-stream-sas7bdat library
• Metadata extraction in ~1ms (vs 730ms in v1.0)
• Data reading in <1ms (vs 605ms in v1.0)
• Optimized XPT loading: v5/v6 files load in ~1.5s (down from 10+ seconds)
• Efficient row counting: 400+ rows counted in ~16ms
• Smart caching for filtered results
• Automatic Python fallback for edge cases
• Optimized pagination (50, 100, 200, 500 rows per page)
• Fast extension activation (output channel on-demand only)
• Professional logging system with debug mode

📋 Requirements

VS Code Requirements

• VS Code version 1.74.0 or higher
• Node.js runtime (included with VS Code)

Optional Python Fallback

• Python 3.x installed and accessible as py command (optional)

• Required Python packages for fallback mode:

  pip install pandas pyreadstat
  

Note: Version 2.0.0 uses a native TypeScript reader by default. Python is only required as a fallback for edge cases.

🎮 Usage

Opening SAS Datasets

1. File Explorer: Simply click on any .sas7bdat or .xpt file
2. Command Palette:
   • Use SAS: Open SAS Dataset command for .sas7bdat files
   • Use SAS: Open SAS XPT File command for .xpt files
3. File Menu: File → Open → Select .sas7bdat or .xpt file

Filtering Data

1. WHERE Clause: Enter conditions in the WHERE input box

   AGE > 30 AND GENDER = 'M'
   VISITNUM >= 5 OR COUNTRY = 'USA'
   

2. KEEP Variables: Type variable names to keep

   USUBJID, AGE, WEIGHT, HEIGHT
   

3. DROP Variables: Type variable names to exclude

   DESC_LONG, NOTE, CHAR_MIXED
   

Keyboard Shortcuts

• Enter in WHERE field: Apply filter
• Enter in KEEP/DROP fields: Apply selection
• Click variable checkboxes: Toggle selection

⚙️ Extension Settings

This extension contributes the following settings:

• sasDatasetViewer.enableDebugLogging: Enable debug logging output (default: false)

📊 Commands

This extension contributes the following commands:

• SAS: Open SAS Dataset: Open a SAS7BDAT dataset file
• SAS: Open SAS XPT File: Open a SAS XPT (XPORT) transport file
• SAS Dataset Viewer: Show Output: Display the output channel for debugging

🐛 Known Issues

• Virtual scrolling mode has limitations with very large datasets (use pagination mode)
• Some complex WHERE clauses may require specific formatting

📝 Release Notes

2.2.0 (Current)

• Major XPT Performance Improvements:
  • Smart header-based version detection (v5/v6 vs v8/v9)
  • Reduced v5/v6 XPT load time from 10+ seconds to ~1.5 seconds
  • Efficient row counting with streaming (16ms for 400+ rows)
  • User-friendly v8/v9 format notifications
• Enhancement: Fully case-insensitive WHERE clause filtering
  • Column names are matched case-insensitively in all filter operations
  • Example: age > 30 works the same as AGE > 30
• Enhancement: Automatic label row detection and skipping
  • XPT files with header/label rows now display correctly
  • First data row shows actual data instead of label text
• Performance: Faster extension activation
  • Output channel opens on-demand only (via command)
  • Reduced startup time
• Fix: Accurate pagination for XPT files
  • Page numbers now display correctly (e.g., "Page 1 of 9" instead of "Page 1 of 0")
  • Row counts are calculated upfront for proper navigation

2.1.0

• New Feature: Full support for SAS XPT (XPORT) transport files
  • Read and view XPT files (v5/v6 format)
  • Same filtering and analysis features as SAS7BDAT files
  • Integrated with xport-js library
• Enhancement: Common interface for dataset documents
• Enhancement: New command for opening XPT files

2.0.3

• Fix: Removed problematic nul file from package
• Clean: Safe VSIX package for extraction

2.0.2

• Documentation: Added proper acknowledgments for js-stream-sas7bdat library
• Version: Incremented to avoid marketplace conflict

2.0.1

• UI Redesign: Cleaner interface with improved layout
  • Removed redundant dataset name displays
  • Added Dataset Metadata button for on-demand information
  • Organized controls into three equal sections
  • Streamlined filter info display
• Major Performance Upgrade: 600-700x faster with TypeScript-first architecture
• Enhanced WHERE Filtering: Case-insensitive comparisons, better AND/OR support
• New Feature: Unique values extraction for categorical variables
• New Feature: Multi-column unique combinations (NODUPKEY equivalent)
• Improved Architecture: TypeScript reader with automatic Python fallback
• Better Logging: Show output command for debugging (SAS Dataset Viewer: Show Output)

1.0.0

• Initial release
• Full dataset viewing and filtering capabilities
• KEEP/DROP variable selection
• Professional logging system
• Comprehensive WHERE clause support

🤝 Contributing

Contributions are welcome! Please feel free to submit issues and pull requests.

📄 License

MIT License - see LICENSE file for details

🙏 Acknowledgments

• js-stream-sas7bdat - Primary TypeScript library for native SAS7BDAT file reading, providing 600x performance improvement
• xport-js - Native TypeScript library for reading XPT v5/v6 files with optimal performance
• pyreadstat - Python fallback library for XPT v8/v9 files and advanced metadata extraction
• pandas - Data manipulation for Python fallback mode
• Built with the VS Code Extension API

Enjoy viewing your SAS datasets in VS Code! 🎉