Skip to main content

Cloud Platform Overview

The msh Cloud Platform extends the open-source msh CLI with cloud-hosted features including centralized metadata management, AI-powered analysis, semantic search, and collaborative data governance.

What is the Cloud Platform?​

The Cloud Platform provides:

CLOUD
  • Centralized Metadata: Upload and manage project metadata in the cloud
  • Cloud Glossary: Shared business glossary across teams and projects
  • AI Sidekick: Enhanced AI features powered by cloud infrastructure
  • Semantic Search: Natural language search across assets and metrics
  • Query Console: NL→SQL translation and execution
  • Pre-Deploy Safety: AI-powered safety checks before deployment
  • Conversational AI: Multi-turn AI agent for data questions

Cloud vs OSS​

Open Source (OSS)​

OSS

The open-source version includes:

  • Local CLI commands (msh run, msh rollback, etc.)
  • Local metadata cache (.msh/ directory)
  • Local glossary (glossary.yaml)
  • AI features using your own API keys
  • All core data pipeline features

Cloud Platform​

CLOUD

The Cloud Platform adds:

  • Centralized metadata storage
  • Shared glossary across projects
  • Enhanced AI features (no API key needed)
  • Semantic search capabilities
  • Query console with NL→SQL
  • Pre-deploy safety checks
  • Conversational AI agent
  • Team collaboration features

Getting Started​

1. Create Cloud Account​

  1. Sign up at https://app.msh.io
  2. Create a new project
  3. Generate an API token

2. Upload Metadata​

Upload your project metadata to the cloud:

# Generate context pack
msh ai context --json > context.json

# Upload to cloud
curl -X POST \
  -H "Authorization: Bearer $API_TOKEN" \
  -H "Content-Type: application/json" \
  -d "{\"context_pack\": $(cat context.json), \"source\": \"cli\"}" \
  https://api.msh.io/api/msh/metadata/projects/$PROJECT_ID/upload

3. Use Cloud Features​

Once metadata is uploaded, you can use:

  • Cloud glossary management
  • Semantic search
  • Query console
  • AI Sidekick features
  • Pre-deploy safety checks

Features​

Metadata Management​

CLOUD

Upload and manage project metadata centrally:

  • Asset discovery across projects
  • Cross-project lineage analysis
  • Version history tracking
  • Test result aggregation

See Metadata Management for details.

Glossary & Semantic Layer​

CLOUD

Centralized business glossary:

  • Terms, metrics, dimensions, policies
  • Term-to-asset linking
  • Metric SQL definitions
  • Data governance policies

See Glossary Management for details.

AI Sidekick​

CLOUD

Enhanced AI-powered features:

  • Asset explanation
  • Risk analysis
  • Lineage impact analysis
  • Pre-deploy safety checks

See AI Sidekick for details.

CLOUD

Natural language search:

  • Search assets by meaning
  • Find metrics and terms
  • Relevance scoring
  • Multi-entity search

See Semantic Search for details.

Query Console​

CLOUD

NL→SQL translation and execution:

  • Natural language to SQL
  • Safe query execution
  • Query history
  • Result visualization

See Query Console for details.

Pre-Deploy Safety​

CLOUD

AI-powered safety checks:

  • Breaking change detection
  • Downstream impact analysis
  • PII propagation risks
  • Policy violation detection

See Pre-Deploy Safety for details.

Conversational AI Agent​

CLOUD

Multi-turn AI assistant:

  • Data discovery
  • Metric definitions
  • Query generation
  • Best practices guidance

See AI Agent for details.

API Authentication​

All Cloud Platform features require API authentication:

export API_TOKEN="your-token-here"

curl -X GET \
  -H "Authorization: Bearer $API_TOKEN" \
  https://api.msh.io/api/msh/projects/

See API Authentication for details.

Migration from OSS​

If you're using the OSS version and want to migrate to Cloud:

  1. Create Cloud Account: Sign up at https://app.msh.io
  2. Upload Metadata: Upload your project metadata
  3. Export Glossary: Export local glossary and import to Cloud
  4. Update Workflows: Update CI/CD to sync metadata to Cloud

See Migration Guide for step-by-step instructions.

Pricing​

  • Free Tier: 1 project, 100 API requests/hour
  • Pro Tier: Unlimited projects, 1000 API requests/hour
  • Enterprise: Custom limits, dedicated support

See Pricing for details.

Next Steps​