AI Inference CLI Tool

Deploy AI APIs to
AWS Bedrock

A CLI tool for deploying OpenAI-compatible APIs to AWS Bedrock with Claude models. Simple, focused, and production-ready infrastructure automation.

AWS Bedrock
GCP (Planned)
Claude 3.5

CLI Command Suite

A comprehensive set of commands for managing AI inference deployments on AWS Bedrock.

init
✅ Available
Initialize new deployment with AWS/GCP configuration
Multi-cloud setup
Credential validation
add
✅ Available
Add inference API or UI components
API components
UI components
plan
✅ Available
Preview changes with cost estimation
Resource planning
Cost estimation
deploy
✅ Available
Deploy infrastructure with rollback support
Auto rollback
Signal handling
status
✅ Available
Check deployment status and health
logs
✅ Available
View component logs with filtering
destroy
✅ Available
Safely remove all deployed resources
More Commands
Available
Full CLI reference with examples

CLI Workflow

Deploy AI inference APIs to AWS Bedrock in four simple steps using our CLI tool.

Initialize
onglx-deploy init
Set up cloud credentials and create deploy.yml configuration
Add Components
onglx-deploy add
Add API components with model selection and UI components
Plan & Review
onglx-deploy plan
Preview resource changes and estimated costs
Deploy
onglx-deploy deploy
Deploy infrastructure with automatic rollback on failure
Terminal - OnglX Deploy
# Initialize new project
$ onglx-deploy init --host aws --region us-east-1
✓ Initialized deployment: my-project
✓ Provider: aws
✓ Region: us-east-1
✓ Config: deploy.yml
# Add API component
$ onglx-deploy add inference --component api --type openai
✓ Added api/openai component
✓ Model: anthropic.claude-3-5-sonnet-20241022-v2:0
# Review deployment plan
$ onglx-deploy plan --show-costs
📋 Deployment Plan
📊 Plan Summary: Additions: 3, Changes: 0
💰 Total Monthly: $9.00 USD
# Deploy to AWS
$ onglx-deploy deploy
✓ Deployment completed successfully!
Endpoints:
API: https://abc123.execute-api.us-east-1.amazonaws.com/

Built for Modern Applications

Currently focused on AI-powered applications with OpenAI-compatible APIs. Future versions will support full-stack applications with compute, storage, and database domains.

Full-Stack Web Apps
🚧 Coming Soon
Next.js frontend + PostgreSQL database deployment (coming in future releases).
Coming soon
E-commerce Platforms
🚧 Coming Soon
High-performance storefronts with CDN and database integration (future release).
Future release
AI-Powered Applications 🔥
✅ Live Now
Multi-cloud AI APIs: AWS Bedrock (Claude 3.5) stable, GCP Vertex AI (Gemini) beta.
Drop-in OpenAI replacement
Up to 50-55% cost savings
Enterprise SaaS
🚧 Coming Soon
Multi-tenant applications with isolated databases, CDN distribution, and compliance-ready infrastructure.
Future release
Content Management
🚧 Coming Soon
Headless CMS with optimized asset delivery, database clustering, and global content distribution.
Future release
Analytics Dashboards
🚧 Coming Soon
Real-time dashboards with data pipelines, time-series databases, and compute-optimized backends.
Future release
API Platforms
🚧 Coming Soon
Microservices architecture with load balancing, API gateways, and distributed database systems.
Future release
Static + Dynamic
🚧 Coming Soon
Hybrid applications mixing static generation with dynamic features, optimized for performance and SEO.
Future release

CLI Tool Pricing

Start free, upgrade for advanced features. South African pricing (ZAR-optimized). SaaS Platform and Enterprise tiers also available.

CLI Free
0
Perfect for personal projects
Unlimited usage
AWS/GCP resource usage
CloudWatch logs
Built-in modules
Community support
Coming Soon
Team Dashboard
TBD
Pricing to be announced
Web dashboard
Team collaboration
Usage analytics
Deployment history
Email support

Enterprise Features: Self-hosted deployment, advanced security, priority support.

Coming Soon

Try the Experimental CLI

Build the experimental CLI from source and test basic AWS Bedrock deployment. Early development software with limited functionality.