Is Rhai scripting included in rbee?

Rhai scripting is a premium feature (€129 lifetime). rbee Premium Queen includes advanced RHAI scheduling algorithms for custom routing logic. Free tier uses basic round-robin routing.

How much does Rhai scripting cost?

Premium Queen costs €129 lifetime (pre-launch pricing through Q2 2026). After Q2 2026, it will be €29/month. Includes advanced RHAI scheduling, multi-tenant isolation, and telemetry.

What can I do with Rhai scripts?

Write custom routing logic: A/B testing (route 10% to new models), canary deployments, GDPR compliance (route EU users to EU workers), cost optimization, latency-based routing. Hot-reload without downtime.

Do I need to restart rbee to update routing scripts?

No. Rhai scripts hot-reload without downtime. Update your routing logic and apply it with one command: rbee-keeper routing apply routing.rhai. No restart, no redeployment.

Can I use Rhai for GDPR compliance?

Yes. Write routing rules to enforce data locality (route EU users to EU workers), cost limits, or compliance requirements. Combine with GDPR Auditing Premium (€249) for complete compliance.

Premium Feature • €129 Lifetime

Stop AcceptingHardcoded Routing.

rbee Premium includes Rhai scripting. Write custom routing logic: A/B testing, canary deployments, GDPR compliance, cost optimization. €129 lifetime. Hot-reload without downtime. Your rules, your control.

€129 lifetimeHot-reloadA/B testingGDPR routing

Try rbee Now View Pricing

routing.rhai

$ rbee-keeper routing apply routing.rhai

▊ Streaming tokens...

// Custom routing script

if task.model.contains("70b") {

route_to("multi-gpu-cluster")

}

else if task.type == "image" {

route_to("cuda-only")

}

else {

route_to("cheapest")

}

GPU 1: 45%

GPU 2: 78%

Cost: $0.00

Custom routingPolicy enforcement

The Hardcoded Routing Trap

Most AI platforms force you into fixed routing strategies. No customization. No control.

Hardcoded Strategies

vLLM and Ray have fixed routing logic. Round-robin, random, or least-loaded. Want custom logic? Fork the entire codebase. Good luck maintaining that.

No flexibility

No GDPR Compliance

Need to route EU users to EU workers for data locality? Impossible with hardcoded routing. You cannot enforce compliance policies.

Compliance risk

No A/B Testing

Want to test new models on 10% of traffic? Cannot do canary deployments? Hardcoded routing means no experimentation.

No testing

Your Rules, Your Control.

rbee Premium includes Rhai scripting. €129 lifetime. Write custom routing logic. Hot-reload without downtime.

Custom Routing Logic

Write routing rules in Rhai. Route by model size, type, cost, latency, or compliance.

Hot-Reload Scripts

Update routing logic without restarting. No downtime, no redeployment.

Policy Enforcement

Enforce GDPR compliance, data locality, or cost limits with routing rules.

A/B Testing

Route 10% of traffic to new models. Test in production safely.

How It Works

Write Rhai scripts to control routing logic

Write routing script

routing.rhai

// Route by model size
if task.model.contains("70b") {
  route_to("multi-gpu-cluster")
} else {
  route_to("single-gpu")
}

Apply script

Hot-reload without downtime

rbee-keeper routing apply routing.rhai

rbee uses your logic

Note

All requests now use your custom routing logic. Update the script anytime - no restart needed.

Routing Examples

See what you can do with Rhai scripts

rust

// routing.rhai - Route by model size
if task.model.contains("70b") {
  // Large models need multi-GPU
  route_to("multi-gpu-cluster")
}
else if task.model.contains("7b") {
  // Small models work on single GPU
  route_to("single-gpu")
}
else {
  // Everything else - cheapest available
  route_to("cheapest")
}

Use Cases

How users leverage Rhai scripting

Enterprise Compliance

Scenario

Need GDPR compliance with EU data locality

Solution

Write Rhai script to route EU users to EU workers

Outcome

GDPR compliant by default

Enterprise GPU orchestration

Startups

Scenario

Optimize costs by routing to cheapest workers

Solution

Rhai script routes by cost, not just availability

Outcome

Save 20-30% on compute costs

Startups save $72K/year

Developers

Scenario

Route by model type for development workflows

Solution

Code models to CUDA, images to Metal, etc.

Outcome

Optimized routing for each task type

How developers use rbee

Research

Scenario

Experiment with different routing strategies

Solution

Hot-reload Rhai scripts to test new strategies

Outcome

Rapid experimentation without downtime

Research AI infrastructure