Cloud LLM Provider Regression Testing

v20260421

cloud-provider-regression-test

Automates comprehensive regression testing for all enabled cloud Large Language Model (LLM) providers. This includes verifying core connectivity, standard chat completion, structured JSON output, and Server-Sent Events (SSE) streaming capabilities. Essential for ensuring the reliability and stability of multi-cloud AI integrations in a CI/CD pipeline.

Cloud AI LLM Testing Regression Integration Node.js

Get Skill

337 downloads

Overview

Cloud Provider Regression Test

Tests every enabled cloud provider for connectivity, chat completion, JSON output, and SSE streaming. Reads keys from ~/.aegis-ai/llm-config.json.

Standalone

node scripts/run-regression.cjs                    # all providers
node scripts/run-regression.cjs --provider glm,xai # specific
node scripts/run-regression.cjs --verbose           # full responses

Protocol

{"event":"ready","providers":8}
{"event":"test_result","suite":"GLM","test":"chat","status":"pass","timeMs":1930}
{"event":"complete","passed":14,"failed":1,"total":15,"timeMs":38000}

Tests Per Provider

Test	Verifies
Chat	Connectivity, auth, URL construction, param compat
JSON	Structured output (JSON instruction following)
Stream	SSE streaming, chunks received

Results saved to ~/.aegis-ai/regression-tests/.

Info

Category Artificial Intelligence

Name cloud-provider-regression-test

Version v20260421

Size 7.19KB

Source SharpAI/DeepCamera

Updated At 2026-06-10