技能 编程开发 Glean搜索可观测性监控

Glean搜索可观测性监控

v20260423
glean-observability
本工具提供企业搜索系统的全方位可观测性监控能力。它追踪搜索延迟、零结果查询率、索引吞吐量和内容时效性等关键指标。通过监控连接器同步状态和索引健康度,帮助团队预警性能衰退和数据衰减,确保搜索结果的实时性和高可用性。
获取技能
250 次下载
概览

Glean Observability

Overview

Glean aggregates enterprise knowledge across dozens of connectors, making indexing health and search quality the two pillars of observability. Monitor connector sync status to catch stale content before users notice, track search latency to maintain sub-second responses, and measure zero-result rates to identify coverage gaps. Degraded indexing silently erodes search relevance, so proactive alerting is essential.

Key Metrics

MetricTypeTargetAlert Threshold
Search latency p95Histogram< 400ms> 1s
Zero-result query rateGauge< 5%> 10%
Documents indexed per runCounterStable +/-5%Drop > 20%
Connector sync errorsCounter0> 3 per hour
Stale content ratioGauge< 10%> 25% (>30 days old)
Indexing throughputGauge> 1000 docs/min< 500 docs/min

Instrumentation

async function trackGleanSearch(query: string, client: GleanClient) {
  const start = Date.now();
  try {
    const results = await client.search({ query });
    const latency = Date.now() - start;
    metrics.histogram('glean.search.latency', latency);
    metrics.increment('glean.search.total');
    if (results.totalCount === 0) metrics.increment('glean.search.zero_results');
    return results;
  } catch (err) {
    metrics.increment('glean.search.errors', { error: err.code });
    throw err;
  }
}

Health Check Dashboard

async function gleanHealth(): Promise<Record<string, string>> {
  const connectors = await gleanAdmin.getConnectorStatus();
  const staleRatio = await gleanAdmin.getStaleContentRatio(30);
  const searchP95 = await metrics.query('glean.search.latency', 'p95', '5m');
  return {
    connectors: connectors.every(c => c.status === 'ok') ? 'healthy' : 'degraded',
    content_freshness: staleRatio < 0.1 ? 'healthy' : 'stale',
    search_latency: searchP95 < 400 ? 'healthy' : 'slow',
  };
}

Alerting Rules

const alerts = [
  { metric: 'glean.search.latency_p95', condition: '> 1000ms', window: '10m', severity: 'warning' },
  { metric: 'glean.search.zero_result_rate', condition: '> 0.10', window: '1h', severity: 'warning' },
  { metric: 'glean.indexing.sync_errors', condition: '> 3', window: '1h', severity: 'critical' },
  { metric: 'glean.indexing.doc_count_delta', condition: 'drop > 20%', window: '1d', severity: 'critical' },
];

Structured Logging

function logGleanEvent(event: string, data: Record<string, any>) {
  console.log(JSON.stringify({
    service: 'glean', event,
    connector: data.connector, doc_count: data.docCount,
    query: data.query ? data.query.substring(0, 100) : undefined,
    latency_ms: data.latency, result_count: data.resultCount,
    timestamp: new Date().toISOString(),
  }));
}

Error Handling

SignalMeaningAction
Connector sync failureSource API down or creds expiredCheck connector config, rotate tokens
Zero-result spikeMissing content or bad query parsingAudit indexed sources, check synonyms
Indexing doc count dropSource deletion or API pagination bugCompare source counts, review API logs
Search latency > 1sOverloaded cluster or complex queriesCheck Glean status page, review query patterns

Resources

Next Steps

See glean-incident-runbook.

信息
分类 编程开发
名称 glean-observability
版本 v20260423
大小 4.05KB
更新时间 2026-04-28
语言