{"type": "excalidraw", "version": 2, "source": "generated", "elements": [{"id": "XmonvqdLTb71RNHOJGwI", "type": "frame", "x": 390, "y": 30, "width": 2880, "height": 1057, "angle": 0, "strokeColor": "#bbb", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 1, "strokeStyle": "solid", "roughness": 0, "opacity": 100, "groupIds": [], "frameId": null, "index": "a0000", "roundness": null, "seed": 1347871629, "version": 1, "versionNonce": 726279855, "isDeleted": false, "boundElements": [], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false, "name": "System diagram"}, {"id": "Hv0rFvz8gBnv9uLATBkA", "type": "text", "x": -760, "y": -40, "width": 883.3000000000001, "height": 27.5, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": null, "index": "a0001", "roundness": null, "seed": 1752604882, "version": 1, "versionNonce": 843537087, "isDeleted": false, "boundElements": [], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false, "text": "Analytics dashboard for an AI chat app: one output topic, three consumers", "fontSize": 22, "baseFontSize": null, "fontFamily": 5, "textAlign": "left", "verticalAlign": "top", "containerId": null, "originalText": "Analytics dashboard for an AI chat app: one output topic, three consumers", "autoResize": true, "lineHeight": 1.25}, {"id": "HArUY7DitsRDY03T31qQ", "type": "text", "x": -760, "y": 20, "width": 662.2, "height": 122.5, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": null, "index": "a0002", "roundness": null, "seed": 297494815, "version": 1, "versionNonce": 1708795964, "isDeleted": false, "boundElements": [], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false, "text": "Requirements (ask first)\n- three metrics per persona? freshness per persona (s / min / day)?\n- DAU and messages per user? may we store chat content (no)?\n- retention: warm 360 d, cold beyond? GDPR erasure SLA? HIPAA for Support?\nEngineering: per-model p50/p99, error rate, model usage, queue depth, GPU util, alerts\nProduct: DAU/WAU, session length, retention, thumbs, revenue by plan\nSupport: per-user timeline of sessions and errors, never the content", "fontSize": 14, "baseFontSize": null, "fontFamily": 5, "textAlign": "left", "verticalAlign": "top", "containerId": null, "originalText": "Requirements (ask first)\n- three metrics per persona? freshness per persona (s / min / day)?\n- DAU and messages per user? may we store chat content (no)?\n- retention: warm 360 d, cold beyond? GDPR erasure SLA? HIPAA for Support?\nEngineering: per-model p50/p99, error rate, model usage, queue depth, GPU util, alerts\nProduct: DAU/WAU, session length, retention, thumbs, revenue by plan\nSupport: per-user timeline of sessions and errors, never the content", "autoResize": true, "lineHeight": 1.25}, {"id": "kMArMjU08NTPPaUyzIBr", "type": "text", "x": -760, "y": 170.5, "width": 631.4000000000001, "height": 105.0, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": null, "index": "a0003", "roundness": null, "seed": 40744656, "version": 1, "versionNonce": 207529024, "isDeleted": false, "boundElements": [], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false, "text": "Technical challenges\n- isolation: analytics never degrades chat (fire-and-forget, drop analytics first)\n- freshness 1-5 s for health; <50 ms only on the hot query path\n- privacy: no content, tokenised identity, erasure keeps aggregates\n- 30M DAU x 20 msgs x 5 events = 3B/day = 35k/s avg, 150k/s peak, ~1 TB/day\n- cardinality: model x region x plan x client version; retention cost", "fontSize": 14, "baseFontSize": null, "fontFamily": 5, "textAlign": "left", "verticalAlign": "top", "containerId": null, "originalText": "Technical challenges\n- isolation: analytics never degrades chat (fire-and-forget, drop analytics first)\n- freshness 1-5 s for health; <50 ms only on the hot query path\n- privacy: no content, tokenised identity, erasure keeps aggregates\n- 30M DAU x 20 msgs x 5 events = 3B/day = 35k/s avg, 150k/s peak, ~1 TB/day\n- cardinality: model x region x plan x client version; retention cost", "autoResize": true, "lineHeight": 1.25}, {"id": "SVtaM26FakBoblEhgkcW", "type": "text", "x": -760, "y": 303.5, "width": 631.4000000000001, "height": 175.0, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": null, "index": "a0004", "roundness": null, "seed": 959268664, "version": 1, "versionNonce": 866561460, "isDeleted": false, "boundElements": [], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false, "text": "Core entities\nEvent(event_id UUIDv7, type, schema_version, ts_event, ts_ingest, source,\n      session_id, user_token, request_id, model, region, plan, client_version,\n      measures{latency_ms, tokens_in/out, status}, attributes{}, sensitivity tags)\nSession(session_id, user_token, start, end, client, origin)\nPrivacyToken(user_id -> token, key, created_at, revoked_at)\nRollup(metric, window 1s|1m|1h|1d, dims, count, sum, p50, p99 sketch, watermark)\nDashboard(id, audience, widgets[])   AlertRule(id, metric, condition, window,\n      group_by, tier nrt|fast|slow, channel, escalation)\nNot entities: the chat message, the GPU (a dimension)", "fontSize": 14, "baseFontSize": null, "fontFamily": 5, "textAlign": "left", "verticalAlign": "top", "containerId": null, "originalText": "Core entities\nEvent(event_id UUIDv7, type, schema_version, ts_event, ts_ingest, source,\n      session_id, user_token, request_id, model, region, plan, client_version,\n      measures{latency_ms, tokens_in/out, status}, attributes{}, sensitivity tags)\nSession(session_id, user_token, start, end, client, origin)\nPrivacyToken(user_id -> token, key, created_at, revoked_at)\nRollup(metric, window 1s|1m|1h|1d, dims, count, sum, p50, p99 sketch, watermark)\nDashboard(id, audience, widgets[])   AlertRule(id, metric, condition, window,\n      group_by, tier nrt|fast|slow, channel, escalation)\nNot entities: the chat message, the GPU (a dimension)", "autoResize": true, "lineHeight": 1.25}, {"id": "m1H6oZahRpoz83zJkzhd", "type": "text", "x": -760, "y": 506.5, "width": 531.3000000000001, "height": 122.5, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": null, "index": "a0005", "roundness": null, "seed": 1764013660, "version": 1, "versionNonce": 2147323291, "isDeleted": false, "boundElements": [], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false, "text": "API\nPOST /v1/events (batch, fire-and-forget, 202, idempotent on event_id)\nGET /v1/metrics?metric&dims&window&from&to -> rollups (cached)\nGET /v1/sessions/{id}/timeline (Support, RBAC, no content)\nPOST /v1/dashboards   POST /v1/alerts\nDELETE /v1/users/{id}/privacy-token (GDPR erasure = shred the key)\ninternal: GET /schemas/{type}/{version}; evaluator reads rollups", "fontSize": 14, "baseFontSize": null, "fontFamily": 5, "textAlign": "left", "verticalAlign": "top", "containerId": null, "originalText": "API\nPOST /v1/events (batch, fire-and-forget, 202, idempotent on event_id)\nGET /v1/metrics?metric&dims&window&from&to -> rollups (cached)\nGET /v1/sessions/{id}/timeline (Support, RBAC, no content)\nPOST /v1/dashboards   POST /v1/alerts\nDELETE /v1/users/{id}/privacy-token (GDPR erasure = shred the key)\ninternal: GET /schemas/{type}/{version}; evaluator reads rollups", "autoResize": true, "lineHeight": 1.25}, {"id": "WbuikMzFfmDcZKYB1Fvk", "type": "text", "x": -760, "y": 657.0, "width": 616.0, "height": 87.5, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": null, "index": "a0006", "roundness": null, "seed": 1957485970, "version": 1, "versionNonce": 227365513, "isDeleted": false, "boundElements": [], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false, "text": "What breaks first\n- analytics on the chat request path -> emit async, local buffer, drop analytics\n- slow ad-hoc scan stalls the on-call dashboard -> workload isolation\n- one bad client version 10x events -> per-source quotas, sampling, quarantine\n- erasure by deleting rows -> aggregates vanish; shred the token key instead", "fontSize": 14, "baseFontSize": null, "fontFamily": 5, "textAlign": "left", "verticalAlign": "top", "containerId": null, "originalText": "What breaks first\n- analytics on the chat request path -> emit async, local buffer, drop analytics\n- slow ad-hoc scan stalls the on-call dashboard -> workload isolation\n- one bad client version 10x events -> per-source quotas, sampling, quarantine\n- erasure by deleting rows -> aggregates vanish; shred the token key instead", "autoResize": true, "lineHeight": 1.25}, {"id": "N5TQd5onl1kmXtwjlYA5", "type": "rectangle", "x": 420, "y": 240, "width": 300, "height": 104, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "#f3f4f6", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0007", "roundness": {"type": 3}, "seed": 1073748261, "version": 1, "versionNonce": 1081315664, "isDeleted": false, "boundElements": [{"type": "text", "id": "HtCmhkKIOeYg3mc9ZWVt"}, {"type": "arrow", "id": "6vI9e64PRBIFbSm4qxbM"}, {"type": "arrow", "id": "xQc59uEbB61IJXKQxcSr"}], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false}, {"id": "HtCmhkKIOeYg3mc9ZWVt", "type": "text", "x": 430, "y": 265.75, "width": 280, "height": 52.5, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0008", "roundness": null, "seed": 290346456, "version": 1, "versionNonce": 1230983126, "isDeleted": false, "boundElements": [], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false, "text": "Event sources\ngateway \u00b7 orchestrator \u00b7 inference\nclient SDK \u00b7 infra agents (GPU, queues)", "fontSize": 14, "baseFontSize": null, "fontFamily": 5, "textAlign": "center", "verticalAlign": "middle", "containerId": "N5TQd5onl1kmXtwjlYA5", "originalText": "Event sources\ngateway \u00b7 orchestrator \u00b7 inference\nclient SDK \u00b7 infra agents (GPU, queues)", "autoResize": true, "lineHeight": 1.25}, {"id": "NN0vTAhQr0MHiGRFBtnB", "type": "rectangle", "x": 940, "y": 240, "width": 300, "height": 104, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "#dbeafe", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0009", "roundness": {"type": 3}, "seed": 899243749, "version": 1, "versionNonce": 911639389, "isDeleted": false, "boundElements": [{"type": "text", "id": "yxFZm6CwFGIpToonpmN9"}, {"type": "arrow", "id": "6vI9e64PRBIFbSm4qxbM"}, {"type": "arrow", "id": "9FIGcJ6UvsJMVDVLeUsV"}], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false}, {"id": "yxFZm6CwFGIpToonpmN9", "type": "text", "x": 950, "y": 265.75, "width": 280, "height": 52.5, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0010", "roundness": null, "seed": 181596386, "version": 1, "versionNonce": 457473535, "isDeleted": false, "boundElements": [], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false, "text": "Collector (per region)\nbuffer 5\u201310 ms, batch, validate lightly\nbackpressure: drop analytics, never chat", "fontSize": 14, "baseFontSize": null, "fontFamily": 5, "textAlign": "center", "verticalAlign": "middle", "containerId": "NN0vTAhQr0MHiGRFBtnB", "originalText": "Collector (per region)\nbuffer 5\u201310 ms, batch, validate lightly\nbackpressure: drop analytics, never chat", "autoResize": true, "lineHeight": 1.25}, {"id": "3AiqTRNyJefXgMskW2tj", "type": "rectangle", "x": 1460, "y": 240, "width": 300, "height": 104, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "#ede9fe", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0011", "roundness": {"type": 3}, "seed": 1979852483, "version": 1, "versionNonce": 693638970, "isDeleted": false, "boundElements": [{"type": "text", "id": "g7bFka9QRVWLPtgTTTOf"}, {"type": "arrow", "id": "9FIGcJ6UvsJMVDVLeUsV"}, {"type": "arrow", "id": "xAp1jP2ZnkDgCTznzFIe"}, {"type": "arrow", "id": "JdMaujnzYneFSTRaHRIx"}], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false}, {"id": "g7bFka9QRVWLPtgTTTOf", "type": "text", "x": 1470, "y": 265.75, "width": 280, "height": 52.5, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0012", "roundness": null, "seed": 1201941312, "version": 1, "versionNonce": 368917497, "isDeleted": false, "boundElements": [], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false, "text": "Ingest topic (Kafka)\nraw events, partition by session_id\nacks=1 \u00b7 replayable \u00b7 7 d", "fontSize": 14, "baseFontSize": null, "fontFamily": 5, "textAlign": "center", "verticalAlign": "middle", "containerId": "3AiqTRNyJefXgMskW2tj", "originalText": "Ingest topic (Kafka)\nraw events, partition by session_id\nacks=1 \u00b7 replayable \u00b7 7 d", "autoResize": true, "lineHeight": 1.25}, {"id": "UQJIHWXBP68QoVmLYa6w", "type": "rectangle", "x": 1980, "y": 240, "width": 300, "height": 110, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "#ffedd5", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0013", "roundness": {"type": 3}, "seed": 513473836, "version": 1, "versionNonce": 1100326025, "isDeleted": false, "boundElements": [{"type": "text", "id": "KRoBL87g6XnmFrtzHHcA"}, {"type": "arrow", "id": "xAp1jP2ZnkDgCTznzFIe"}, {"type": "arrow", "id": "WSYt6uw60EEiv5ri5js3"}, {"type": "arrow", "id": "Kv9JjcWmaMVJB1HmlDgZ"}], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false}, {"id": "KRoBL87g6XnmFrtzHHcA", "type": "text", "x": 1990, "y": 260.0, "width": 280, "height": 70.0, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0014", "roundness": null, "seed": 956274209, "version": 1, "versionNonce": 1371065736, "isDeleted": false, "boundElements": [], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false, "text": "Stream processor (Flink)\nschema check \u00b7 dedupe on event_id\n1 s + 1 min rollups, p99 sketches\nwatermarks for late events", "fontSize": 14, "baseFontSize": null, "fontFamily": 5, "textAlign": "center", "verticalAlign": "middle", "containerId": "UQJIHWXBP68QoVmLYa6w", "originalText": "Stream processor (Flink)\nschema check \u00b7 dedupe on event_id\n1 s + 1 min rollups, p99 sketches\nwatermarks for late events", "autoResize": true, "lineHeight": 1.25}, {"id": "iivpZc5LTqFnVHqtbfK9", "type": "rectangle", "x": 1460, "y": 60, "width": 300, "height": 84, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "#dcfce7", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0015", "roundness": {"type": 3}, "seed": 861388080, "version": 1, "versionNonce": 1429320608, "isDeleted": false, "boundElements": [{"type": "text", "id": "eoZ3pjkbqwIQ67VqNVfP"}, {"type": "arrow", "id": "WSYt6uw60EEiv5ri5js3"}], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false}, {"id": "eoZ3pjkbqwIQ67VqNVfP", "type": "text", "x": 1470, "y": 75.75, "width": 280, "height": 52.5, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0016", "roundness": null, "seed": 655468740, "version": 1, "versionNonce": 121192252, "isDeleted": false, "boundElements": [], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false, "text": "Schema registry\nevent types, versions,\nsensitivity tags per field", "fontSize": 14, "baseFontSize": null, "fontFamily": 5, "textAlign": "center", "verticalAlign": "middle", "containerId": "iivpZc5LTqFnVHqtbfK9", "originalText": "Schema registry\nevent types, versions,\nsensitivity tags per field", "autoResize": true, "lineHeight": 1.25}, {"id": "0SLE0b5woaXbZo8L9dv9", "type": "rectangle", "x": 420, "y": 60, "width": 300, "height": 84, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "#dcfce7", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0017", "roundness": {"type": 3}, "seed": 161173752, "version": 1, "versionNonce": 565024613, "isDeleted": false, "boundElements": [{"type": "text", "id": "swDPxwuxQ3Ir7rRTFquT"}, {"type": "arrow", "id": "xQc59uEbB61IJXKQxcSr"}], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false}, {"id": "swDPxwuxQ3Ir7rRTFquT", "type": "text", "x": 430, "y": 75.75, "width": 280, "height": 52.5, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0018", "roundness": null, "seed": 775993213, "version": 1, "versionNonce": 1929819408, "isDeleted": false, "boundElements": [], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false, "text": "Privacy token vault\nuser_id \u2192 token, per-user key\nerasure = delete the key", "fontSize": 14, "baseFontSize": null, "fontFamily": 5, "textAlign": "center", "verticalAlign": "middle", "containerId": "0SLE0b5woaXbZo8L9dv9", "originalText": "Privacy token vault\nuser_id \u2192 token, per-user key\nerasure = delete the key", "autoResize": true, "lineHeight": 1.25}, {"id": "pbvsE55GpvGSt9kNn0P5", "type": "rectangle", "x": 1980, "y": 460, "width": 300, "height": 104, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "#ede9fe", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0019", "roundness": {"type": 3}, "seed": 184541703, "version": 1, "versionNonce": 566115375, "isDeleted": false, "boundElements": [{"type": "text", "id": "882avhA0ZJudPtzcZjmC"}, {"type": "arrow", "id": "Kv9JjcWmaMVJB1HmlDgZ"}, {"type": "arrow", "id": "9TiduYQPELhqym28GuTl"}, {"type": "arrow", "id": "vXkX81Vdken577G9YPb9"}, {"type": "arrow", "id": "maZq2fdlqM981gmvYyb6"}], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false}, {"id": "882avhA0ZJudPtzcZjmC", "type": "text", "x": 1990, "y": 485.75, "width": 280, "height": 52.5, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0020", "roundness": null, "seed": 549552627, "version": 1, "versionNonce": 1988085397, "isDeleted": false, "boundElements": [], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false, "text": "Output topic (Kafka)\nrollups + enriched events\none seam, three independent consumers", "fontSize": 14, "baseFontSize": null, "fontFamily": 5, "textAlign": "center", "verticalAlign": "middle", "containerId": "pbvsE55GpvGSt9kNn0P5", "originalText": "Output topic (Kafka)\nrollups + enriched events\none seam, three independent consumers", "autoResize": true, "lineHeight": 1.25}, {"id": "x3GaFR4P9UIW63l5HURj", "type": "rectangle", "x": 1460, "y": 460, "width": 300, "height": 104, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "#ffedd5", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0021", "roundness": {"type": 3}, "seed": 103043522, "version": 1, "versionNonce": 16728944, "isDeleted": false, "boundElements": [{"type": "text", "id": "ndHHdP7IuEwHUUp79AAu"}, {"type": "arrow", "id": "9TiduYQPELhqym28GuTl"}, {"type": "arrow", "id": "U16IxALUR1VzrmuLM64i"}, {"type": "arrow", "id": "vaLmj8WV1wgg3nZ3iL3C"}], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false}, {"id": "ndHHdP7IuEwHUUp79AAu", "type": "text", "x": 1470, "y": 485.75, "width": 280, "height": 52.5, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0022", "roundness": null, "seed": 138275352, "version": 1, "versionNonce": 1514652656, "isDeleted": false, "boundElements": [], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false, "text": "Real-time consumer\nlatest rollups in memory\n\u2192 dashboard API for WebSocket push", "fontSize": 14, "baseFontSize": null, "fontFamily": 5, "textAlign": "center", "verticalAlign": "middle", "containerId": "x3GaFR4P9UIW63l5HURj", "originalText": "Real-time consumer\nlatest rollups in memory\n\u2192 dashboard API for WebSocket push", "autoResize": true, "lineHeight": 1.25}, {"id": "RzqNcEqmX2uVj2J27BJ2", "type": "rectangle", "x": 940, "y": 460, "width": 300, "height": 104, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "#ffedd5", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0023", "roundness": {"type": 3}, "seed": 1391635890, "version": 1, "versionNonce": 441897666, "isDeleted": false, "boundElements": [{"type": "text", "id": "wzrdzeTaLgtMF1reMJfn"}, {"type": "arrow", "id": "U16IxALUR1VzrmuLM64i"}, {"type": "arrow", "id": "WWBtsb7u4NJfLWEgw0nd"}, {"type": "arrow", "id": "d6MgJfr0D7VAb68Yxjk1"}], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false}, {"id": "wzrdzeTaLgtMF1reMJfn", "type": "text", "x": 950, "y": 485.75, "width": 280, "height": 52.5, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0024", "roundness": null, "seed": 1558710008, "version": 1, "versionNonce": 717497112, "isDeleted": false, "boundElements": [], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false, "text": "Dashboard API\npush live values \u00b7 serve history\nfrom the DB \u00b7 RBAC by audience \u00b7 audit", "fontSize": 14, "baseFontSize": null, "fontFamily": 5, "textAlign": "center", "verticalAlign": "middle", "containerId": "RzqNcEqmX2uVj2J27BJ2", "originalText": "Dashboard API\npush live values \u00b7 serve history\nfrom the DB \u00b7 RBAC by audience \u00b7 audit", "autoResize": true, "lineHeight": 1.25}, {"id": "wmQMPTqyrScEjpxLTMqO", "type": "rectangle", "x": 420, "y": 460, "width": 300, "height": 104, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "#f3f4f6", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0025", "roundness": {"type": 3}, "seed": 124171808, "version": 1, "versionNonce": 827205033, "isDeleted": false, "boundElements": [{"type": "text", "id": "fQra2HhpCoKRTre7W8xD"}, {"type": "arrow", "id": "WWBtsb7u4NJfLWEgw0nd"}], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false}, {"id": "fQra2HhpCoKRTre7W8xD", "type": "text", "x": 430, "y": 485.75, "width": 280, "height": 52.5, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0026", "roundness": null, "seed": 2000741177, "version": 1, "versionNonce": 711171409, "isDeleted": false, "boundElements": [], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false, "text": "Dashboards\nEngineering \u00b7 Product \u00b7 Support\n(timeline, no content)", "fontSize": 14, "baseFontSize": null, "fontFamily": 5, "textAlign": "center", "verticalAlign": "middle", "containerId": "wmQMPTqyrScEjpxLTMqO", "originalText": "Dashboards\nEngineering \u00b7 Product \u00b7 Support\n(timeline, no content)", "autoResize": true, "lineHeight": 1.25}, {"id": "vNmn1cpp8LqAAqEnOyzn", "type": "ellipse", "x": 1420, "y": 680, "width": 380, "height": 110, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "#dcfce7", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0027", "roundness": {"type": 2}, "seed": 1870572840, "version": 1, "versionNonce": 1865644725, "isDeleted": false, "boundElements": [{"type": "text", "id": "EMvAYjIPPsSWd60omV5C"}, {"type": "arrow", "id": "vXkX81Vdken577G9YPb9"}, {"type": "arrow", "id": "d6MgJfr0D7VAb68Yxjk1"}, {"type": "arrow", "id": "3N0tX7XSoYuZr6gGHuup"}], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false}, {"id": "EMvAYjIPPsSWd60omV5C", "type": "text", "x": 1430, "y": 706.875, "width": 360, "height": 56.25, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0028", "roundness": null, "seed": 1798293049, "version": 1, "versionNonce": 1472636800, "isDeleted": false, "boundElements": [], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false, "text": "DB writer consumer \u2192 hot store (ClickHouse)\nrollups 7\u201330 d, raw 24 h\nfilter, sort, history queries", "fontSize": 15, "baseFontSize": null, "fontFamily": 5, "textAlign": "center", "verticalAlign": "middle", "containerId": "vNmn1cpp8LqAAqEnOyzn", "originalText": "DB writer consumer \u2192 hot store (ClickHouse)\nrollups 7\u201330 d, raw 24 h\nfilter, sort, history queries", "autoResize": true, "lineHeight": 1.25}, {"id": "cgUKbtPuQRgd86GG2yjV", "type": "ellipse", "x": 1940, "y": 680, "width": 380, "height": 110, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "#dcfce7", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0029", "roundness": {"type": 2}, "seed": 1971475405, "version": 1, "versionNonce": 800171428, "isDeleted": false, "boundElements": [{"type": "text", "id": "AxFc3l7pPILGNpotf8I4"}, {"type": "arrow", "id": "maZq2fdlqM981gmvYyb6"}, {"type": "arrow", "id": "JdMaujnzYneFSTRaHRIx"}, {"type": "arrow", "id": "KvispyIHGyJ2EJTkwiSx"}], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false}, {"id": "AxFc3l7pPILGNpotf8I4", "type": "text", "x": 1950, "y": 706.875, "width": 360, "height": 56.25, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0030", "roundness": null, "seed": 1896554255, "version": 1, "versionNonce": 216050198, "isDeleted": false, "boundElements": [], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false, "text": "Cold writer consumer \u2192 lake (Iceberg)\nraw from the ingest topic + rollups\nwarm 360 d, cold beyond, on demand", "fontSize": 15, "baseFontSize": null, "fontFamily": 5, "textAlign": "center", "verticalAlign": "middle", "containerId": "cgUKbtPuQRgd86GG2yjV", "originalText": "Cold writer consumer \u2192 lake (Iceberg)\nraw from the ingest topic + rollups\nwarm 360 d, cold beyond, on demand", "autoResize": true, "lineHeight": 1.25}, {"id": "2YfkAOZ1aHbNrzVan9Bi", "type": "rectangle", "x": 940, "y": 690, "width": 300, "height": 110, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "#fef9c3", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0031", "roundness": {"type": 3}, "seed": 900364738, "version": 1, "versionNonce": 84870783, "isDeleted": false, "boundElements": [{"type": "text", "id": "RiyeccZgJQT8icH3s5JG"}, {"type": "arrow", "id": "3N0tX7XSoYuZr6gGHuup"}, {"type": "arrow", "id": "vaLmj8WV1wgg3nZ3iL3C"}], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false}, {"id": "RiyeccZgJQT8icH3s5JG", "type": "text", "x": 950, "y": 710.0, "width": 280, "height": 70.0, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0032", "roundness": null, "seed": 2104902743, "version": 1, "versionNonce": 1359080171, "isDeleted": false, "boundElements": [], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false, "text": "Alert evaluator, one per tier\n<10 s: real-time consumer \u2192 pager\n<60 s: hot store every 15 s \u2192 chat\n<1 day: batch on the lake \u2192 email/ticket", "fontSize": 14, "baseFontSize": null, "fontFamily": 5, "textAlign": "center", "verticalAlign": "middle", "containerId": "2YfkAOZ1aHbNrzVan9Bi", "originalText": "Alert evaluator, one per tier\n<10 s: real-time consumer \u2192 pager\n<60 s: hot store every 15 s \u2192 chat\n<1 day: batch on the lake \u2192 email/ticket", "autoResize": true, "lineHeight": 1.25}, {"id": "8ulasCJ8FgT1WV5tS1RN", "type": "rectangle", "x": 420, "y": 690, "width": 300, "height": 110, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "#fef9c3", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0033", "roundness": {"type": 3}, "seed": 854563774, "version": 1, "versionNonce": 1721816568, "isDeleted": false, "boundElements": [{"type": "text", "id": "rgqPf9YAHo7qMWdZ0PZl"}, {"type": "arrow", "id": "KvispyIHGyJ2EJTkwiSx"}], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false}, {"id": "rgqPf9YAHo7qMWdZ0PZl", "type": "text", "x": 430, "y": 710.0, "width": 280, "height": 70.0, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0034", "roundness": null, "seed": 117865535, "version": 1, "versionNonce": 2144446369, "isDeleted": false, "boundElements": [], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false, "text": "Compliance module\nscans the lake for non-compliant fields\ngates writes past warm retention\ntickets + deletion workflow", "fontSize": 14, "baseFontSize": null, "fontFamily": 5, "textAlign": "center", "verticalAlign": "middle", "containerId": "8ulasCJ8FgT1WV5tS1RN", "originalText": "Compliance module\nscans the lake for non-compliant fields\ngates writes past warm retention\ntickets + deletion workflow", "autoResize": true, "lineHeight": 1.25}, {"id": "6vI9e64PRBIFbSm4qxbM", "type": "arrow", "x": 720, "y": 292.0, "width": 220, "height": 1, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0035", "roundness": null, "seed": 580753731, "version": 1, "versionNonce": 1832545167, "isDeleted": false, "boundElements": [], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false, "points": [[0, 0], [220, 0.0]], "startBinding": {"elementId": "N5TQd5onl1kmXtwjlYA5", "mode": "orbit", "fixedPoint": [1, 0.5]}, "endBinding": {"elementId": "NN0vTAhQr0MHiGRFBtnB", "mode": "orbit", "fixedPoint": [0, 0.5]}, "startArrowhead": null, "endArrowhead": "arrow", "elbowed": false}, {"id": "ZhWC8o3Sbu71zaclriAH", "type": "text", "x": 740, "y": 266.0, "width": 257.40000000000003, "height": 16.25, "angle": 0, "strokeColor": "#374151", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0036", "roundness": null, "seed": 1563123696, "version": 1, "versionNonce": 2136060994, "isDeleted": false, "boundElements": [], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false, "text": "1 events, async (token, not user_id)", "fontSize": 13, "baseFontSize": null, "fontFamily": 5, "textAlign": "left", "verticalAlign": "top", "containerId": null, "originalText": "1 events, async (token, not user_id)", "autoResize": true, "lineHeight": 1.25}, {"id": "9FIGcJ6UvsJMVDVLeUsV", "type": "arrow", "x": 1240, "y": 292.0, "width": 220, "height": 1, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0037", "roundness": null, "seed": 976408017, "version": 1, "versionNonce": 1185704655, "isDeleted": false, "boundElements": [], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false, "points": [[0, 0], [220, 0.0]], "startBinding": {"elementId": "NN0vTAhQr0MHiGRFBtnB", "mode": "orbit", "fixedPoint": [1, 0.5]}, "endBinding": {"elementId": "3AiqTRNyJefXgMskW2tj", "mode": "orbit", "fixedPoint": [0, 0.5]}, "startArrowhead": null, "endArrowhead": "arrow", "elbowed": false}, {"id": "m5TIJaLSTiThlj2nnoa6", "type": "text", "x": 1260, "y": 266.0, "width": 64.35000000000001, "height": 16.25, "angle": 0, "strokeColor": "#374151", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0038", "roundness": null, "seed": 1281586341, "version": 1, "versionNonce": 1849185486, "isDeleted": false, "boundElements": [], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false, "text": "2 batches", "fontSize": 13, "baseFontSize": null, "fontFamily": 5, "textAlign": "left", "verticalAlign": "top", "containerId": null, "originalText": "2 batches", "autoResize": true, "lineHeight": 1.25}, {"id": "xAp1jP2ZnkDgCTznzFIe", "type": "arrow", "x": 1760, "y": 292.0, "width": 220, "height": 3.0, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0039", "roundness": null, "seed": 993175187, "version": 1, "versionNonce": 1135107854, "isDeleted": false, "boundElements": [], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false, "points": [[0, 0], [220, 3.0]], "startBinding": {"elementId": "3AiqTRNyJefXgMskW2tj", "mode": "orbit", "fixedPoint": [1, 0.5]}, "endBinding": {"elementId": "UQJIHWXBP68QoVmLYa6w", "mode": "orbit", "fixedPoint": [0, 0.5]}, "startArrowhead": null, "endArrowhead": "arrow", "elbowed": false}, {"id": "kvaUaHZXmpxzjrmqOxzy", "type": "text", "x": 1780, "y": 266.0, "width": 64.35000000000001, "height": 16.25, "angle": 0, "strokeColor": "#374151", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0040", "roundness": null, "seed": 1361680870, "version": 1, "versionNonce": 1329487241, "isDeleted": false, "boundElements": [], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false, "text": "3 consume", "fontSize": 13, "baseFontSize": null, "fontFamily": 5, "textAlign": "left", "verticalAlign": "top", "containerId": null, "originalText": "3 consume", "autoResize": true, "lineHeight": 1.25}, {"id": "WSYt6uw60EEiv5ri5js3", "type": "arrow", "x": 1610.0, "y": 144, "width": 480.0, "height": 96, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "dashed", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0041", "roundness": null, "seed": 1134400028, "version": 1, "versionNonce": 1441086700, "isDeleted": false, "boundElements": [], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false, "points": [[0, 0], [480.0, 96]], "startBinding": {"elementId": "iivpZc5LTqFnVHqtbfK9", "mode": "orbit", "fixedPoint": [0.5, 1]}, "endBinding": {"elementId": "UQJIHWXBP68QoVmLYa6w", "mode": "orbit", "fixedPoint": [0.36666666666666664, 0]}, "startArrowhead": null, "endArrowhead": "arrow", "elbowed": false}, {"id": "5deiwirOm8SFdStKE3xJ", "type": "text", "x": 1620.0, "y": 164, "width": 171.60000000000002, "height": 16.25, "angle": 0, "strokeColor": "#374151", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0042", "roundness": null, "seed": 668307064, "version": 1, "versionNonce": 1132044179, "isDeleted": false, "boundElements": [], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false, "text": "schema, sensitivity tags", "fontSize": 13, "baseFontSize": null, "fontFamily": 5, "textAlign": "left", "verticalAlign": "top", "containerId": null, "originalText": "schema, sensitivity tags", "autoResize": true, "lineHeight": 1.25}, {"id": "xQc59uEbB61IJXKQxcSr", "type": "arrow", "x": 570.0, "y": 144, "width": 40.0, "height": 96, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "dashed", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0043", "roundness": null, "seed": 1798411211, "version": 1, "versionNonce": 334482576, "isDeleted": false, "boundElements": [], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false, "points": [[0, 0], [-40.0, 96]], "startBinding": {"elementId": "0SLE0b5woaXbZo8L9dv9", "mode": "orbit", "fixedPoint": [0.5, 1]}, "endBinding": {"elementId": "N5TQd5onl1kmXtwjlYA5", "mode": "orbit", "fixedPoint": [0.36666666666666664, 0]}, "startArrowhead": null, "endArrowhead": "arrow", "elbowed": false}, {"id": "C08CN4P4tcCfW83EmefQ", "type": "text", "x": 580.0, "y": 164, "width": 100.10000000000001, "height": 16.25, "angle": 0, "strokeColor": "#374151", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0044", "roundness": null, "seed": 1575116619, "version": 1, "versionNonce": 119238562, "isDeleted": false, "boundElements": [], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false, "text": "token per user", "fontSize": 13, "baseFontSize": null, "fontFamily": 5, "textAlign": "left", "verticalAlign": "top", "containerId": null, "originalText": "token per user", "autoResize": true, "lineHeight": 1.25}, {"id": "Kv9JjcWmaMVJB1HmlDgZ", "type": "arrow", "x": 2130.0, "y": 350, "width": 1, "height": 110, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0045", "roundness": null, "seed": 296263308, "version": 1, "versionNonce": 877269771, "isDeleted": false, "boundElements": [], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false, "points": [[0, 0], [0.0, 110]], "startBinding": {"elementId": "UQJIHWXBP68QoVmLYa6w", "mode": "orbit", "fixedPoint": [0.5, 1]}, "endBinding": {"elementId": "pbvsE55GpvGSt9kNn0P5", "mode": "orbit", "fixedPoint": [0.5, 0]}, "startArrowhead": null, "endArrowhead": "arrow", "elbowed": false}, {"id": "rZ72UHsWC9QUIwP2dH4X", "type": "text", "x": 2142.0, "y": 372, "width": 250.25000000000003, "height": 16.25, "angle": 0, "strokeColor": "#374151", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0046", "roundness": null, "seed": 1425330976, "version": 1, "versionNonce": 1108593395, "isDeleted": false, "boundElements": [], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false, "text": "4 publish rollups + enriched events", "fontSize": 13, "baseFontSize": null, "fontFamily": 5, "textAlign": "left", "verticalAlign": "top", "containerId": null, "originalText": "4 publish rollups + enriched events", "autoResize": true, "lineHeight": 1.25}, {"id": "9TiduYQPELhqym28GuTl", "type": "arrow", "x": 1980, "y": 492.0, "width": 220, "height": 1, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0047", "roundness": null, "seed": 1457856564, "version": 1, "versionNonce": 327476360, "isDeleted": false, "boundElements": [], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false, "points": [[0, 0], [-220, 0.0]], "startBinding": {"elementId": "pbvsE55GpvGSt9kNn0P5", "mode": "orbit", "fixedPoint": [0, 0.3076923076923077]}, "endBinding": {"elementId": "x3GaFR4P9UIW63l5HURj", "mode": "orbit", "fixedPoint": [1, 0.3076923076923077]}, "startArrowhead": null, "endArrowhead": "arrow", "elbowed": false}, {"id": "symTPPcJXFSM5r23kOOh", "type": "text", "x": 1780, "y": 500.0, "width": 150.15, "height": 16.25, "angle": 0, "strokeColor": "#374151", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0048", "roundness": null, "seed": 1525474433, "version": 1, "versionNonce": 1431388490, "isDeleted": false, "boundElements": [], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false, "text": "5a real-time consumer", "fontSize": 13, "baseFontSize": null, "fontFamily": 5, "textAlign": "left", "verticalAlign": "top", "containerId": null, "originalText": "5a real-time consumer", "autoResize": true, "lineHeight": 1.25}, {"id": "U16IxALUR1VzrmuLM64i", "type": "arrow", "x": 1460, "y": 492.0, "width": 220, "height": 1, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0049", "roundness": null, "seed": 1912858459, "version": 1, "versionNonce": 2018384760, "isDeleted": false, "boundElements": [], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false, "points": [[0, 0], [-220, 0.0]], "startBinding": {"elementId": "x3GaFR4P9UIW63l5HURj", "mode": "orbit", "fixedPoint": [0, 0.3076923076923077]}, "endBinding": {"elementId": "RzqNcEqmX2uVj2J27BJ2", "mode": "orbit", "fixedPoint": [1, 0.3076923076923077]}, "startArrowhead": null, "endArrowhead": "arrow", "elbowed": false}, {"id": "tjuk57UEuGetxr3qHig0", "type": "text", "x": 1260, "y": 500.0, "width": 92.95, "height": 16.25, "angle": 0, "strokeColor": "#374151", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0050", "roundness": null, "seed": 769826472, "version": 1, "versionNonce": 1638646767, "isDeleted": false, "boundElements": [], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false, "text": "6 live values", "fontSize": 13, "baseFontSize": null, "fontFamily": 5, "textAlign": "left", "verticalAlign": "top", "containerId": null, "originalText": "6 live values", "autoResize": true, "lineHeight": 1.25}, {"id": "WWBtsb7u4NJfLWEgw0nd", "type": "arrow", "x": 940, "y": 492.0, "width": 220, "height": 1, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0051", "roundness": null, "seed": 789754367, "version": 1, "versionNonce": 543830740, "isDeleted": false, "boundElements": [], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false, "points": [[0, 0], [-220, 0.0]], "startBinding": {"elementId": "RzqNcEqmX2uVj2J27BJ2", "mode": "orbit", "fixedPoint": [0, 0.3076923076923077]}, "endBinding": {"elementId": "wmQMPTqyrScEjpxLTMqO", "mode": "orbit", "fixedPoint": [1, 0.3076923076923077]}, "startArrowhead": null, "endArrowhead": "arrow", "elbowed": false}, {"id": "pdi96fNyJ23pYMmEgSy2", "type": "text", "x": 740, "y": 500.0, "width": 114.4, "height": 16.25, "angle": 0, "strokeColor": "#374151", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0052", "roundness": null, "seed": 331345908, "version": 1, "versionNonce": 1167029720, "isDeleted": false, "boundElements": [], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false, "text": "7 WebSocket push", "fontSize": 13, "baseFontSize": null, "fontFamily": 5, "textAlign": "left", "verticalAlign": "top", "containerId": null, "originalText": "7 WebSocket push", "autoResize": true, "lineHeight": 1.25}, {"id": "vXkX81Vdken577G9YPb9", "type": "arrow", "x": 2070.0, "y": 564, "width": 400.0, "height": 116, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0053", "roundness": null, "seed": 1596532570, "version": 1, "versionNonce": 1068286154, "isDeleted": false, "boundElements": [], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false, "points": [[0, 0], [-400.0, 116]], "startBinding": {"elementId": "pbvsE55GpvGSt9kNn0P5", "mode": "orbit", "fixedPoint": [0.3, 1]}, "endBinding": {"elementId": "vNmn1cpp8LqAAqEnOyzn", "mode": "orbit", "fixedPoint": [0.6578947368421053, 0]}, "startArrowhead": null, "endArrowhead": "arrow", "elbowed": false}, {"id": "7ZI5hYUOWaqvXEXbqySq", "type": "text", "x": 1680.0, "y": 640, "width": 85.80000000000001, "height": 16.25, "angle": 0, "strokeColor": "#374151", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0054", "roundness": null, "seed": 1437460615, "version": 1, "versionNonce": 986327098, "isDeleted": false, "boundElements": [], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false, "text": "5b DB writer", "fontSize": 13, "baseFontSize": null, "fontFamily": 5, "textAlign": "left", "verticalAlign": "top", "containerId": null, "originalText": "5b DB writer", "autoResize": true, "lineHeight": 1.25}, {"id": "maZq2fdlqM981gmvYyb6", "type": "arrow", "x": 2170.0, "y": 564, "width": 40.0, "height": 116, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0055", "roundness": null, "seed": 292106707, "version": 1, "versionNonce": 91515377, "isDeleted": false, "boundElements": [], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false, "points": [[0, 0], [-40.0, 116]], "startBinding": {"elementId": "pbvsE55GpvGSt9kNn0P5", "mode": "orbit", "fixedPoint": [0.6333333333333333, 1]}, "endBinding": {"elementId": "cgUKbtPuQRgd86GG2yjV", "mode": "orbit", "fixedPoint": [0.5, 0]}, "startArrowhead": null, "endArrowhead": "arrow", "elbowed": false}, {"id": "HHwgQ1Y2gQoSNWhf328n", "type": "text", "x": 2140.0, "y": 584, "width": 100.10000000000001, "height": 16.25, "angle": 0, "strokeColor": "#374151", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0056", "roundness": null, "seed": 1274637096, "version": 1, "versionNonce": 675563383, "isDeleted": false, "boundElements": [], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false, "text": "5c cold writer", "fontSize": 13, "baseFontSize": null, "fontFamily": 5, "textAlign": "left", "verticalAlign": "top", "containerId": null, "originalText": "5c cold writer", "autoResize": true, "lineHeight": 1.25}, {"id": "JdMaujnzYneFSTRaHRIx", "type": "arrow", "x": 1780, "y": 327.0, "width": 530, "height": 378.0, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "dashed", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0057", "roundness": null, "seed": 395501829, "version": 1, "versionNonce": 1796051349, "isDeleted": false, "boundElements": [], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false, "points": [[0, 0], [570, 0.0], [570, 378.0], [530, 378.0]], "startBinding": {"elementId": "3AiqTRNyJefXgMskW2tj", "mode": "orbit", "fixedPoint": [1, 0.8365384615384616]}, "endBinding": {"elementId": "cgUKbtPuQRgd86GG2yjV", "mode": "orbit", "fixedPoint": [0.9736842105263158, 0.22727272727272727]}, "startArrowhead": null, "endArrowhead": "arrow", "elbowed": false}, {"id": "rfpqslcLu53AUj9mAOMe", "type": "text", "x": 2310, "y": 534, "width": 343.20000000000005, "height": 16.25, "angle": 0, "strokeColor": "#374151", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0058", "roundness": null, "seed": 631175333, "version": 1, "versionNonce": 1414783236, "isDeleted": false, "boundElements": [], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false, "text": "raw events \u2192 cold writer (from the ingest topic)", "fontSize": 13, "baseFontSize": null, "fontFamily": 5, "textAlign": "left", "verticalAlign": "top", "containerId": null, "originalText": "raw events \u2192 cold writer (from the ingest topic)", "autoResize": true, "lineHeight": 1.25}, {"id": "d6MgJfr0D7VAb68Yxjk1", "type": "arrow", "x": 1460, "y": 710.0, "width": 220, "height": 166.0, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "dashed", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0059", "roundness": null, "seed": 405311217, "version": 1, "versionNonce": 536070204, "isDeleted": false, "boundElements": [], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false, "points": [[0, 0], [-220, -166.0]], "startBinding": {"elementId": "vNmn1cpp8LqAAqEnOyzn", "mode": "orbit", "fixedPoint": [0.10526315789473684, 0.2727272727272727]}, "endBinding": {"elementId": "RzqNcEqmX2uVj2J27BJ2", "mode": "orbit", "fixedPoint": [1, 0.8076923076923077]}, "startArrowhead": null, "endArrowhead": "arrow", "elbowed": false}, {"id": "zpVzSwly7DzOTJt90UCP", "type": "text", "x": 1260, "y": 574, "width": 150.15, "height": 16.25, "angle": 0, "strokeColor": "#374151", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0060", "roundness": null, "seed": 1411545607, "version": 1, "versionNonce": 2081519978, "isDeleted": false, "boundElements": [], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false, "text": "history, filter, sort", "fontSize": 13, "baseFontSize": null, "fontFamily": 5, "textAlign": "left", "verticalAlign": "top", "containerId": null, "originalText": "history, filter, sort", "autoResize": true, "lineHeight": 1.25}, {"id": "3N0tX7XSoYuZr6gGHuup", "type": "arrow", "x": 1480, "y": 765.0, "width": 240, "height": 20.0, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "dashed", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0061", "roundness": null, "seed": 1337110216, "version": 1, "versionNonce": 1555269483, "isDeleted": false, "boundElements": [], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false, "points": [[0, 0], [-240, -20.0]], "startBinding": {"elementId": "vNmn1cpp8LqAAqEnOyzn", "mode": "orbit", "fixedPoint": [0.15789473684210525, 0.7727272727272727]}, "endBinding": {"elementId": "2YfkAOZ1aHbNrzVan9Bi", "mode": "orbit", "fixedPoint": [1, 0.5]}, "startArrowhead": null, "endArrowhead": "arrow", "elbowed": false}, {"id": "3pkkGHWo29MEZxN6V1eG", "type": "text", "x": 1260, "y": 753.0, "width": 92.95, "height": 16.25, "angle": 0, "strokeColor": "#374151", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0062", "roundness": null, "seed": 260251295, "version": 1, "versionNonce": 898336117, "isDeleted": false, "boundElements": [], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false, "text": "1-min rollups", "fontSize": 13, "baseFontSize": null, "fontFamily": 5, "textAlign": "left", "verticalAlign": "top", "containerId": null, "originalText": "1-min rollups", "autoResize": true, "lineHeight": 1.25}, {"id": "vaLmj8WV1wgg3nZ3iL3C", "type": "arrow", "x": 1480, "y": 564, "width": 290.0, "height": 126, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "dashed", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0063", "roundness": null, "seed": 615380635, "version": 1, "versionNonce": 1008620915, "isDeleted": false, "boundElements": [], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false, "points": [[0, 0], [-290.0, 126]], "startBinding": {"elementId": "x3GaFR4P9UIW63l5HURj", "mode": "orbit", "fixedPoint": [0.06666666666666667, 1]}, "endBinding": {"elementId": "2YfkAOZ1aHbNrzVan9Bi", "mode": "orbit", "fixedPoint": [0.8333333333333334, 0]}, "startArrowhead": null, "endArrowhead": "arrow", "elbowed": false}, {"id": "OU1ZHFFyQU5gmeyPOZ9I", "type": "text", "x": 1200.0, "y": 660, "width": 193.05, "height": 16.25, "angle": 0, "strokeColor": "#374151", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0064", "roundness": null, "seed": 1855144683, "version": 1, "versionNonce": 2037886911, "isDeleted": false, "boundElements": [], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false, "text": "<10 s tier reads the stream", "fontSize": 13, "baseFontSize": null, "fontFamily": 5, "textAlign": "left", "verticalAlign": "top", "containerId": null, "originalText": "<10 s tier reads the stream", "autoResize": true, "lineHeight": 1.25}, {"id": "KvispyIHGyJ2EJTkwiSx", "type": "arrow", "x": 1980, "y": 780, "width": 1260, "height": 5.0, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "dashed", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0065", "roundness": null, "seed": 1143581433, "version": 1, "versionNonce": 344440497, "isDeleted": false, "boundElements": [], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false, "points": [[0, 0], [0, 50], [-1220, 50], [-1220, -5.0], [-1260, -5.0]], "startBinding": {"elementId": "cgUKbtPuQRgd86GG2yjV", "mode": "orbit", "fixedPoint": [0.10526315789473684, 0.9090909090909091]}, "endBinding": {"elementId": "8ulasCJ8FgT1WV5tS1RN", "mode": "orbit", "fixedPoint": [1, 0.7727272727272727]}, "startArrowhead": null, "endArrowhead": "arrow", "elbowed": false}, {"id": "3OJgl0HnSdmaSdSpF7sr", "type": "text", "x": 740, "y": 781.0, "width": 28.6, "height": 16.25, "angle": 0, "strokeColor": "#374151", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0066", "roundness": null, "seed": 1832250940, "version": 1, "versionNonce": 1333425669, "isDeleted": false, "boundElements": [], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false, "text": "scan", "fontSize": 13, "baseFontSize": null, "fontFamily": 5, "textAlign": "left", "verticalAlign": "top", "containerId": null, "originalText": "scan", "autoResize": true, "lineHeight": 1.25}, {"id": "mE0QfNtwPMsCeqU7NA4O", "type": "text", "x": 420, "y": 840, "width": 2079.0, "height": 35.0, "angle": 0, "strokeColor": "#b91c1c", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0067", "roundness": null, "seed": 658944798, "version": 1, "versionNonce": 1363155902, "isDeleted": false, "boundElements": [], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false, "text": "Failure / probes: analytics on the chat path \u2192 async emit + local buffer, shed analytics first. Ad-hoc scan stalls on-call \u2192 workload isolation. Client version sends 10\u00d7 \u2192 per-source quota, sampling, quarantine. Erasure by row deletes kills trends \u2192 shred the token key.\nSupport must never see content \u2192 content is never emitted; timeline view behind RBAC with an audit log.", "fontSize": 14, "baseFontSize": null, "fontFamily": 5, "textAlign": "left", "verticalAlign": "top", "containerId": null, "originalText": "Failure / probes: analytics on the chat path \u2192 async emit + local buffer, shed analytics first. Ad-hoc scan stalls on-call \u2192 workload isolation. Client version sends 10\u00d7 \u2192 per-source quota, sampling, quarantine. Erasure by row deletes kills trends \u2192 shred the token key.\nSupport must never see content \u2192 content is never emitted; timeline view behind RBAC with an audit log.", "autoResize": true, "lineHeight": 1.25}, {"id": "eEykQZczP9YyFiPiUnUP", "type": "text", "x": 420, "y": 905, "width": 2156.0, "height": 17.5, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0068", "roundness": null, "seed": 134364867, "version": 1, "versionNonce": 394137897, "isDeleted": false, "boundElements": [], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false, "text": "Numbers to say: 30M DAU \u00b7 20 messages \u00b7 5 events \u2192 3B/day \u2192 35k/s average, 150k/s peak \u00b7 300 B/event \u2192 1 TB/day raw \u00b7 warm 360 d \u2248 360 TB raw, rollups GBs/day \u00b7 freshness 1\u20135 s end to end; <50 ms is the cached rollup query \u00b7 collector flush 5\u201310 ms \u00b7 Kafka acks=1 single-digit ms.", "fontSize": 14, "baseFontSize": null, "fontFamily": 5, "textAlign": "left", "verticalAlign": "top", "containerId": null, "originalText": "Numbers to say: 30M DAU \u00b7 20 messages \u00b7 5 events \u2192 3B/day \u2192 35k/s average, 150k/s peak \u00b7 300 B/event \u2192 1 TB/day raw \u00b7 warm 360 d \u2248 360 TB raw, rollups GBs/day \u00b7 freshness 1\u20135 s end to end; <50 ms is the cached rollup query \u00b7 collector flush 5\u201310 ms \u00b7 Kafka acks=1 single-digit ms.", "autoResize": true, "lineHeight": 1.25}, {"id": "CGo7SP1bV889MgyqRnm5", "type": "text", "x": 420, "y": 955, "width": 2071.3, "height": 17.5, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0069", "roundness": null, "seed": 1377202359, "version": 1, "versionNonce": 1229919730, "isDeleted": false, "boundElements": [], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false, "text": "Alert tiers: <10 s streaming on 1-s rollups \u2192 pager (p99 latency, error rate per model) \u00b7 <60 s 1-min rollups every 15 s \u2192 chat/on-call (GPU util, queue depth) \u00b7 <1 day batch on the lake \u2192 email/ticket (retention, revenue drift, cost). Dedupe, group, silence, escalate.", "fontSize": 14, "baseFontSize": null, "fontFamily": 5, "textAlign": "left", "verticalAlign": "top", "containerId": null, "originalText": "Alert tiers: <10 s streaming on 1-s rollups \u2192 pager (p99 latency, error rate per model) \u00b7 <60 s 1-min rollups every 15 s \u2192 chat/on-call (GPU util, queue depth) \u00b7 <1 day batch on the lake \u2192 email/ticket (retention, revenue drift, cost). Dedupe, group, silence, escalate.", "autoResize": true, "lineHeight": 1.25}, {"id": "pb3HbCLt5bWaNgwpt22Y", "type": "text", "x": 420, "y": 1005, "width": 52.800000000000004, "height": 20.0, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0070", "roundness": null, "seed": 309615545, "version": 1, "versionNonce": 1891468396, "isDeleted": false, "boundElements": [], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false, "text": "Legend", "fontSize": 16, "baseFontSize": null, "fontFamily": 5, "textAlign": "left", "verticalAlign": "top", "containerId": null, "originalText": "Legend", "autoResize": true, "lineHeight": 1.25}, {"id": "KEGJre63JHo5CISjASkm", "type": "rectangle", "x": 420, "y": 1035, "width": 22, "height": 22, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "#f3f4f6", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0071", "roundness": {"type": 3}, "seed": 902284037, "version": 1, "versionNonce": 1648938563, "isDeleted": false, "boundElements": [], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false}, {"id": "q3fJek2WaUqQ6lUKl0Ex", "type": "text", "x": 450, "y": 1036, "width": 143.0, "height": 16.25, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0072", "roundness": null, "seed": 560143384, "version": 1, "versionNonce": 390255726, "isDeleted": false, "boundElements": [], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false, "text": "sources / dashboards", "fontSize": 13, "baseFontSize": null, "fontFamily": 5, "textAlign": "left", "verticalAlign": "top", "containerId": null, "originalText": "sources / dashboards", "autoResize": true, "lineHeight": 1.25}, {"id": "QJZGeBf7DcrvP5l8Lxp4", "type": "rectangle", "x": 650, "y": 1035, "width": 22, "height": 22, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "#dbeafe", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0073", "roundness": {"type": 3}, "seed": 66957704, "version": 1, "versionNonce": 1581798318, "isDeleted": false, "boundElements": [], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false}, {"id": "yytAhXIEmj13svRC9FdG", "type": "text", "x": 680, "y": 1036, "width": 64.35000000000001, "height": 16.25, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0074", "roundness": null, "seed": 1785233066, "version": 1, "versionNonce": 1494156422, "isDeleted": false, "boundElements": [], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false, "text": "collector", "fontSize": 13, "baseFontSize": null, "fontFamily": 5, "textAlign": "left", "verticalAlign": "top", "containerId": null, "originalText": "collector", "autoResize": true, "lineHeight": 1.25}, {"id": "fwMR6qihHwyeYxVdTPRg", "type": "rectangle", "x": 880, "y": 1035, "width": 22, "height": 22, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "#ede9fe", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0075", "roundness": {"type": 3}, "seed": 2040242120, "version": 1, "versionNonce": 429254031, "isDeleted": false, "boundElements": [], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false}, {"id": "z7hLrvxJLVzi1fL1rGZ4", "type": "text", "x": 910, "y": 1036, "width": 42.900000000000006, "height": 16.25, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0076", "roundness": null, "seed": 514346879, "version": 1, "versionNonce": 1303846690, "isDeleted": false, "boundElements": [], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false, "text": "topics", "fontSize": 13, "baseFontSize": null, "fontFamily": 5, "textAlign": "left", "verticalAlign": "top", "containerId": null, "originalText": "topics", "autoResize": true, "lineHeight": 1.25}, {"id": "nCNfSCRxkwQVmbTUJMxL", "type": "rectangle", "x": 1110, "y": 1035, "width": 22, "height": 22, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "#ffedd5", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0077", "roundness": {"type": 3}, "seed": 41431275, "version": 1, "versionNonce": 927356830, "isDeleted": false, "boundElements": [], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false}, {"id": "Y51vSP94OfdA6ivvK3BT", "type": "text", "x": 1140, "y": 1036, "width": 200.20000000000002, "height": 16.25, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0078", "roundness": null, "seed": 962162555, "version": 1, "versionNonce": 531750395, "isDeleted": false, "boundElements": [], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false, "text": "processing / consumers / API", "fontSize": 13, "baseFontSize": null, "fontFamily": 5, "textAlign": "left", "verticalAlign": "top", "containerId": null, "originalText": "processing / consumers / API", "autoResize": true, "lineHeight": 1.25}, {"id": "11XiUIyXUnaak6VKiEbi", "type": "rectangle", "x": 1340, "y": 1035, "width": 22, "height": 22, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "#dcfce7", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0079", "roundness": {"type": 3}, "seed": 1224248370, "version": 1, "versionNonce": 192728335, "isDeleted": false, "boundElements": [], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false}, {"id": "YcDpiW25PrS0gnuY0FTL", "type": "text", "x": 1370, "y": 1036, "width": 121.55000000000001, "height": 16.25, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0080", "roundness": null, "seed": 476899061, "version": 1, "versionNonce": 1138261140, "isDeleted": false, "boundElements": [], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false, "text": "stores / registry", "fontSize": 13, "baseFontSize": null, "fontFamily": 5, "textAlign": "left", "verticalAlign": "top", "containerId": null, "originalText": "stores / registry", "autoResize": true, "lineHeight": 1.25}, {"id": "kcUsGp69dIojS8mHunoo", "type": "rectangle", "x": 1570, "y": 1035, "width": 22, "height": 22, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "#fef9c3", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0081", "roundness": {"type": 3}, "seed": 1518346247, "version": 1, "versionNonce": 779500266, "isDeleted": false, "boundElements": [], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false}, {"id": "VRnK4IAuYV0GShy7YcPE", "type": "text", "x": 1600, "y": 1036, "width": 135.85000000000002, "height": 16.25, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0082", "roundness": null, "seed": 1064010880, "version": 1, "versionNonce": 346083533, "isDeleted": false, "boundElements": [], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false, "text": "alerts / compliance", "fontSize": 13, "baseFontSize": null, "fontFamily": 5, "textAlign": "left", "verticalAlign": "top", "containerId": null, "originalText": "alerts / compliance", "autoResize": true, "lineHeight": 1.25}, {"id": "TULzFanh0E3901AFYtyq", "type": "text", "x": 1920, "y": 1005, "width": 464.75000000000006, "height": 16.25, "angle": 0, "strokeColor": "#374151", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "XmonvqdLTb71RNHOJGwI", "index": "a0083", "roundness": null, "seed": 593811261, "version": 1, "versionNonce": 422171472, "isDeleted": false, "boundElements": [], "updated": 1790775836258, "created": 1790775836258, "link": null, "locked": false, "text": "solid = event and query path   dashed = control, schemas, history", "fontSize": 13, "baseFontSize": null, "fontFamily": 5, "textAlign": "left", "verticalAlign": "top", "containerId": null, "originalText": "solid = event and query path   dashed = control, schemas, history", "autoResize": true, "lineHeight": 1.25}], "appState": {"viewBackgroundColor": "#ffffff", "gridSize": null}, "files": {}}