{"type": "excalidraw", "version": 2, "source": "generated", "elements": [{"id": "Cx2kUhpYP9Rqn51OJeD9", "type": "frame", "x": 390, "y": 17, "width": 2210.5, "height": 1075, "angle": 0, "strokeColor": "#bbb", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 1, "strokeStyle": "solid", "roughness": 0, "opacity": 100, "groupIds": [], "frameId": null, "index": "a0000", "roundness": null, "seed": 1585333284, "version": 1, "versionNonce": 289547071, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "name": "System diagram"}, {"id": "OR7meZuxYl4Ee4JeZWTO", "type": "text", "x": -760, "y": -40, "width": 689.7, "height": 27.5, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": null, "index": "a0001", "roundness": null, "seed": 1501996801, "version": 1, "versionNonce": 51984297, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "text": "ML model serving platform: versions + A/B, global clients", "fontSize": 22, "baseFontSize": null, "fontFamily": 5, "textAlign": "left", "verticalAlign": "top", "containerId": null, "originalText": "ML model serving platform: versions + A/B, global clients", "autoResize": true, "lineHeight": 1.25}, {"id": "0YDi6LoYi8U4XcQfCjHd", "type": "text", "x": -760, "y": 20, "width": 515.9000000000001, "height": 175.0, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": null, "index": "a0002", "roundness": null, "seed": 64634663, "version": 1, "versionNonce": 1941625258, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "text": "Requirements (ask first)\n- clients: apps or services? one call = request/response or stream?\n- how many models, what sizes (MB to 100 GB)? latency per class?\n- peak req/s, per region? regions? may a call cross regions?\n- A/B: % split, sticky by user or customer, canary %?\n- who owns the GPUs, is cost a constraint? what is 'rollout done'?\nEngineer: register model, upload version, deploy to pool/region,\nrun an experiment between two versions, roll out / roll back.\nClient: call one stable endpoint per model, get result or stream.\nOperator: see per-version, per-arm health.", "fontSize": 14, "baseFontSize": null, "fontFamily": 5, "textAlign": "left", "verticalAlign": "top", "containerId": null, "originalText": "Requirements (ask first)\n- clients: apps or services? one call = request/response or stream?\n- how many models, what sizes (MB to 100 GB)? latency per class?\n- peak req/s, per region? regions? may a call cross regions?\n- A/B: % split, sticky by user or customer, canary %?\n- who owns the GPUs, is cost a constraint? what is 'rollout done'?\nEngineer: register model, upload version, deploy to pool/region,\nrun an experiment between two versions, roll out / roll back.\nClient: call one stable endpoint per model, get result or stream.\nOperator: see per-version, per-arm health.", "autoResize": true, "lineHeight": 1.25}, {"id": "WvJztBYvwWlwGGkVEfud", "type": "text", "x": -760, "y": 223.0, "width": 631.4000000000001, "height": 122.5, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": null, "index": "a0003", "roundness": null, "seed": 1476349815, "version": 1, "versionNonce": 490964732, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "text": "Technical challenges\n- sizes differ 1000x: one GPU per small model, many per large\n- loading 100 GB takes minutes: never cold-start on the request path\n- global clients, one registry: rules may be seconds stale, calls never fail on it\n- sticky A/B assignment must be a cheap hash on the hot path\n- GPU cost: batching + bin-packing decide the bill\n- availability > consistency on inference; consistency in the control plane", "fontSize": 14, "baseFontSize": null, "fontFamily": 5, "textAlign": "left", "verticalAlign": "top", "containerId": null, "originalText": "Technical challenges\n- sizes differ 1000x: one GPU per small model, many per large\n- loading 100 GB takes minutes: never cold-start on the request path\n- global clients, one registry: rules may be seconds stale, calls never fail on it\n- sticky A/B assignment must be a cheap hash on the hot path\n- GPU cost: batching + bin-packing decide the bill\n- availability > consistency on inference; consistency in the control plane", "autoResize": true, "lineHeight": 1.25}, {"id": "sXRfCrhbr2DH8hKxlR1b", "type": "text", "x": -760, "y": 373.5, "width": 685.3000000000001, "height": 140.0, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": null, "index": "a0004", "roundness": null, "seed": 1816375883, "version": 1, "versionNonce": 1763699224, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "text": "Core entities\nModel(id, name, owner, aliases prod->v7, canary->v8)\nModelVersion(model, version, artifact URI, checksum, size, GPU mem, status) immutable\nDeployment(version, region, pool, replicas, GPU class, generation, status)\nExperiment(model, arms[], key: user|customer, stop criteria)\nArm(experiment, version, weight %, pinned customers[])\nReplica(node, GPUs, version, state: pulling->loaded->warm->ready(v,G)->serving->draining)\nNot entities: the request (metered), the batch (runtime), the region (partition key)", "fontSize": 14, "baseFontSize": null, "fontFamily": 5, "textAlign": "left", "verticalAlign": "top", "containerId": null, "originalText": "Core entities\nModel(id, name, owner, aliases prod->v7, canary->v8)\nModelVersion(model, version, artifact URI, checksum, size, GPU mem, status) immutable\nDeployment(version, region, pool, replicas, GPU class, generation, status)\nExperiment(model, arms[], key: user|customer, stop criteria)\nArm(experiment, version, weight %, pinned customers[])\nReplica(node, GPUs, version, state: pulling->loaded->warm->ready(v,G)->serving->draining)\nNot entities: the request (metered), the batch (runtime), the region (partition key)", "autoResize": true, "lineHeight": 1.25}, {"id": "UTl7valx9UZZd9cdeo6L", "type": "text", "x": -760, "y": 541.5, "width": 616.0, "height": 157.5, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": null, "index": "a0005", "roundness": null, "seed": 2051012830, "version": 1, "versionNonce": 440151140, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "text": "API\nPOST /models   POST /models/{id}/versions (signed upload URL)\nPOST /deployments {version, region, replicas, gpu_class, canary_pct}\nPOST /experiments {model, arms, key}   POST /rollouts/{id}/pause|resume|rollback\nPOST /v1/models/{name}:predict {inputs, version?, user_key?} -> result | stream\n   response carries served_version + arm\nGET /models/{id}/versions/{v}/status -> loaded, ready, serving per region\ninternal: POST /replicas/{id}/report {generation, version, state}\n          routers watch a routing-rules snapshot per model", "fontSize": 14, "baseFontSize": null, "fontFamily": 5, "textAlign": "left", "verticalAlign": "top", "containerId": null, "originalText": "API\nPOST /models   POST /models/{id}/versions (signed upload URL)\nPOST /deployments {version, region, replicas, gpu_class, canary_pct}\nPOST /experiments {model, arms, key}   POST /rollouts/{id}/pause|resume|rollback\nPOST /v1/models/{name}:predict {inputs, version?, user_key?} -> result | stream\n   response carries served_version + arm\nGET /models/{id}/versions/{v}/status -> loaded, ready, serving per region\ninternal: POST /replicas/{id}/report {generation, version, state}\n          routers watch a routing-rules snapshot per model", "autoResize": true, "lineHeight": 1.25}, {"id": "owrOkHn8XPFYSuJdoDMR", "type": "text", "x": -760, "y": 727.0, "width": 592.9000000000001, "height": 87.5, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": null, "index": "a0006", "roundness": null, "seed": 1048451829, "version": 1, "versionNonce": 1862841746, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "text": "What breaks first\n- cold start of a large version on scale-up -> warm pool + NVMe pre-placement\n- registry on the hot path -> cached rules snapshot, last-known-good\n- bad canary visible only in quality -> experiment log + stop criteria\n- big model starves small ones -> per-version queues, shed by tier", "fontSize": 14, "baseFontSize": null, "fontFamily": 5, "textAlign": "left", "verticalAlign": "top", "containerId": null, "originalText": "What breaks first\n- cold start of a large version on scale-up -> warm pool + NVMe pre-placement\n- registry on the hot path -> cached rules snapshot, last-known-good\n- bad canary visible only in quality -> experiment log + stop criteria\n- big model starves small ones -> per-version queues, shed by tier", "autoResize": true, "lineHeight": 1.25}, {"id": "tcg3xmUT7lBdLYBdrHfL", "type": "rectangle", "x": 420, "y": 60, "width": 300, "height": 84, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "#f3f4f6", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0007", "roundness": {"type": 3}, "seed": 1905513029, "version": 1, "versionNonce": 1570447790, "isDeleted": false, "boundElements": [{"type": "text", "id": "uFylaomt9xupeV1RNcLE"}, {"type": "arrow", "id": "cXLaYYeOHgP84LhYySkl"}], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false}, {"id": "uFylaomt9xupeV1RNcLE", "type": "text", "x": 430, "y": 93.25, "width": 280, "height": 17.5, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0008", "roundness": null, "seed": 402547040, "version": 1, "versionNonce": 1923130234, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "text": "ML engineer / release owner", "fontSize": 14, "baseFontSize": null, "fontFamily": 5, "textAlign": "center", "verticalAlign": "middle", "containerId": "tcg3xmUT7lBdLYBdrHfL", "originalText": "ML engineer / release owner", "autoResize": true, "lineHeight": 1.25}, {"id": "gUtJE8uGHZM4EwDsEMO8", "type": "rectangle", "x": 940, "y": 60, "width": 300, "height": 84, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "#ffedd5", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0009", "roundness": {"type": 3}, "seed": 1030961466, "version": 1, "versionNonce": 957426288, "isDeleted": false, "boundElements": [{"type": "text", "id": "TgQNVEAblGHVBoqgjpIR"}, {"type": "arrow", "id": "cXLaYYeOHgP84LhYySkl"}, {"type": "arrow", "id": "7yVECUfDbvvLoSRveIcW"}, {"type": "arrow", "id": "nNjHUAXigkvvmDlOPBCd"}], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false}, {"id": "TgQNVEAblGHVBoqgjpIR", "type": "text", "x": 950, "y": 75.75, "width": 280, "height": 52.5, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0010", "roundness": null, "seed": 1860156903, "version": 1, "versionNonce": 1111417946, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "text": "Control-plane API\nmodels \u00b7 versions \u00b7 deployments\nexperiments \u00b7 rollouts", "fontSize": 14, "baseFontSize": null, "fontFamily": 5, "textAlign": "center", "verticalAlign": "middle", "containerId": "gUtJE8uGHZM4EwDsEMO8", "originalText": "Control-plane API\nmodels \u00b7 versions \u00b7 deployments\nexperiments \u00b7 rollouts", "autoResize": true, "lineHeight": 1.25}, {"id": "rckdCTfpX3QjSboYpvaN", "type": "ellipse", "x": 1460, "y": 47, "width": 300, "height": 110, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "#dcfce7", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0011", "roundness": {"type": 2}, "seed": 95074808, "version": 1, "versionNonce": 1604091275, "isDeleted": false, "boundElements": [{"type": "text", "id": "rflL2kIEO7xKEjC8Tmul"}, {"type": "arrow", "id": "7yVECUfDbvvLoSRveIcW"}, {"type": "arrow", "id": "CT9QkjB5ekEiL3UfCYCs"}], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false}, {"id": "rflL2kIEO7xKEjC8Tmul", "type": "text", "x": 1470, "y": 73.875, "width": 280, "height": 56.25, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0012", "roundness": null, "seed": 1762352111, "version": 1, "versionNonce": 1979108851, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "text": "Registry (Postgres)\nModel, ModelVersion, Deployment,\nExperiment, Arm \u00b7 single writer", "fontSize": 15, "baseFontSize": null, "fontFamily": 5, "textAlign": "center", "verticalAlign": "middle", "containerId": "rckdCTfpX3QjSboYpvaN", "originalText": "Registry (Postgres)\nModel, ModelVersion, Deployment,\nExperiment, Arm \u00b7 single writer", "autoResize": true, "lineHeight": 1.25}, {"id": "HeOA0PK9A13h4AlU3EF6", "type": "rectangle", "x": 1980, "y": 60, "width": 300, "height": 84, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "#dcfce7", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0013", "roundness": {"type": 3}, "seed": 1425357385, "version": 1, "versionNonce": 769396030, "isDeleted": false, "boundElements": [{"type": "text", "id": "qf41Ez4I8aOpS5bPYDhE"}, {"type": "arrow", "id": "CT9QkjB5ekEiL3UfCYCs"}, {"type": "arrow", "id": "RBAc9wVpBfY86HDBQkLv"}], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false}, {"id": "qf41Ez4I8aOpS5bPYDhE", "type": "text", "x": 1990, "y": 75.75, "width": 280, "height": 52.5, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0014", "roundness": null, "seed": 1749152247, "version": 1, "versionNonce": 1685142631, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "text": "Artifact store (object storage)\nweights + checksum, immutable\nmirrored per region", "fontSize": 14, "baseFontSize": null, "fontFamily": 5, "textAlign": "center", "verticalAlign": "middle", "containerId": "HeOA0PK9A13h4AlU3EF6", "originalText": "Artifact store (object storage)\nweights + checksum, immutable\nmirrored per region", "autoResize": true, "lineHeight": 1.25}, {"id": "IuupTaLPBAWFdS881cIl", "type": "rectangle", "x": 420, "y": 240, "width": 300, "height": 84, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "#f3f4f6", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0015", "roundness": {"type": 3}, "seed": 549220766, "version": 1, "versionNonce": 556320078, "isDeleted": false, "boundElements": [{"type": "text", "id": "F3lU8BEf4jUSq85MzEBO"}, {"type": "arrow", "id": "3EGU5ejesBwLgg3JKEXU"}], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false}, {"id": "F3lU8BEf4jUSq85MzEBO", "type": "text", "x": 430, "y": 264.5, "width": 280, "height": 35.0, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0016", "roundness": null, "seed": 886808048, "version": 1, "versionNonce": 410683237, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "text": "Clients around the globe\napps, services", "fontSize": 14, "baseFontSize": null, "fontFamily": 5, "textAlign": "center", "verticalAlign": "middle", "containerId": "IuupTaLPBAWFdS881cIl", "originalText": "Clients around the globe\napps, services", "autoResize": true, "lineHeight": 1.25}, {"id": "sTWidggCIDyzPeCqYSRZ", "type": "rectangle", "x": 940, "y": 240, "width": 300, "height": 110, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "#ffedd5", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0017", "roundness": {"type": 3}, "seed": 142002035, "version": 1, "versionNonce": 2118690610, "isDeleted": false, "boundElements": [{"type": "text", "id": "6TXaePlrS70LBEx91YHR"}, {"type": "arrow", "id": "nNjHUAXigkvvmDlOPBCd"}, {"type": "arrow", "id": "ua3N9Vj5IS1yXaU3iDI3"}, {"type": "arrow", "id": "MIX0BCwh2AIQzZ0tKCRE"}], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false}, {"id": "6TXaePlrS70LBEx91YHR", "type": "text", "x": 950, "y": 260.0, "width": 280, "height": 70.0, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0018", "roundness": null, "seed": 409893804, "version": 1, "versionNonce": 1960522067, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "text": "Deployment controller\nplacement: bin-pack by GPU memory,\ntopology-aware \u00b7 cohorts, generation G\nwarm pool \u00b7 publishes routing rules", "fontSize": 14, "baseFontSize": null, "fontFamily": 5, "textAlign": "center", "verticalAlign": "middle", "containerId": "sTWidggCIDyzPeCqYSRZ", "originalText": "Deployment controller\nplacement: bin-pack by GPU memory,\ntopology-aware \u00b7 cohorts, generation G\nwarm pool \u00b7 publishes routing rules", "autoResize": true, "lineHeight": 1.25}, {"id": "NDb1ncZxufFJMrE6w0Ug", "type": "rectangle", "x": 1460, "y": 240, "width": 300, "height": 110, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "#dcfce7", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0019", "roundness": {"type": 3}, "seed": 1511902194, "version": 1, "versionNonce": 899622483, "isDeleted": false, "boundElements": [{"type": "text", "id": "2xeDoduWd5iEcgAxDPIP"}, {"type": "arrow", "id": "ua3N9Vj5IS1yXaU3iDI3"}, {"type": "arrow", "id": "EMr8P0kgaWZTDEsXUPJ0"}, {"type": "arrow", "id": "mbsKN6QLC7cNsE86nltp"}], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false}, {"id": "2xeDoduWd5iEcgAxDPIP", "type": "text", "x": 1470, "y": 260.0, "width": 280, "height": 70.0, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0020", "roundness": null, "seed": 1703243971, "version": 1, "versionNonce": 507623874, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "text": "Routing rules + ready set\nalias \u2192 version, arm weights, pins\nready replicas per region\n(cached snapshot in every router)", "fontSize": 14, "baseFontSize": null, "fontFamily": 5, "textAlign": "center", "verticalAlign": "middle", "containerId": "NDb1ncZxufFJMrE6w0Ug", "originalText": "Routing rules + ready set\nalias \u2192 version, arm weights, pins\nready replicas per region\n(cached snapshot in every router)", "autoResize": true, "lineHeight": 1.25}, {"id": "s1N6yCP8YohEgeACmkeT", "type": "rectangle", "x": 1980, "y": 240, "width": 300, "height": 110, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "#fee2e2", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0021", "roundness": {"type": 3}, "seed": 968250454, "version": 1, "versionNonce": 15961105, "isDeleted": false, "boundElements": [{"type": "text", "id": "inrGMG5lfeifT8FsdeTb"}, {"type": "arrow", "id": "RBAc9wVpBfY86HDBQkLv"}, {"type": "arrow", "id": "EMr8P0kgaWZTDEsXUPJ0"}, {"type": "arrow", "id": "KNJNjycIFk71xHETMOPd"}], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false}, {"id": "inrGMG5lfeifT8FsdeTb", "type": "text", "x": 1990, "y": 260.0, "width": 280, "height": 70.0, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0022", "roundness": null, "seed": 804438457, "version": 1, "versionNonce": 973154704, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "text": "Node agent (per GPU node)\npull chunks, verify hash, NVMe cache\nload to GPU memory, warm-up\nreport ready(version, G)", "fontSize": 14, "baseFontSize": null, "fontFamily": 5, "textAlign": "center", "verticalAlign": "middle", "containerId": "s1N6yCP8YohEgeACmkeT", "originalText": "Node agent (per GPU node)\npull chunks, verify hash, NVMe cache\nload to GPU memory, warm-up\nreport ready(version, G)", "autoResize": true, "lineHeight": 1.25}, {"id": "cbgdN7xiWzqzxoLSdaqL", "type": "rectangle", "x": 420, "y": 440, "width": 300, "height": 110, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "#dbeafe", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0023", "roundness": {"type": 3}, "seed": 565180407, "version": 1, "versionNonce": 790282396, "isDeleted": false, "boundElements": [{"type": "text", "id": "JE9TUewP4W7ZG8mFo3Gt"}, {"type": "arrow", "id": "3EGU5ejesBwLgg3JKEXU"}, {"type": "arrow", "id": "XybAuIMQROVhHcryzvSA"}, {"type": "arrow", "id": "BkDbrXnI7bEJ2akAeKhp"}, {"type": "arrow", "id": "CTLmar5W70UMwyiFenro"}], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false}, {"id": "JE9TUewP4W7ZG8mFo3Gt", "type": "text", "x": 430, "y": 468.75, "width": 280, "height": 52.5, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0024", "roundness": null, "seed": 1914260037, "version": 1, "versionNonce": 1068748372, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "text": "Global edge + API gateway\nanycast \u2192 nearest region\nauth, quota, usage meter", "fontSize": 14, "baseFontSize": null, "fontFamily": 5, "textAlign": "center", "verticalAlign": "middle", "containerId": "cbgdN7xiWzqzxoLSdaqL", "originalText": "Global edge + API gateway\nanycast \u2192 nearest region\nauth, quota, usage meter", "autoResize": true, "lineHeight": 1.25}, {"id": "047pFGSoCFJ3LpAwY3ja", "type": "rectangle", "x": 940, "y": 440, "width": 300, "height": 110, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "#ffedd5", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0025", "roundness": {"type": 3}, "seed": 1310759163, "version": 1, "versionNonce": 324278902, "isDeleted": false, "boundElements": [{"type": "text", "id": "jyl7l3sgt38JRMQ4O4xN"}, {"type": "arrow", "id": "MIX0BCwh2AIQzZ0tKCRE"}, {"type": "arrow", "id": "XybAuIMQROVhHcryzvSA"}, {"type": "arrow", "id": "6gXFwJLKFwHd6IPxbnh0"}, {"type": "arrow", "id": "Amc8m7EGYmIkE1E71QSC"}, {"type": "arrow", "id": "BkDbrXnI7bEJ2akAeKhp"}, {"type": "arrow", "id": "epmXppUXE9AtB7YeXluW"}], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false}, {"id": "jyl7l3sgt38JRMQ4O4xN", "type": "text", "x": 950, "y": 460.0, "width": 280, "height": 70.0, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0026", "roundness": null, "seed": 1975684118, "version": 1, "versionNonce": 8231414, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "text": "Inference router\nalias \u2192 version \u2192 arm\n(sticky hash of user / customer key)\n\u2192 ready replica \u00b7 stamps served_version", "fontSize": 14, "baseFontSize": null, "fontFamily": 5, "textAlign": "center", "verticalAlign": "middle", "containerId": "047pFGSoCFJ3LpAwY3ja", "originalText": "Inference router\nalias \u2192 version \u2192 arm\n(sticky hash of user / customer key)\n\u2192 ready replica \u00b7 stamps served_version", "autoResize": true, "lineHeight": 1.25}, {"id": "HkXIWSyb9KjKtonMkOne", "type": "rectangle", "x": 1460, "y": 440, "width": 300, "height": 110, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "#ede9fe", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0027", "roundness": {"type": 3}, "seed": 137876538, "version": 1, "versionNonce": 1448704187, "isDeleted": false, "boundElements": [{"type": "text", "id": "DhC3I1LojZVc4Q2zXAMI"}, {"type": "arrow", "id": "mbsKN6QLC7cNsE86nltp"}, {"type": "arrow", "id": "6gXFwJLKFwHd6IPxbnh0"}, {"type": "arrow", "id": "Jj97JhdrPlZ3bqO0wn8A"}, {"type": "arrow", "id": "cYLN7UqmIRNFWBUNeu92"}, {"type": "arrow", "id": "Amc8m7EGYmIkE1E71QSC"}, {"type": "arrow", "id": "cqvRDyMDnDCMfiphL26R"}], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false}, {"id": "DhC3I1LojZVc4Q2zXAMI", "type": "text", "x": 1470, "y": 460.0, "width": 280, "height": 70.0, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0028", "roundness": null, "seed": 879348910, "version": 1, "versionNonce": 546975026, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "text": "Per-version queue + batcher\nflush on size or time\nnever mixes versions\nqueue depth = utilisation dial", "fontSize": 14, "baseFontSize": null, "fontFamily": 5, "textAlign": "center", "verticalAlign": "middle", "containerId": "HkXIWSyb9KjKtonMkOne", "originalText": "Per-version queue + batcher\nflush on size or time\nnever mixes versions\nqueue depth = utilisation dial", "autoResize": true, "lineHeight": 1.25}, {"id": "MNORMs0QSD6e4xWt4EF1", "type": "rectangle", "x": 1980, "y": 440, "width": 300, "height": 110, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "#fee2e2", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0029", "roundness": {"type": 3}, "seed": 720052118, "version": 1, "versionNonce": 1638960618, "isDeleted": false, "boundElements": [{"type": "text", "id": "J4mppVvkdI3GuPTh2IjS"}, {"type": "arrow", "id": "KNJNjycIFk71xHETMOPd"}, {"type": "arrow", "id": "Jj97JhdrPlZ3bqO0wn8A"}, {"type": "arrow", "id": "cYLN7UqmIRNFWBUNeu92"}, {"type": "arrow", "id": "Dlr6ndUZ9DlGtT3pYZ23"}], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false}, {"id": "J4mppVvkdI3GuPTh2IjS", "type": "text", "x": 1990, "y": 460.0, "width": 280, "height": 70.0, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0030", "roundness": null, "seed": 1268882511, "version": 1, "versionNonce": 1756507824, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "text": "GPU replica pools (per region)\nv7 prod 90% \u00b7 v8 canary 10%\n+10% warm spare\none version per replica", "fontSize": 14, "baseFontSize": null, "fontFamily": 5, "textAlign": "center", "verticalAlign": "middle", "containerId": "MNORMs0QSD6e4xWt4EF1", "originalText": "GPU replica pools (per region)\nv7 prod 90% \u00b7 v8 canary 10%\n+10% warm spare\none version per replica", "autoResize": true, "lineHeight": 1.25}, {"id": "AfH9hdiYaCVDcYhICMH5", "type": "rectangle", "x": 420, "y": 670, "width": 300, "height": 84, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "#f3f4f6", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "dashed", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0031", "roundness": {"type": 3}, "seed": 148431954, "version": 1, "versionNonce": 197479855, "isDeleted": false, "boundElements": [{"type": "text", "id": "b7pTaW112hWRJoVFEpDf"}, {"type": "arrow", "id": "CTLmar5W70UMwyiFenro"}], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false}, {"id": "b7pTaW112hWRJoVFEpDf", "type": "text", "x": 430, "y": 685.75, "width": 280, "height": 52.5, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0032", "roundness": null, "seed": 2130898082, "version": 1, "versionNonce": 25623992, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "text": "Other regions (same data plane)\nregistry read replica, artifacts\nmirrored, failover at the router", "fontSize": 14, "baseFontSize": null, "fontFamily": 5, "textAlign": "center", "verticalAlign": "middle", "containerId": "AfH9hdiYaCVDcYhICMH5", "originalText": "Other regions (same data plane)\nregistry read replica, artifacts\nmirrored, failover at the router", "autoResize": true, "lineHeight": 1.25}, {"id": "uHKxnXTq7W5w4nfo2U3n", "type": "rectangle", "x": 940, "y": 670, "width": 1340, "height": 94, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "#fef9c3", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0033", "roundness": {"type": 3}, "seed": 590344125, "version": 1, "versionNonce": 1401876313, "isDeleted": false, "boundElements": [{"type": "text", "id": "a7sEJkiShUtJCaoP7uwH"}, {"type": "arrow", "id": "epmXppUXE9AtB7YeXluW"}, {"type": "arrow", "id": "cqvRDyMDnDCMfiphL26R"}, {"type": "arrow", "id": "Dlr6ndUZ9DlGtT3pYZ23"}], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false}, {"id": "a7sEJkiShUtJCaoP7uwH", "type": "text", "x": 950, "y": 690.75, "width": 1320, "height": 52.5, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0034", "roundness": null, "seed": 538985117, "version": 1, "versionNonce": 614129976, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "text": "Observability + experiment analytics\nmetrics by model / version / arm \u00b7 queue depth \u00b7 GPU util \u00b7 experiment log (request id \u2192 arm, version)\ncanary stop signals (errors, p99, quality) \u2192 controller: pause or roll back", "fontSize": 14, "baseFontSize": null, "fontFamily": 5, "textAlign": "center", "verticalAlign": "middle", "containerId": "uHKxnXTq7W5w4nfo2U3n", "originalText": "Observability + experiment analytics\nmetrics by model / version / arm \u00b7 queue depth \u00b7 GPU util \u00b7 experiment log (request id \u2192 arm, version)\ncanary stop signals (errors, p99, quality) \u2192 controller: pause or roll back", "autoResize": true, "lineHeight": 1.25}, {"id": "cXLaYYeOHgP84LhYySkl", "type": "arrow", "x": 720, "y": 102.0, "width": 220, "height": 1, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "dashed", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0035", "roundness": null, "seed": 1621863064, "version": 1, "versionNonce": 711149156, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "points": [[0, 0], [220, 0.0]], "startBinding": {"elementId": "tcg3xmUT7lBdLYBdrHfL", "mode": "orbit", "fixedPoint": [1, 0.5]}, "endBinding": {"elementId": "gUtJE8uGHZM4EwDsEMO8", "mode": "orbit", "fixedPoint": [0, 0.5]}, "startArrowhead": null, "endArrowhead": "arrow", "elbowed": false}, {"id": "WT7wZIEAJwiCBp74zN6t", "type": "text", "x": 740, "y": 60.0, "width": 185.9, "height": 32.5, "angle": 0, "strokeColor": "#374151", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0036", "roundness": null, "seed": 1534347006, "version": 1, "versionNonce": 1169709867, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "text": "register model, upload v8,\ndeploy, start experiment", "fontSize": 13, "baseFontSize": null, "fontFamily": 5, "textAlign": "left", "verticalAlign": "top", "containerId": null, "originalText": "register model, upload v8,\ndeploy, start experiment", "autoResize": true, "lineHeight": 1.25}, {"id": "7yVECUfDbvvLoSRveIcW", "type": "arrow", "x": 1240, "y": 102.0, "width": 220, "height": 1, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "dashed", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0037", "roundness": null, "seed": 16271170, "version": 1, "versionNonce": 314177136, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "points": [[0, 0], [220, 0.0]], "startBinding": {"elementId": "gUtJE8uGHZM4EwDsEMO8", "mode": "orbit", "fixedPoint": [1, 0.5]}, "endBinding": {"elementId": "rckdCTfpX3QjSboYpvaN", "mode": "orbit", "fixedPoint": [0, 0.5]}, "startArrowhead": null, "endArrowhead": "arrow", "elbowed": false}, {"id": "3a1m0QPtXdBIpazkedXG", "type": "text", "x": 1260, "y": 76.0, "width": 28.6, "height": 16.25, "angle": 0, "strokeColor": "#374151", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0038", "roundness": null, "seed": 1969040536, "version": 1, "versionNonce": 1665720549, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "text": "rows", "fontSize": 13, "baseFontSize": null, "fontFamily": 5, "textAlign": "left", "verticalAlign": "top", "containerId": null, "originalText": "rows", "autoResize": true, "lineHeight": 1.25}, {"id": "CT9QkjB5ekEiL3UfCYCs", "type": "arrow", "x": 1760, "y": 102.0, "width": 220, "height": 1, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "dashed", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0039", "roundness": null, "seed": 1918572533, "version": 1, "versionNonce": 1586392391, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "points": [[0, 0], [220, 0.0]], "startBinding": {"elementId": "rckdCTfpX3QjSboYpvaN", "mode": "orbit", "fixedPoint": [1, 0.5]}, "endBinding": {"elementId": "HeOA0PK9A13h4AlU3EF6", "mode": "orbit", "fixedPoint": [0, 0.5]}, "startArrowhead": null, "endArrowhead": "arrow", "elbowed": false}, {"id": "7lCU06zjiN4liovaF6y9", "type": "text", "x": 1780, "y": 76.0, "width": 164.45000000000002, "height": 16.25, "angle": 0, "strokeColor": "#374151", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0040", "roundness": null, "seed": 1299093615, "version": 1, "versionNonce": 415690233, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "text": "artifact URI + checksum", "fontSize": 13, "baseFontSize": null, "fontFamily": 5, "textAlign": "left", "verticalAlign": "top", "containerId": null, "originalText": "artifact URI + checksum", "autoResize": true, "lineHeight": 1.25}, {"id": "nNjHUAXigkvvmDlOPBCd", "type": "arrow", "x": 1090.0, "y": 144, "width": 1, "height": 96, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "dashed", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0041", "roundness": null, "seed": 1537388788, "version": 1, "versionNonce": 230648632, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "points": [[0, 0], [0.0, 96]], "startBinding": {"elementId": "gUtJE8uGHZM4EwDsEMO8", "mode": "orbit", "fixedPoint": [0.5, 1]}, "endBinding": {"elementId": "sTWidggCIDyzPeCqYSRZ", "mode": "orbit", "fixedPoint": [0.5, 0]}, "startArrowhead": null, "endArrowhead": "arrow", "elbowed": false}, {"id": "owjQlCL034zMB1ztyyVq", "type": "text", "x": 1102.0, "y": 166, "width": 92.95, "height": 16.25, "angle": 0, "strokeColor": "#374151", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0042", "roundness": null, "seed": 1037121186, "version": 1, "versionNonce": 1835156621, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "text": "desired state", "fontSize": 13, "baseFontSize": null, "fontFamily": 5, "textAlign": "left", "verticalAlign": "top", "containerId": null, "originalText": "desired state", "autoResize": true, "lineHeight": 1.25}, {"id": "ua3N9Vj5IS1yXaU3iDI3", "type": "arrow", "x": 1240, "y": 275.0, "width": 220, "height": 1, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "dashed", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0043", "roundness": null, "seed": 1358599736, "version": 1, "versionNonce": 961595486, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "points": [[0, 0], [220, 0.0]], "startBinding": {"elementId": "sTWidggCIDyzPeCqYSRZ", "mode": "orbit", "fixedPoint": [1, 0.3181818181818182]}, "endBinding": {"elementId": "NDb1ncZxufFJMrE6w0Ug", "mode": "orbit", "fixedPoint": [0, 0.3181818181818182]}, "startArrowhead": null, "endArrowhead": "arrow", "elbowed": false}, {"id": "Z0lrdUyFT1T9LGkTxh1q", "type": "text", "x": 1260, "y": 233.0, "width": 128.70000000000002, "height": 32.5, "angle": 0, "strokeColor": "#374151", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0044", "roundness": null, "seed": 1116407692, "version": 1, "versionNonce": 1569724242, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "text": "arm weights, pins,\nready set", "fontSize": 13, "baseFontSize": null, "fontFamily": 5, "textAlign": "left", "verticalAlign": "top", "containerId": null, "originalText": "arm weights, pins,\nready set", "autoResize": true, "lineHeight": 1.25}, {"id": "RBAc9wVpBfY86HDBQkLv", "type": "arrow", "x": 2130.0, "y": 144, "width": 1, "height": 96, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0045", "roundness": null, "seed": 1430697732, "version": 1, "versionNonce": 975029036, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "points": [[0, 0], [0.0, 96]], "startBinding": {"elementId": "HeOA0PK9A13h4AlU3EF6", "mode": "orbit", "fixedPoint": [0.5, 1]}, "endBinding": {"elementId": "s1N6yCP8YohEgeACmkeT", "mode": "orbit", "fixedPoint": [0.5, 0]}, "startArrowhead": null, "endArrowhead": "arrow", "elbowed": false}, {"id": "T7yrQTrzRN2CqaAVZSap", "type": "text", "x": 2142.0, "y": 166, "width": 135.85000000000002, "height": 16.25, "angle": 0, "strokeColor": "#374151", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0046", "roundness": null, "seed": 1800558998, "version": 1, "versionNonce": 720393901, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "text": "pull chunks, verify", "fontSize": 13, "baseFontSize": null, "fontFamily": 5, "textAlign": "left", "verticalAlign": "top", "containerId": null, "originalText": "pull chunks, verify", "autoResize": true, "lineHeight": 1.25}, {"id": "EMr8P0kgaWZTDEsXUPJ0", "type": "arrow", "x": 1760, "y": 315.0, "width": 220, "height": 1, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "dashed", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0047", "roundness": null, "seed": 388150300, "version": 1, "versionNonce": 635800064, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "points": [[0, 0], [220, 0.0]], "startBinding": {"elementId": "NDb1ncZxufFJMrE6w0Ug", "mode": "orbit", "fixedPoint": [1, 0.6818181818181818]}, "endBinding": {"elementId": "s1N6yCP8YohEgeACmkeT", "mode": "orbit", "fixedPoint": [0, 0.6818181818181818]}, "startArrowhead": null, "endArrowhead": "arrow", "elbowed": false}, {"id": "u7Zy9soodDG12BlKM8HZ", "type": "text", "x": 1780, "y": 273.0, "width": 143.0, "height": 32.5, "angle": 0, "strokeColor": "#374151", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0048", "roundness": null, "seed": 382537935, "version": 1, "versionNonce": 365165502, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "text": "assign: load v8 (G),\ndrain v7", "fontSize": 13, "baseFontSize": null, "fontFamily": 5, "textAlign": "left", "verticalAlign": "top", "containerId": null, "originalText": "assign: load v8 (G),\ndrain v7", "autoResize": true, "lineHeight": 1.25}, {"id": "mbsKN6QLC7cNsE86nltp", "type": "arrow", "x": 1610.0, "y": 350, "width": 1, "height": 90, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "dashed", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0049", "roundness": null, "seed": 217912527, "version": 1, "versionNonce": 816961223, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "points": [[0, 0], [0.0, 90]], "startBinding": {"elementId": "NDb1ncZxufFJMrE6w0Ug", "mode": "orbit", "fixedPoint": [0.5, 1]}, "endBinding": {"elementId": "HkXIWSyb9KjKtonMkOne", "mode": "orbit", "fixedPoint": [0.5, 0]}, "startArrowhead": null, "endArrowhead": "arrow", "elbowed": false}, {"id": "mZFsBAjm43sxudzybnf1", "type": "text", "x": 1622.0, "y": 372, "width": 157.3, "height": 32.5, "angle": 0, "strokeColor": "#374151", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0050", "roundness": null, "seed": 990361250, "version": 1, "versionNonce": 1553308440, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "text": "rules snapshot (watch;\nseconds stale is fine)", "fontSize": 13, "baseFontSize": null, "fontFamily": 5, "textAlign": "left", "verticalAlign": "top", "containerId": null, "originalText": "rules snapshot (watch;\nseconds stale is fine)", "autoResize": true, "lineHeight": 1.25}, {"id": "KNJNjycIFk71xHETMOPd", "type": "arrow", "x": 2130.0, "y": 350, "width": 1, "height": 90, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0051", "roundness": null, "seed": 1103660210, "version": 1, "versionNonce": 1224066790, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "points": [[0, 0], [0.0, 90]], "startBinding": {"elementId": "s1N6yCP8YohEgeACmkeT", "mode": "orbit", "fixedPoint": [0.5, 1]}, "endBinding": {"elementId": "MNORMs0QSD6e4xWt4EF1", "mode": "orbit", "fixedPoint": [0.5, 0]}, "startArrowhead": null, "endArrowhead": "arrow", "elbowed": false}, {"id": "F2C0GkKluAUuw9jBG9dd", "type": "text", "x": 2142.0, "y": 372, "width": 150.15, "height": 32.5, "angle": 0, "strokeColor": "#374151", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0052", "roundness": null, "seed": 643835848, "version": 1, "versionNonce": 1547277136, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "text": "NVMe \u2192 GPU memory,\nwarm-up, ready(v8, G)", "fontSize": 13, "baseFontSize": null, "fontFamily": 5, "textAlign": "left", "verticalAlign": "top", "containerId": null, "originalText": "NVMe \u2192 GPU memory,\nwarm-up, ready(v8, G)", "autoResize": true, "lineHeight": 1.25}, {"id": "MIX0BCwh2AIQzZ0tKCRE", "type": "arrow", "x": 1090.0, "y": 350, "width": 1, "height": 90, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "dashed", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0053", "roundness": null, "seed": 948103755, "version": 1, "versionNonce": 688540185, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "points": [[0, 0], [0.0, 90]], "startBinding": {"elementId": "sTWidggCIDyzPeCqYSRZ", "mode": "orbit", "fixedPoint": [0.5, 1]}, "endBinding": {"elementId": "047pFGSoCFJ3LpAwY3ja", "mode": "orbit", "fixedPoint": [0.5, 0]}, "startArrowhead": null, "endArrowhead": "arrow", "elbowed": false}, {"id": "tF6Aos3ameqJS8EFDOal", "type": "text", "x": 1102.0, "y": 372, "width": 100.10000000000001, "height": 32.5, "angle": 0, "strokeColor": "#374151", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0054", "roundness": null, "seed": 272563254, "version": 1, "versionNonce": 1188427299, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "text": "routing rules,\nready replicas", "fontSize": 13, "baseFontSize": null, "fontFamily": 5, "textAlign": "left", "verticalAlign": "top", "containerId": null, "originalText": "routing rules,\nready replicas", "autoResize": true, "lineHeight": 1.25}, {"id": "3EGU5ejesBwLgg3JKEXU", "type": "arrow", "x": 570.0, "y": 324, "width": 1, "height": 116, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0055", "roundness": null, "seed": 365519714, "version": 1, "versionNonce": 968649174, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "points": [[0, 0], [0.0, 116]], "startBinding": {"elementId": "IuupTaLPBAWFdS881cIl", "mode": "orbit", "fixedPoint": [0.5, 1]}, "endBinding": {"elementId": "cbgdN7xiWzqzxoLSdaqL", "mode": "orbit", "fixedPoint": [0.5, 0]}, "startArrowhead": null, "endArrowhead": "arrow", "elbowed": false}, {"id": "4zStU7EiLGNJJvG3faMp", "type": "text", "x": 582.0, "y": 346, "width": 193.05, "height": 16.25, "angle": 0, "strokeColor": "#374151", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0056", "roundness": null, "seed": 678670619, "version": 1, "versionNonce": 1555612915, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "text": "1 request to nearest region", "fontSize": 13, "baseFontSize": null, "fontFamily": 5, "textAlign": "left", "verticalAlign": "top", "containerId": null, "originalText": "1 request to nearest region", "autoResize": true, "lineHeight": 1.25}, {"id": "XybAuIMQROVhHcryzvSA", "type": "arrow", "x": 720, "y": 475.0, "width": 220, "height": 1, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0057", "roundness": null, "seed": 282882355, "version": 1, "versionNonce": 1750971002, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "points": [[0, 0], [220, 0.0]], "startBinding": {"elementId": "cbgdN7xiWzqzxoLSdaqL", "mode": "orbit", "fixedPoint": [1, 0.3181818181818182]}, "endBinding": {"elementId": "047pFGSoCFJ3LpAwY3ja", "mode": "orbit", "fixedPoint": [0, 0.3181818181818182]}, "startArrowhead": null, "endArrowhead": "arrow", "elbowed": false}, {"id": "9XaD2oULNX0n9FPWZqGi", "type": "text", "x": 740, "y": 449.0, "width": 121.55000000000001, "height": 16.25, "angle": 0, "strokeColor": "#374151", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0058", "roundness": null, "seed": 1037359862, "version": 1, "versionNonce": 1769879070, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "text": "2 authed, metered", "fontSize": 13, "baseFontSize": null, "fontFamily": 5, "textAlign": "left", "verticalAlign": "top", "containerId": null, "originalText": "2 authed, metered", "autoResize": true, "lineHeight": 1.25}, {"id": "6gXFwJLKFwHd6IPxbnh0", "type": "arrow", "x": 1240, "y": 475.0, "width": 220, "height": 1, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0059", "roundness": null, "seed": 369320160, "version": 1, "versionNonce": 259828675, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "points": [[0, 0], [220, 0.0]], "startBinding": {"elementId": "047pFGSoCFJ3LpAwY3ja", "mode": "orbit", "fixedPoint": [1, 0.3181818181818182]}, "endBinding": {"elementId": "HkXIWSyb9KjKtonMkOne", "mode": "orbit", "fixedPoint": [0, 0.3181818181818182]}, "startArrowhead": null, "endArrowhead": "arrow", "elbowed": false}, {"id": "ZYLHLDk8ytQy719zh7Cw", "type": "text", "x": 1260, "y": 433.0, "width": 107.25000000000001, "height": 32.5, "angle": 0, "strokeColor": "#374151", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0060", "roundness": null, "seed": 987025322, "version": 1, "versionNonce": 134362779, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "text": "3 to the chosen\nversion's queue", "fontSize": 13, "baseFontSize": null, "fontFamily": 5, "textAlign": "left", "verticalAlign": "top", "containerId": null, "originalText": "3 to the chosen\nversion's queue", "autoResize": true, "lineHeight": 1.25}, {"id": "Jj97JhdrPlZ3bqO0wn8A", "type": "arrow", "x": 1760, "y": 475.0, "width": 220, "height": 1, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0061", "roundness": null, "seed": 2113979618, "version": 1, "versionNonce": 370792493, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "points": [[0, 0], [220, 0.0]], "startBinding": {"elementId": "HkXIWSyb9KjKtonMkOne", "mode": "orbit", "fixedPoint": [1, 0.3181818181818182]}, "endBinding": {"elementId": "MNORMs0QSD6e4xWt4EF1", "mode": "orbit", "fixedPoint": [0, 0.3181818181818182]}, "startArrowhead": null, "endArrowhead": "arrow", "elbowed": false}, {"id": "UaZRRO6NtbQsOXBDltqN", "type": "text", "x": 1780, "y": 433.0, "width": 92.95, "height": 32.5, "angle": 0, "strokeColor": "#374151", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0062", "roundness": null, "seed": 112202033, "version": 1, "versionNonce": 1556635550, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "text": "4 batch to a\nready replica", "fontSize": 13, "baseFontSize": null, "fontFamily": 5, "textAlign": "left", "verticalAlign": "top", "containerId": null, "originalText": "4 batch to a\nready replica", "autoResize": true, "lineHeight": 1.25}, {"id": "cYLN7UqmIRNFWBUNeu92", "type": "arrow", "x": 1980, "y": 525.0, "width": 220, "height": 1, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0063", "roundness": null, "seed": 118491041, "version": 1, "versionNonce": 1140365451, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "points": [[0, 0], [-220, 0.0]], "startBinding": {"elementId": "MNORMs0QSD6e4xWt4EF1", "mode": "orbit", "fixedPoint": [0, 0.7727272727272727]}, "endBinding": {"elementId": "HkXIWSyb9KjKtonMkOne", "mode": "orbit", "fixedPoint": [1, 0.7727272727272727]}, "startArrowhead": null, "endArrowhead": "arrow", "elbowed": false}, {"id": "eKNQMLILDODO9FmGGLfw", "type": "text", "x": 1780, "y": 531.0, "width": 121.55000000000001, "height": 16.25, "angle": 0, "strokeColor": "#374151", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0064", "roundness": null, "seed": 1975025890, "version": 1, "versionNonce": 89341942, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "text": "5 result / stream", "fontSize": 13, "baseFontSize": null, "fontFamily": 5, "textAlign": "left", "verticalAlign": "top", "containerId": null, "originalText": "5 result / stream", "autoResize": true, "lineHeight": 1.25}, {"id": "Amc8m7EGYmIkE1E71QSC", "type": "arrow", "x": 1460, "y": 525.0, "width": 220, "height": 1, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0065", "roundness": null, "seed": 685023176, "version": 1, "versionNonce": 1784338202, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "points": [[0, 0], [-220, 0.0]], "startBinding": {"elementId": "HkXIWSyb9KjKtonMkOne", "mode": "orbit", "fixedPoint": [0, 0.7727272727272727]}, "endBinding": {"elementId": "047pFGSoCFJ3LpAwY3ja", "mode": "orbit", "fixedPoint": [1, 0.7727272727272727]}, "startArrowhead": null, "endArrowhead": "arrow", "elbowed": false}, {"id": "49EeIqfjJMOGTRpzdfqJ", "type": "text", "x": 1260, "y": 531.0, "width": 7.15, "height": 16.25, "angle": 0, "strokeColor": "#374151", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0066", "roundness": null, "seed": 1063183633, "version": 1, "versionNonce": 794738957, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "text": "6", "fontSize": 13, "baseFontSize": null, "fontFamily": 5, "textAlign": "left", "verticalAlign": "top", "containerId": null, "originalText": "6", "autoResize": true, "lineHeight": 1.25}, {"id": "BkDbrXnI7bEJ2akAeKhp", "type": "arrow", "x": 940, "y": 525.0, "width": 220, "height": 1, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0067", "roundness": null, "seed": 1525223788, "version": 1, "versionNonce": 809303244, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "points": [[0, 0], [-220, 0.0]], "startBinding": {"elementId": "047pFGSoCFJ3LpAwY3ja", "mode": "orbit", "fixedPoint": [0, 0.7727272727272727]}, "endBinding": {"elementId": "cbgdN7xiWzqzxoLSdaqL", "mode": "orbit", "fixedPoint": [1, 0.7727272727272727]}, "startArrowhead": null, "endArrowhead": "arrow", "elbowed": false}, {"id": "OQwAkPOyXmhZdSw9yM3q", "type": "text", "x": 740, "y": 531.0, "width": 150.15, "height": 16.25, "angle": 0, "strokeColor": "#374151", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0068", "roundness": null, "seed": 917744891, "version": 1, "versionNonce": 265343838, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "text": "7 served_version, arm", "fontSize": 13, "baseFontSize": null, "fontFamily": 5, "textAlign": "left", "verticalAlign": "top", "containerId": null, "originalText": "7 served_version, arm", "autoResize": true, "lineHeight": 1.25}, {"id": "CTLmar5W70UMwyiFenro", "type": "arrow", "x": 570.0, "y": 550, "width": 1, "height": 120, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "dashed", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0069", "roundness": null, "seed": 1518506092, "version": 1, "versionNonce": 1103690403, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "points": [[0, 0], [0.0, 120]], "startBinding": {"elementId": "cbgdN7xiWzqzxoLSdaqL", "mode": "orbit", "fixedPoint": [0.5, 1]}, "endBinding": {"elementId": "AfH9hdiYaCVDcYhICMH5", "mode": "orbit", "fixedPoint": [0.5, 0]}, "startArrowhead": null, "endArrowhead": "arrow", "elbowed": false}, {"id": "w46B50yrlp4H9WCxxvdJ", "type": "text", "x": 582.0, "y": 572, "width": 157.3, "height": 32.5, "angle": 0, "strokeColor": "#374151", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0070", "roundness": null, "seed": 44325696, "version": 1, "versionNonce": 1206580718, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "text": "8 failover if no ready\nreplica in this region", "fontSize": 13, "baseFontSize": null, "fontFamily": 5, "textAlign": "left", "verticalAlign": "top", "containerId": null, "originalText": "8 failover if no ready\nreplica in this region", "autoResize": true, "lineHeight": 1.25}, {"id": "epmXppUXE9AtB7YeXluW", "type": "arrow", "x": 1130.0, "y": 550, "width": 1, "height": 120, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "dashed", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0071", "roundness": null, "seed": 726085621, "version": 1, "versionNonce": 887077287, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "points": [[0, 0], [0.0, 120]], "startBinding": {"elementId": "047pFGSoCFJ3LpAwY3ja", "mode": "orbit", "fixedPoint": [0.6333333333333333, 1]}, "endBinding": {"elementId": "uHKxnXTq7W5w4nfo2U3n", "mode": "orbit", "fixedPoint": [0.1417910447761194, 0]}, "startArrowhead": null, "endArrowhead": "arrow", "elbowed": false}, {"id": "7Da8CcBQiQTXUsFOYUuM", "type": "text", "x": 1140.0, "y": 590, "width": 164.45000000000002, "height": 16.25, "angle": 0, "strokeColor": "#374151", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0072", "roundness": null, "seed": 1071884496, "version": 1, "versionNonce": 496798714, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "text": "metrics, experiment log", "fontSize": 13, "baseFontSize": null, "fontFamily": 5, "textAlign": "left", "verticalAlign": "top", "containerId": null, "originalText": "metrics, experiment log", "autoResize": true, "lineHeight": 1.25}, {"id": "cqvRDyMDnDCMfiphL26R", "type": "arrow", "x": 1650.0, "y": 550, "width": 1, "height": 120, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "dashed", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0073", "roundness": null, "seed": 236979884, "version": 1, "versionNonce": 899407268, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "points": [[0, 0], [0.0, 120]], "startBinding": {"elementId": "HkXIWSyb9KjKtonMkOne", "mode": "orbit", "fixedPoint": [0.6333333333333333, 1]}, "endBinding": {"elementId": "uHKxnXTq7W5w4nfo2U3n", "mode": "orbit", "fixedPoint": [0.5298507462686567, 0]}, "startArrowhead": null, "endArrowhead": "arrow", "elbowed": false}, {"id": "nHFj7wMs9DYj2rSolzvX", "type": "text", "x": 1660.0, "y": 590, "width": 164.45000000000002, "height": 16.25, "angle": 0, "strokeColor": "#374151", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0074", "roundness": null, "seed": 1013724232, "version": 1, "versionNonce": 1808290813, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "text": "queue depth, batch size", "fontSize": 13, "baseFontSize": null, "fontFamily": 5, "textAlign": "left", "verticalAlign": "top", "containerId": null, "originalText": "queue depth, batch size", "autoResize": true, "lineHeight": 1.25}, {"id": "Dlr6ndUZ9DlGtT3pYZ23", "type": "arrow", "x": 2170.0, "y": 550, "width": 1, "height": 120, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "dashed", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0075", "roundness": null, "seed": 76444778, "version": 1, "versionNonce": 877838618, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "points": [[0, 0], [0.0, 120]], "startBinding": {"elementId": "MNORMs0QSD6e4xWt4EF1", "mode": "orbit", "fixedPoint": [0.6333333333333333, 1]}, "endBinding": {"elementId": "uHKxnXTq7W5w4nfo2U3n", "mode": "orbit", "fixedPoint": [0.917910447761194, 0]}, "startArrowhead": null, "endArrowhead": "arrow", "elbowed": false}, {"id": "gXDoGZGmm3kPwm680Aq9", "type": "text", "x": 2180.0, "y": 590, "width": 150.15, "height": 16.25, "angle": 0, "strokeColor": "#374151", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0076", "roundness": null, "seed": 1376196035, "version": 1, "versionNonce": 275383684, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "text": "GPU util, errors, p99", "fontSize": 13, "baseFontSize": null, "fontFamily": 5, "textAlign": "left", "verticalAlign": "top", "containerId": null, "originalText": "GPU util, errors, p99", "autoResize": true, "lineHeight": 1.25}, {"id": "0Xc4HXPYTBEuNbg1LfMV", "type": "text", "x": 420, "y": 805, "width": 962.5000000000001, "height": 35.0, "angle": 0, "strokeColor": "#b91c1c", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0077", "roundness": null, "seed": 1995540331, "version": 1, "versionNonce": 1452506813, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "text": "Failure / cold start: a large version is never loaded on the request path. Warm pool + NVMe pre-placement before the rollout;\nif a region has no ready replica, fail over (extra latency) instead of erroring.", "fontSize": 14, "baseFontSize": null, "fontFamily": 5, "textAlign": "left", "verticalAlign": "top", "containerId": null, "originalText": "Failure / cold start: a large version is never loaded on the request path. Warm pool + NVMe pre-placement before the rollout;\nif a region has no ready replica, fail over (extra latency) instead of erroring.", "autoResize": true, "lineHeight": 1.25}, {"id": "Q0KXpHJTz9MfkdRbgMn2", "type": "text", "x": 420, "y": 865, "width": 1039.5, "height": 52.5, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0078", "roundness": null, "seed": 1423891377, "version": 1, "versionNonce": 1846611724, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "text": "Numbers to say: 10k req/s peak \u00b7 100 models, 100 MB\u2013100 GB \u00b7 small model batch 32 / 10 ms \u2192 3,200 req/s per GPU \u2192 4 GPUs for 10k, run 6\n100 GB pull at 10 Gbit/s = 80 s + NVMe\u2192GPU \u2248 20 s + warm-up \u2192 minutes, so a version switch is control-plane only\nqueue target 70% util \u00b7 rules stale by seconds is fine, calls never fail on the registry", "fontSize": 14, "baseFontSize": null, "fontFamily": 5, "textAlign": "left", "verticalAlign": "top", "containerId": null, "originalText": "Numbers to say: 10k req/s peak \u00b7 100 models, 100 MB\u2013100 GB \u00b7 small model batch 32 / 10 ms \u2192 3,200 req/s per GPU \u2192 4 GPUs for 10k, run 6\n100 GB pull at 10 Gbit/s = 80 s + NVMe\u2192GPU \u2248 20 s + warm-up \u2192 minutes, so a version switch is control-plane only\nqueue target 70% util \u00b7 rules stale by seconds is fine, calls never fail on the registry", "autoResize": true, "lineHeight": 1.25}, {"id": "kC6kQmHlIS8EUt09R44M", "type": "text", "x": 420, "y": 950, "width": 1078.0, "height": 35.0, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0079", "roundness": null, "seed": 837376288, "version": 1, "versionNonce": 1912856139, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "text": "Rollout: canary 10% \u2192 watch per-arm errors, p99, quality \u2192 50% \u2192 100%\nrollback = new generation, rules revert, v8 drains. A/B: sticky hash(key, experiment id); analysis reads the experiment log, not the router.", "fontSize": 14, "baseFontSize": null, "fontFamily": 5, "textAlign": "left", "verticalAlign": "top", "containerId": null, "originalText": "Rollout: canary 10% \u2192 watch per-arm errors, p99, quality \u2192 50% \u2192 100%\nrollback = new generation, rules revert, v8 drains. A/B: sticky hash(key, experiment id); analysis reads the experiment log, not the router.", "autoResize": true, "lineHeight": 1.25}, {"id": "BsSMIHQYr05HQjgbVmmk", "type": "text", "x": 420, "y": 1010, "width": 52.800000000000004, "height": 20.0, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0080", "roundness": null, "seed": 896744322, "version": 1, "versionNonce": 1738425754, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "text": "Legend", "fontSize": 16, "baseFontSize": null, "fontFamily": 5, "textAlign": "left", "verticalAlign": "top", "containerId": null, "originalText": "Legend", "autoResize": true, "lineHeight": 1.25}, {"id": "RtlyaRF2QNGFWxuT7ss0", "type": "rectangle", "x": 420, "y": 1040, "width": 22, "height": 22, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "#f3f4f6", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0081", "roundness": {"type": 3}, "seed": 325942801, "version": 1, "versionNonce": 826315488, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false}, {"id": "CSAy78SnjIarT5T1OVI8", "type": "text", "x": 450, "y": 1041, "width": 150.15, "height": 16.25, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0082", "roundness": null, "seed": 913554098, "version": 1, "versionNonce": 180330345, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "text": "client / other region", "fontSize": 13, "baseFontSize": null, "fontFamily": 5, "textAlign": "left", "verticalAlign": "top", "containerId": null, "originalText": "client / other region", "autoResize": true, "lineHeight": 1.25}, {"id": "SUaaeucH7CW9nOTs2uHJ", "type": "rectangle", "x": 650, "y": 1040, "width": 22, "height": 22, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "#dbeafe", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0083", "roundness": {"type": 3}, "seed": 1426863984, "version": 1, "versionNonce": 1305802528, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false}, {"id": "EoXaQFy1Z6HfZcLTW0bM", "type": "text", "x": 680, "y": 1041, "width": 92.95, "height": 16.25, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0084", "roundness": null, "seed": 1650441141, "version": 1, "versionNonce": 1505226475, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "text": "edge, gateway", "fontSize": 13, "baseFontSize": null, "fontFamily": 5, "textAlign": "left", "verticalAlign": "top", "containerId": null, "originalText": "edge, gateway", "autoResize": true, "lineHeight": 1.25}, {"id": "rQjaErzzKBAUusOOLsnI", "type": "rectangle", "x": 880, "y": 1040, "width": 22, "height": 22, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "#ffedd5", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0085", "roundness": {"type": 3}, "seed": 1061746778, "version": 1, "versionNonce": 133296889, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false}, {"id": "JVsuWYmzq5ZUWRBerSTf", "type": "text", "x": 910, "y": 1041, "width": 50.050000000000004, "height": 16.25, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0086", "roundness": null, "seed": 622127722, "version": 1, "versionNonce": 1269676485, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "text": "service", "fontSize": 13, "baseFontSize": null, "fontFamily": 5, "textAlign": "left", "verticalAlign": "top", "containerId": null, "originalText": "service", "autoResize": true, "lineHeight": 1.25}, {"id": "eg1SOmMQvvRsbGvtxNgV", "type": "rectangle", "x": 1110, "y": 1040, "width": 22, "height": 22, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "#dcfce7", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0087", "roundness": {"type": 3}, "seed": 1374941908, "version": 1, "versionNonce": 1331145597, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false}, {"id": "xswLDGu3wDhijquQvvuk", "type": "text", "x": 1140, "y": 1041, "width": 92.95, "height": 16.25, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0088", "roundness": null, "seed": 216495454, "version": 1, "versionNonce": 372000913, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "text": "store / rules", "fontSize": 13, "baseFontSize": null, "fontFamily": 5, "textAlign": "left", "verticalAlign": "top", "containerId": null, "originalText": "store / rules", "autoResize": true, "lineHeight": 1.25}, {"id": "Bw9Z3rjm0JsEaNSwIG5c", "type": "rectangle", "x": 1340, "y": 1040, "width": 22, "height": 22, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "#ede9fe", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0089", "roundness": {"type": 3}, "seed": 848769959, "version": 1, "versionNonce": 475420058, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false}, {"id": "RQQYrLEqfbHsgLWh601E", "type": "text", "x": 1370, "y": 1041, "width": 107.25000000000001, "height": 16.25, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0090", "roundness": null, "seed": 796176895, "version": 1, "versionNonce": 1009991538, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "text": "queue + batcher", "fontSize": 13, "baseFontSize": null, "fontFamily": 5, "textAlign": "left", "verticalAlign": "top", "containerId": null, "originalText": "queue + batcher", "autoResize": true, "lineHeight": 1.25}, {"id": "fl23W4ngSIJzKtELFVXV", "type": "rectangle", "x": 1570, "y": 1040, "width": 22, "height": 22, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "#fee2e2", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0091", "roundness": {"type": 3}, "seed": 647103090, "version": 1, "versionNonce": 1913597475, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false}, {"id": "keaZvGnVSkDdnElaTAB1", "type": "text", "x": 1600, "y": 1041, "width": 64.35000000000001, "height": 16.25, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0092", "roundness": null, "seed": 1277373914, "version": 1, "versionNonce": 1536051255, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "text": "GPU nodes", "fontSize": 13, "baseFontSize": null, "fontFamily": 5, "textAlign": "left", "verticalAlign": "top", "containerId": null, "originalText": "GPU nodes", "autoResize": true, "lineHeight": 1.25}, {"id": "1ujgHFO3TB69RRLi2qMt", "type": "rectangle", "x": 1800, "y": 1040, "width": 22, "height": 22, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "#fef9c3", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0093", "roundness": {"type": 3}, "seed": 1504377616, "version": 1, "versionNonce": 791769139, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false}, {"id": "TxMEmHGvuuvJfsLxXelC", "type": "text", "x": 1830, "y": 1041, "width": 92.95, "height": 16.25, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0094", "roundness": null, "seed": 1355533425, "version": 1, "versionNonce": 2057511733, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "text": "observability", "fontSize": 13, "baseFontSize": null, "fontFamily": 5, "textAlign": "left", "verticalAlign": "top", "containerId": null, "originalText": "observability", "autoResize": true, "lineHeight": 1.25}, {"id": "q1iv1ukX1Xyf2ICeXdrh", "type": "text", "x": 2070, "y": 1010, "width": 500.50000000000006, "height": 16.25, "angle": 0, "strokeColor": "#374151", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": "Cx2kUhpYP9Rqn51OJeD9", "index": "a0095", "roundness": null, "seed": 1774114257, "version": 1, "versionNonce": 2136481847, "isDeleted": false, "boundElements": [], "updated": 1790573240449, "created": 1790573240449, "link": null, "locked": false, "text": "solid = request bytes and weights   dashed = control, reports, metrics", "fontSize": 13, "baseFontSize": null, "fontFamily": 5, "textAlign": "left", "verticalAlign": "top", "containerId": null, "originalText": "solid = request bytes and weights   dashed = control, reports, metrics", "autoResize": true, "lineHeight": 1.25}], "appState": {"viewBackgroundColor": "#ffffff", "gridSize": null}, "files": {}}