Chrome Built-in AI
Chrome’s built-in AI APIs run a
model on the device. autotel-builtin-ai patches the globals and every session
they hand back, so each availability check, session creation and model call
becomes a span, and your calls stay as they are. Spans go to the global
OpenTelemetry tracer provider that autotel-web registers.
It is the counterpart to WebMCP: that one traces the tools a page offers an agent, this one traces the model a page runs.
Installation
Section titled “Installation”npm install autotel-builtin-ai autotel-webimport { initFull } from 'autotel-web/full';import { instrumentBuiltInAI } from 'autotel-builtin-ai';
initFull({ service: 'shop', endpoint: 'https://collector.example.com' });instrumentBuiltInAI();Call it before the page creates a session. A session created earlier keeps its original methods and produces no spans.
What it records
Section titled “What it records”The Prompt API looks synchronous and cheap. These are the costs and behaviours you can see only while a call runs:
availability()can answer for the options you pass it as well as for model readiness. On Canary 154, behind an experimental speculative-decoding flag, the guard in the documentation refused on a browser wherecreate()worked. Canary 159 no longer offers that flag and gives one answer either way.create()blocks for the whole model download: 190,163 ms measured, against 11–26 ms warm.- The download monitor fires when the model is already on disk, so a progress bar flashes 0→100 for a returning visitor.
- Web pages ignore
topKandtemperature: a session created withtemperature: 0reads backsamplingMode: 'balanced'on Canary 159. - Time to first token exists only while the stream runs.
| Span | When |
|---|---|
builtin_ai.availability |
The page asks whether a model is usable |
create_session {api} |
The page creates a session: create_session LanguageModel |
{method} {api} |
One model call: prompt LanguageModel, summarize Summarizer |
clone {api}, destroy {api} |
The page forks or tears down a session |
append {api}, measureContextUsage {api} |
The page adds context, or prices it before a prompt |
invoke_agent LanguageModel |
A question on a session with tools: the root of its trace |
execute_tool {name} |
A tool the page ran, rebuilt from the call and its response |
Model calls carry the GenAI attributes that apply on device:
gen_ai.operation.name, gen_ai.provider.name (google.chrome, or
microsoft.edge on Edge, which ships the same APIs over its own model),
gen_ai.conversation.id, gen_ai.request.stream, gen_ai.output.type,
gen_ai.response.finish_reasons and gen_ai.response.time_to_first_chunk.
The generative APIs report no model id and no per-call token counts, so their
spans carry context occupancy instead: builtin_ai.context.usage_before,
_after, _delta, remaining, utilization, plus
builtin_ai.context.compacted once the session overflows. SemanticEmbedder
reports its embedding space, embeddinggemma-300m on Canary 159, and its spans
carry it as gen_ai.request.model.
The package README lists every attribute. Three help before you build a dashboard.
builtin_ai.availability.options_supplied
Section titled “builtin_ai.availability.options_supplied”The one to watch. On Canary 154 with speculative decoding enabled and a working model:
await LanguageModel.availability(); // 'unavailable'await LanguageModel.availability({ samplingMode: 'most-predictable' }); // 'available'await LanguageModel.create({ samplingMode: 'most-predictable' }); // succeedsThere, availability() !== 'available', the shape the docs show, turned the
feature off for users who had it. On Canary 159 the flag is gone and
availability gives the same answer with or without options. If a later Chrome
brings the behaviour back, a bare guard followed by an optioned create()
shows up as two spans sharing an installation id, and one query finds it.
guardWouldRefuse(bare, withOptions) is exported for pages that want to check
it themselves.
builtin_ai.download.real
Section titled “builtin_ai.download.real”create() fires the download monitor when the model is already on disk, so
“the monitor fired” and “a download happened” are separate facts. A fractional
progress event proves a real fetch. Otherwise the availability answer from
before the call separates them, and the package takes that answer from the
page’s own availability() calls, so installing telemetry adds no calls of its
own. A page that never calls availability() gets no download.real.
builtin_ai.create.blocked_on_download says whether this call paid for the
fetch: the 190-second one.
Tool calls
Section titled “Tool calls”On a session created with tools, a question is one trace:
invoke_agent LanguageModel "Weather and population of Kyoto?"├── prompt LanguageModel asks for two tools├── execute_tool get_weather├── execute_tool get_population└── prompt LanguageModel "Light rain; 1.4 million people."Turns and tool runs are siblings, since they run one after another. Each
execute_tool spans from the end of the turn that asked for the call to the
moment the page sent its response, paired by callId. When the page moves on
without answering, the root closes with builtin_ai.exchange.abandoned.
Streaming
Section titled “Streaming”The package measures a streaming call as it drains:
gen_ai.response.time_to_first_chunk, builtin_ai.stream.chunks and .chars,
with tool-call chunks read out and passed on as Chrome sent them. You get the
stream at once, and the span closes when the stream does. A stream that fails
records error.type and error status; one you cancel records
builtin_ai.stream.cancelled, and cancelling it stops the model. A generation
that reaches the output limit records finish reason length.
Payload capture
Section titled “Payload capture”Capture is off by default. Prompts and outputs are people’s data, so you decide when they go on a span:
instrumentBuiltInAI({ capturePayloads: true, maxPayloadLength: 8192 });With capture on, the spans record prompts, outputs, system instructions, tool
definitions, and tool arguments and results in the GenAI message shapes. Image
and audio parts appear by modality only. Each attribute stays valid JSON within
maxPayloadLength: the package cuts long strings first, then trailing entries.
Character counts, timings, tool names and refusal kinds arrive either way.
builtin_ai.create.refusal is a classification of the platform’s error and
carries no caller data.
Refusals worth knowing
Section titled “Refusals worth knowing”builtin_ai.create.refusal classifies why create() threw:
sampling_incompatible, service_unavailable, feature_disabled,
download_failed or user_activation_required. Chrome downloads a model only
inside a user gesture, so a create() on page load works for returning visitors
and refuses for new ones; builtin_ai.create.user_activation on the span tells
you which.
Metrics
Section titled “Metrics”gen_ai.client.operation.duration and
gen_ai.client.operation.time_to_first_chunk follow the GenAI convention, and
builtin_ai.create.duration keeps model downloads out of call latency, split by
builtin_ai.download.real. Every span also carries the device’s memory, CPU
performance tier and logical cores, since on device the hardware sets the
latency.
Inspecting locally
Section titled “Inspecting locally”autotel-devtools shows these spans in its GenAI view: conversations grouped
by session, messages, tool calls, a context-window gauge from the reported
occupancy, and a timeline with each tool exchange on its own row.
Your own tracer
Section titled “Your own tracer”Pass tracer to send spans somewhere other than the global provider:
instrumentBuiltInAI({ tracer: provider.getTracer('builtin-ai') });Teardown
Section titled “Teardown”instrumentBuiltInAI() returns a handle whose uninstall() restores every
patched global and session method. Installations count references, so calling
it twice and uninstalling once leaves the instrumentation in place.
You can call it unconditionally: with no built-in AI globals present (an
unflagged Chrome, another browser, server rendering), it patches nothing and
returns a handle that does nothing. Restrict what it touches with apis:
instrumentBuiltInAI({ apis: ['LanguageModel', 'Summarizer'] });