jp dZddlmZddlZddlZddlZddlZddlmZm Z m Z m Z ddl m Z ddlmZddlmZmZmZddlmZdd lmZerdd lmZdd lmZmZdd lmZej>e Z!d Z"dZ#dZ$dZ%d#dZ&d#dZ'd$dZ(de)fd%dZ*d&dZ+d'dZ,d(dZ-d)dZ.d*dZ/d+dZ0d,dZ1d-dZ2GddZ3Gdd Z4de"ddddeddd! d.d"Z5y)/uLangSmith tracing for the OpenAI Agents SDK realtime backend. The Agents SDK's realtime sessions emit no local SDK trace spans (realtime tracing is server-side only), so the existing batch ``OpenAIAgentsTracingProcessor`` captures nothing here. This is a separate, complementary integration: :func:`wrap_realtime_session` wraps the ``RealtimeSession`` so the trace is built from its **semantic event stream**, while the caller's ``async for event in session`` loop is left untouched. The conversation is reconstructed from the full ``history`` snapshot the session delivers on every ``history_updated`` — not from the streamed events, which mis-deliver user messages and emit the assistant transcript as growing partials. Snapshots are folded into an item map keyed by stable ``item_id`` (latest text per id wins → partials collapse); each finalized message emits one span (a curated ``user_message`` or an assistant ``model`` ``llm`` span), grouped into turns. Each SDK-run tool becomes a single ``tool`` span spanning its ``tool_start``→``tool_end`` pair (so the span duration is the real tool latency); ``audio_interrupted`` flags the turn. Token usage — which the SDK exposes no *semantic* event for — is recovered from the raw ``response.done`` the SDK still forwards as a ``raw_model_event`` (``raw_server_event``), then attached to that turn's assistant ``model`` span so the conversation is priced (audio tokens included). Trace shape — one conversation = one trace:: realtime_session (root; transcript + WAV) ├── turn (latency_ms, was_interrupted) │ ├── user_message (curated user msg, from history) │ ├── lookup_weather (tool — args in / output out) │ └── model (assistant message) (llm — from history) └── turn … ) annotationsN) TYPE_CHECKINGAnyCallableOptional)get_package_version)observe_safely)DEFAULT_MAX_AUDIO_SECONDS EventSession start_session)usage_metadata_from_usage)tracing_context)Sequence)ClientRunTree) WriteReplicai]2c t|*t|ttttt t fr|St|S)zIKeep JSON-able values as-is; repr anything exotic so a span never breaks.) isinstancestrintfloatbooldictlistrepr)values y/var/www/html/Fitness-lenito-AI-main/venv/lib/python3.12/site-packages/langsmith/integrations/openai_realtime/_session.py _stringifyr!Ls, } 53UD$*MN ;ct|dd}t|tr|St|}t |t kr|S|dt dzS)z=Last-resort view of a value we won't (or can't) recurse into.nameN…)getattrrrrlen _MAX_REPR)rr$texts r _shallowr*SsJ 5&$ 'D$ ;Dt9 )4GtJY/?%/GGr"c tj|rSt|tsCtj|Dcic]$}|j t ||j d&}}n t |dd}|sy|jDcic]&\}}|jdrt|r$||(c}}Scc}wcc}}w)z?Public, non-callable attributes of a dataclass/object, or None.N__dict___) dataclasses is_dataclassrtypefieldsr$r&items startswithcallable)rfr1kvs r _public_fieldsr8\s&z%/F:E:L:LU:S :SQAFFGE16640 0:S   D1  'Aq||C/@RS1   s)B; C& C2Cc | t|ttttfr|St|t t tfrdtt |dS|tk\r t|St||vry|t|hz}t|tri}t|jD]k\}\}}|tk\rdt|tz d|d<|St|tr|j!drPt#||d z||t|<m|St|t$t&t(frht%|}|dtDcgc]}t#||d z|} }t|tkDr%| j+d t|tz d| St-|} | r2| jD cic]\} }| t#||d z|c}} St|Scc}wcc}} w) a Recursively coerce any value into a compact, JSON-able span payload. Keeps readable data and strips what would break or bloat a span: raw bytes, callables, private attributes, and anything past the depth/width caps. Cycles are broken via ``seen``. Nz +z morer%r-u… +)rrrrrbytes bytearray memoryviewr' _MAX_DEPTHr*idr enumerater2 _MAX_ITEMSr3_cleanrtuplesetappendr8) rdepthseenoutikeyvalr2r7cleanedr1r6s r rDrDls } 53UD*AB %%J783uU|$%W--  %yD 2e9+ D% &u{{}5MAzSJ Uj!8 9?E  #s#s(;"3 48CCM 6 %$s+,U 7<[j7IJ7I!6!UQY-7IJ u: " NNU3u: #:";5A B E "F :@,,.I.$!Q6!UQY--.II E?KJs G1G6c>t|ddxs| t|SdS)Nr$)r&r)tools r _tool_namerQs$ 4 & T9I4:TtTr"c|yt|dd}t|ddxsg}g}|D]2}t|ddxs t|dd}|s"|j|4|dj|xsdfS)z9Best-effort ``(role, text)`` for a realtime history item.NNNrolecontent transcriptr) )r&rGjoin)itemrTrUpartspartr)s r _item_textr\s | 4 &DdIt,2G Et\40OGD&$4O  LL  #((5/)T **r"ct|dd}t|dddk7ryt|ddxsdj}|syt|dd|fS)zExtract the user transcript from a ``raw_model_event``. Reads a ``raw_model_event`` wrapping an input-audio transcription completion (the wire-level source ``history`` can omit on a barge-in). Returns ``(item_id, transcript)`` or None. dataNr0#input_audio_transcription_completedrVitem_id)r&strip)eventr^rVs r raw_input_transcriptrds] 5&$ 'DtVT"&KK$ d39r@@BJ  4D ): 55r"ct|dd}t|dd}t|tr|jddk7ry|jd}t|tsyt |jdS)uToken usage from a ``raw_model_event`` wrapping a ``response.done``. The Agents SDK emits no semantic usage event, but still forwards the raw ``response.done`` (as a ``raw_server_event``), which carries ``response.usage`` — the only place per-turn token counts appear on this backend. Maps it via the shared Realtime usage mapper (so audio/cached detail is kept). Returns ``None`` for any other event or a payload without usage. r^Nr0z response.doneresponseusage)r&rrgetr )rcr^rawrfs r raw_response_usagerjsk 5&$ 'D $ %C c4 CGGFO$Fwwz"H h % $X\\'%: ;;r"cXt|dd}t|\}}t|dd||fS)zF``(item_id, role, text)`` for a ``history_added`` event's single item.rYNra)r&r\)rcrYrTr)s r history_itemrls4 5&$ 'DD!JD$ 4D )4 55r"cg}t|ddxsgD]/}t|\}}|jt|dd||f1|S)zK``(item_id, role, text)`` for every item in a ``history_updated`` snapshot.historyNra)r&r\rG)rcrJrYrTr)s r history_messagesrosS;=Cy$/525% d GD)T2D$?@6 Jr"ct|ddxs t|}t|}t|tr|nd|i}||d<d}|dvrtt|dddd|d<n|dk(r6t t|d d|d <t t|d d|d <d }nZ|d k(rMt t|d d|d <t t|d d|d <t t|d d|d <n|dk(rt|dd|d<n|dk(r*tt|dd\}}||c|d<|d<|dk(}n|dk(rEt|ddxsg}|rt|dnd\}}||c|d<|d<t||d<|dk(}ny|dk(r7tt|dddd|d<tt|dddd|d<n=|dk(rt t|d d|d <n|d!k(rt t|d!d|d!<|||fS)"z9Map a session event to ``(name, span_payload, inbound)``.r0NrF agent_start agent_endagentr$ tool_startrP argumentsTtool_endoutputaudio_interruptedra history_addedrYrTr)userhistory_updatedrnrS last_role last_textlengthhandoff from_agentto_agentguardrail_trippedmessageerror) r&rrDrrrQr!r\r')rcetypedumpedpayloadinboundrTr)rns r describe_eventrsA E64 ( 7DKE E]F(264(@fwPVFWGGFOG ,,"75'4#@&$O , $WUFD%AB)'%d*KL  * $WUFD%AB)'%d*KL &wuh'EF % %$UIt<  / !vt <= d+/(&. # #%D17R07Z ,\ d5942 gk2L&. )  ' E< .!  &geZ&FPTU  % %'y$(GH  ' %geWd&CD '7 ""r"ct|dd}t|tr|xsdSdD]&}t||d}t|ts!|s$|cSy)aBest-effort model name for a ``RealtimeSession`` (attribution only). The Agents SDK emits no per-response usage, so this never drives cost; it just tags the assistant ``llm`` span with ``ls_model_name``. Returns ``None`` when the model can't be read from the session. modelN) model_namer)r&rr)sessionrattrr$s r _resolve_modelrsT GWd +E%}'udD) dC TK( r"cveZdZdZddd ddZddZddZddZddZdd Z dd Z dd Z dd Z dd Z y)_AgentsRealtimeTraceraReconstructs the conversation from history snapshots and emits its spans. Folds each ``history`` snapshot into a map keyed by stable ``item_id`` (latest non-empty text wins, so partials collapse), emits one span per finalized message (a ``user_message`` or an assistant ``model`` ``llm`` span) grouped into per-user-turn ``turn`` spans, and spans ``tool_end`` / ``audio_interrupted`` from the live stream. Optionally notifies an ``on_message`` callback as finalized transcript lines arrive. N on_messagerc||_||_||_i|_t |_t |_d|_d|_i|_ yN) _trace _on_message_model_itemsrF_emitted _notified_latency_since_pending_usage _open_tools)selfrrrs r __init__z_AgentsRealtimeTracer.__init__"sQ % 13 "%% /2u,06: PRr"c.|jj}t|dd}|y|dk(r|j|y|dk(rOt |x}||_t |}|r-|\}}|j|d|fg||jdy|dk(r/|jt|g||jdy|d k(r.|jt|||jdy|d vry|d k(r|j|y|d k(r|j||yt|\}} } |d k(r|jjd|jj| ||| 5 dddy#1swYyxYw)zBObserve one session event: fold history, emit spans, time latency.r0Naudioraw_model_eventr{T hold_lastrzr|rqrurwry)was_interrupted)r$r)rnowr&record_first_audiorjrrd_observe_items_flushrlro _start_tool _end_toolradd_turn_metadata event_span) rrc received_atrrgrecrarVr$rrs r observez_AgentsRealtimeTracer.observe;skkoo' vt, =  G   # #K 0  % %+E22?&+#&u-C&)###gvz%B$C[Q d +  O #   e!4 5{ C KK$K '  % %    0 7 E KK$K '  0 0  L   U #  J  NN5+ . "0!6gw ' ' KK ) )$ ) ?[[ # #G[tW # U V U Us F  Fctt|dd}tt|dd}|jj |xsddd|i}|j j ||fgj|y)z:Open a held-open ``tool`` span for a ``tool_start`` event.rPNrv)r$run_typeinputs)rQr&r!r open_spanr setdefaultrG)rrcr$argsruns r rz!_AgentsRealtimeTracer._start_toollsz'%67'%d;<kk##&$  ##T4L"5<+ *  #'D  +r"c|j|r|sy||f|jvry|jj||f|j||y)zCSend one finalized transcript line to the on_message callback once.N)rradd)rrTr)s r rz_AgentsRealtimeTracer._notifysN    #4t  $<4>> )  D$<( t$r"c ||j|d}|j|dxsdj}|dvr|jj|y|sy|jj||j |||j j |||dk(rJ|j j|d|d|j jdd d|d  5 dddy|j jd |d |jd |jdd|_ y#1swYyxYw)z:Emit one message span for a finalized history item (once).rTr)r`rNr{)rarTrU user_messageT)rTrU)r$rrropenai) ls_provider ls_model_name)rusage_metadatametadata) rrbrrrr add_messagerr record_llmrr)rrrTr)s r rz"_AgentsRealtimeTracer._record_items,{{3' C (.B557 , , MM  c "   # T4  d+ 6>''DA !# &48 ( KK " "!,>#22)1DKKP #  #'D s 'D22D;)rr r$Optional[Callable[[str, str], None]]r Optional[str]returnNone)rcrrr)rcrrrrr)rr)rz list[tuple]rrrr)rrrr)rrrr)rT str | Noner)rrr)rrrr)__name__ __module__ __qualname____doc__rrrrrrrrrrr"r rrso<@# RR9 R  R  R2/b B8 !)2 ''%'r"rc|eZdZdZ d dZd dZd dZddZd dZddZ ddZ dd Z y )_TracedRealtimeSessionuAsync-context-manager proxy over a ``RealtimeSession`` that traces events. Delegates the underlying session's ``async with`` and every attribute (``send_audio``, …), iterates its events, and observes each. On exit it emits any pending messages and finalizes the conversation root (transcript + WAV). Exposes ``record_user_audio`` / ``record_agent_audio`` for the stereo WAV. c ||_|xsttj|_||_||_||_||_||_ ||_ | |_ | |_ d|_ d|_d|_d|_yr)_sessionruuiduuid4 _thread_id _sample_rate _project_name_tags _metadatar_max_audio_seconds_client _replicasr_tracer_ctx_aiter) rr thread_id sample_rate project_nametagsrrmax_audio_secondsclientreplicass r rz_TracedRealtimeSession.__init__s|   #8s4::<'8') !%"3 !/3 8<   r"cBttj|d|S)Nr)r&object__getattribute__)rr$s r __getattr__z"_TracedRealtimeSession.__getattr__!sv..tZ@$GGr"cK|jjd{ t|j|j|j |j |j|j|j|jdtd }||_ td|ji|j |j |j}|j||_t!||j"t%|j|_|S7#t($r|jS |jj*t-j.n&#t0$rt2j5dd YnwxYw|jj6t-j.d{7wxYww) Nzopenai-agents-realtimez openai-agents) rrrrrrrr integrationintegration_versionr)rrrrrzCvoice tracing: error unwinding context after a failed session enterTexc_info)r __aenter__r rrrrrrrrrrr __enter__rrrrr BaseException__exit__sysr  Exceptionloggerdebug __aexit__)rtracectxs r r z!_TracedRealtimeSession.__aenter__$sqmm&&((($ !// --!//ZZ"&"9"9||4$7$H E DK!%t7ZZ!// C MMODI0$"2"2.:WDL S ): yy$&DII&& 7 LL(!%! *$--))3<<>: : :  sWGDGC5DGF=5+E! F=! FF=F1F=5F86F==GcHK |j|jj|jF|*|jd||jj_|jj |j|jjddd |jj|||d{S#t$rtjddYqwxYw#|j|jjdddwwxYw7Yw)Nz: z)voice tracing: failed to finalize sessionTr)rrrrrrfinalizerrwarningrr rr)rexc_typeexctbs r rz _TracedRealtimeSession.__aexit__Ps 5||' **,{{&?/7/@/@.AC5,IDKKOO) $$&yy$ ""4t4]],,XsB???  W NNFQUN V Wyy$ ""4t4%?sBD"A8C r?sbB# 99D< 2()0   8 $    H  %&ik'TU + 6 <&6(#V"]']'@A=A=N $*"& $)-7;)B#154 44 4  4  4'454'4 4/44r"