o :/Êiñ ã@s–dZddlmZddlmZddlZzddlmZWne y(d$dd „ZYnwd%dd„Z ed&dd„ƒZ d'dd„Z d(dd„Z d)dd „Zd*d"d#„ZdS)+aSmall helper wrappers for external Oink Blackwell custom ops. vLLM does not depend on the external Oink repository/package. When an external plugin registers torch.library.custom_op entrypoints under the `oink::` namespace (e.g. via vLLM's general_plugins mechanism) and `VLLM_USE_OINK_OPS=1` is set, vLLM can route eligible calls to those ops. This module provides: - A single place to probe Oink op availability at module init time (outside torch.compile tracing), and - Thin wrappers around the torch.ops entrypoints for use in CUDA fast paths, without introducing graph breaks. Important: Do not call the availability helpers in a compiled region. They may call functions decorated with `torch._dynamo.disable` to safely check conditions that should not be traced. é)Ú annotations)ÚCallableN)ÚdisableÚfnrcCs|S)N©)rrrú[/lsinfo/ai/hellotax_ai/llm_service/venv_vllm/lib/python3.10/site-packages/vllm/_oink_ops.pyÚ_dynamo_disable srÚop_nameÚstrÚreturnÚboolcCsttjdƒo ttjj|ƒS)z*Check if a specific oink op is registered.Úoink)ÚhasattrÚtorchÚopsr )r rrrÚ _has_oink_op$srÚ device_indexÚintcCsXtj ¡sdSztj |¡\}}d||}|dkrWdSWtdƒSty+YdSw)aTReturn True if Oink ops are registered and device is SM100+. This function is intended to be called during module initialization (e.g., in RMSNorm.__init__), not in the forward path. External plugins are expected to gate registration on SM100+ and VLLM_USE_OINK_OPS=1, so if the ops are present they should be usable. Fé édÚrmsnorm)rÚcudaÚ is_availableÚget_device_capabilityÚ Exceptionr)rÚmajorÚminorÚsmrrrÚis_oink_available_for_device)s  ÿ ýÿrcCstdƒS)z3Return True if the in-place fused op is registered.Úfused_add_rms_norm)rrrrrÚhas_fused_add_rms_normAsr Úxú torch.TensorÚweightÚepsÚfloatcCstjj |||¡S)z_Call `torch.ops.oink.rmsnorm`. This wrapper is safe to call in torch.compile regions. )rrr r)r!r#r$rrrrFsrÚresidualÚNonecCstjj ||||¡dS)zBCall `torch.ops.oink.fused_add_rms_norm` (mutates x and residual).N)rrr r©r!r&r#r$rrrÚfused_add_rms_norm_Nsr)ú!tuple[torch.Tensor, torch.Tensor]cCst||||ƒ||fS)zDConvenience wrapper returning (x, residual) after in-place mutation.)r)r(rrrrXsr)rr)r r r r )rrr r )r r )r!r"r#r"r$r%r r") r!r"r&r"r#r"r$r%r r') r!r"r&r"r#r"r$r%r r*)Ú__doc__Ú __future__rÚcollections.abcrrÚ torch._dynamorrrrrr rr)rrrrrÚs    þ