|jM%"ddlmZddlZddlZddlmZddlmZmZmZm Z ddl Z ddl m Z ddl mZddlmZerdd lmZdd l mZdd lmZd d gZe ddZGddeeZGddejZd"dZdddd#d!ZdS)$) annotationsN)IntEnum) TYPE_CHECKINGLiteralProtocolTypeVar) DenseTensor) check_type)in_dygraph_mode) CapsuleType)Tensor) PlaceLike to_dlpack from_dlpack _T_contraT) contravariantc.eZdZdZdddddddZddZdS) SupportDLPackz ref: https://github.com/numpy/numpy/blob/7e6e48ca7aacae9994d18a3dadbabd2b91c32151/numpy/__init__.pyi#L3068-L3077 https://github.com/numpy/numpy/blob/7e6e48ca7aacae9994d18a3dadbabd2b91c32151/numpy/__init__.pyi#L4730-L4731 .N)stream max_version dl_devicecopyrNone | _T_contrartuple[int, int] | Nonertuple[IntEnum, int] | Noner bool | Nonereturnr cdSN)selfrrrrs c/lsinfo/ai/hellotax_ai/data_center/backend/venv/lib/python3.11/site-packages/paddle/utils/dlpack.py __dlpack__zSupportDLPack.__dlpack__2s ctuple[int, Literal[0]]cdSr r!)r"s r#__dlpack_device__zSupportDLPack.__dlpack_device__;sr%) rrrrrrrrrr )rr&)__name__ __module__ __qualname____doc__r$r(r!r%r#rr+sT$'.104 ?>>>>>r%rcNeZdZdZdZdZdZdZdZdZ dZ d Z d Z d Z d Zd ZdZdZdZdS) DLDeviceType))r ))))) ) ) ) ) )))))N)r)r*r+kDLCPUkDLCUDA kDLCUDAHost kDLOpenCL kDLVulkankDLMetalkDLVPIkDLROCM kDLROCMHost kDLExtDevkDLCUDAManaged kDLOneAPI kDLWebGPU kDLHexagonkDLMAIAkDLTrnr!r%r#r.r.>s^ FGKIIH FGKINIIJG FFFr%r.xrrr cXtrrt|tjs t dt |d|St|dtd|S)an Encodes a tensor to DLPack. Args: x (Tensor): The input tensor, and the data type can be ``bool``, ``float16``, ``float32``, ``float64``, ``int8``, ``int16``, ``int32``, ``int64``, ``uint8``, ``complex64``, ``complex128``. Returns: dltensor, and the data type is PyCapsule. Examples: .. code-block:: python :name: code-paddle-to-paddle >>> import paddle >>> # x is a tensor with shape [2, 4] >>> x = paddle.to_tensor([[0.2, 0.3, 0.5, 0.9], ... [0.1, 0.2, 0.6, 0.7]]) >>> dlpack = paddle.to_dlpack(x) >>> print(dlpack) >>> # doctest: +SKIP('the address will change in every run') >>> #doctest: -SKIP >>> # dlpack capsule will be renamed to 'used_dltensor' after decoded >>> y = paddle.from_dlpack(dlpack) >>> print(dlpack) >>> # doctest: +SKIP('the address will change in every run') .. code-block:: python :name: code-paddle-to-torch >>> # doctest: +SKIP('torch will not be installed') >>> # type: ignore >>> # convert tensor from paddle to other framework using to_dlpack >>> import torch >>> x = paddle.randn([2, 4]).to(device="cpu") >>> y = torch.from_dlpack(paddle.to_dlpack(x)) >>> print(y.shape) torch.Size([2, 4]) >>> # doctest: -SKIP zAThe type of 'x' in to_dlpack must be paddle.Tensor, but received .rNr) r isinstancepaddler TypeErrortypevalue get_tensor _to_dlpackr r )rNs r#rrQs\3!V]++ ,!%a,,,  wwyy##%%00222q# k222 <<>>r%)devicerdlpackSupportDLPack | CapsuleTyperXPlaceLike | Nonerrct|drfi}d|d<|||d<|Ktjj|}tjj||d<|}|dtj fvrtj 5tj dt tjj|d }dddn #1swxYwY|dtj k}|r |jdkrd n|j}||d < |jd i|} n4#t&$r%|d|jd i|} YnwxYw|} tjj| } t-r(tj| |  } | S)a Decodes a DLPack to a tensor. The returned Paddle tensor will share the memory with the tensor from given dlpack. Args: dlpack (SupportDLPack | CapsuleType): A PyCapsule object with the dltensor, or that implements '__dlpack__' and '__dlpack_device__' methods. If `dlpack` is a tensor (or ndarray) object, it must support the `__dlpack__` protocol (i.e., have a `dlpack.__dlpack__` method). Otherwise `dlpack` may be a DLPack capsule, which is an opaque `PyCapsule` instance, typically produced by a `to_dlpack` function or method. device (PlaceLike, optional): The device of the returned tensor. If not specified, the device will be the same as that of the input `dlpack`. copy (bool, optional): Whether or not to copy the input. If True, the output tensor always copied. If False, the output tensor must never copied, and raise a BufferError in case a copy is deemed necessary. If None, the output tensor must reuse the existing memory buffer if possible and copy otherwise. Default: None. Returns: out (Tensor): A tensor decoded from DLPack. The data type of returned tensor can be one of: ``int32``, ``int64``, ``float16``, ``float32`` and ``float64``. The device of returned tensor can be one of: ``CPU``, ``CUDAPlace``, ``CUDAPinnedPlace``. Examples: .. code-block:: python :name: code-paddle-from-paddle >>> import paddle >>> # From DLPack capsule >>> x = paddle.to_tensor([[0.2, 0.3, 0.5, 0.9], ... [0.1, 0.2, 0.6, 0.7]], place="cpu") >>> dlpack = paddle.to_dlpack(x) >>> y = paddle.from_dlpack(dlpack) >>> # dlpack capsule will be renamed to 'used_dltensor' after decoded >>> print(dlpack) >>> # doctest: +SKIP('the address will change in every run') >>> # doctest: -SKIP >>> print(y) Tensor(shape=[2, 4], dtype=float32, place=Place(cpu), stop_gradient=True, [[0.20000000, 0.30000001, 0.50000000, 0.89999998], [0.10000000, 0.20000000, 0.60000002, 0.69999999]]) >>> # data of tensor x is shared with tensor y >>> y[0, 0] = 10.0 >>> print(x) Tensor(shape=[2, 4], dtype=float32, place=Place(gpu:0), stop_gradient=True, [[10. , 0.30000001, 0.50000000, 0.89999998], [0.10000000, 0.20000000, 0.60000002, 0.69999999]]) .. code-block:: python :name: code-paddle-from-numpy >>> # Directly from external tensor that implements '__dlpack__' and '__dlpack_device__' methods >>> import paddle >>> import numpy as np >>> x = np.array([[0.2, 0.3, 0.5, 0.9], ... [0.1, 0.2, 0.6, 0.7]]) >>> y = paddle.from_dlpack(x) >>> y[0, 0] = 10.0 >>> # data of tensor x is shared with tensor y >>> print(x) [[10. 0.3 0.5 0.9] [ 0.1 0.2 0.6 0.7]] r$)r/r rNrrrignore)categoryr/r)placer!)hasattrrRbase framework_get_paddle_placecoreplace_to_dl_devicer(r.r?warningscatch_warningsfilterwarnings UserWarningrXcudacurrent_stream cuda_streamr$rSpoprr r_place) rYrXrkwargsr_ dlpack_deviceris_gpu stream_ptrdlpack_outs r#rrs?Zv|$$$ &}  !F6N  K);;FCCE"(+"2"E"Ee"L"LF; 0022    46 6 6(** M M';GGGG+::=;KLL M M M M M M M M M M M M M M M#1%)==FO 2a 7 7V=O  *F8  2'f'11&11GG 2 2 2 JJ} % % %'f'11&11GGG 2 -3[-=-I-I..C=mCszz||<<< Js%)AC;;C?C?8 E,E54E5)rNrrr )rYrZrXr[rrrr) __future__renumrfrtypingrrrrrR base.corer base.data_feederr base.frameworkr typing_extensionsr rpaddle._typingr__all__rrr.rrr!r%r#r~s#""""" <<<<<<<<<<<< ######)))))),,,,,,)------((((((  GKt 4 4 4 ?????HY'???&4<&8888| $ zzzzzzzzr%