o z3i3 @s ddlZddlmZmZddlmZddlmZmZm Z m Z m Z m Z ddl ZddlmZddlmZddlmZdd lmZmZdd lmZmZerTddlZd d lmZejreddlZGd ddej j!Z"eGdddZ#dddde$de%e&e e e&e'fffddZ(dS)N) dataclassfield)Path) TYPE_CHECKINGAnyClassVarDictOptionalUnion)config)DownloadConfig) array_cast) is_local_pathxopen)no_op_if_value_is_nullstring_to_dict) FeatureTypecs2eZdZdZdejjffdd ZddZZ S)Nifti1ImageWrapperzY A wrapper around nibabel's Nifti1Image to customize its representation. nifti_imagecs0tj|j|j|j|j|j|d||_dS)N)dataobjaffineheaderextrafile_mapdtype) super__init__rrrrrget_data_dtyper)selfr __class__e/lsinfo/ai/hellotax_ai/llm_service/venv_embed/lib/python3.10/site-packages/datasets/features/nifti.pyrs zNifti1ImageWrapper.__init__c Csddlm}m}m}m}ddlm}|j}|}| |j |j |j _ d|j _d|j _d}t|jdrNd|jjvrNt|jjddddurN|jjdj}|durTd}|||d } || g||dS) Nr)NiiVue ShowRender SliceTypeVolume)displayTrimagefilenamez volume.nii.gz)namedata) ipyniivuer%r&r'r(IPython.displayr)rto_bytesset_slice_type MULTIPLANARALWAYSoptsmultiplanar_show_rendershow_3d_crosshairmultiplanar_force_renderhasattrrgetattrr+ load_volumes) r r%r&r'r(r)bytes_nvr,volumer#r#r$ _repr_html_'s$         zNifti1ImageWrapper._repr_html_) __name__ __module__ __qualname____doc__nibnifti1 Nifti1Imagerr> __classcell__r#r#r!r$rs rc@seZdZUdZdZeed<edddZe e ed<dZ e e ed <e e e d Ze eed <edddd Ze ed <ddZdee eeedfdefddZd deddfddZd de jde jfddZdedee dfffddZdee je je j fde jfddZ!dS)!Niftia **Experimental.** Nifti [`Feature`] to read NIfTI neuroimaging files. Input: The Nifti feature accepts as input: - A `str`: Absolute path to the NIfTI file (i.e. random access is allowed). - A `pathlib.Path`: path to the NIfTI file (i.e. random access is allowed). - A `dict` with the keys: - `path`: String with relative path of the NIfTI file in a dataset repository. - `bytes`: Bytes of the NIfTI file. This is useful for archived files with sequential access. - A `nibabel` image object (e.g., `nibabel.nifti1.Nifti1Image`). Args: decode (`bool`, defaults to `True`): Whether to decode the NIfTI data. If `False` a string with the bytes is returned. `decode=False` is not supported when decoding examples. Examples: ```py >>> from datasets import Dataset, Nifti >>> ds = Dataset.from_dict({"nifti": ["path/to/file.nii.gz"]}).cast_column("nifti", Nifti()) >>> ds.features["nifti"] Nifti(decode=True, id=None) >>> ds[0]["nifti"] >>> ds = ds.cast_column("nifti", Nifti(decode=False)) >>> ds[0]["nifti"] {'bytes': None, 'path': 'path/to/file.nii.gz'} ``` TdecodeNF)defaultrepridznibabel.nifti1.Nifti1Imagerbytespathpa_type)rIinitrJ_typecCs|jSN)rO)r r#r#r$__call__kszNifti.__call__valuenib.Nifti1ImagereturncCstjrddl}nd}t|tr|ddSt|tr"t|ddSt|ttfr.d|dS|dur=t||j j r=t |St|t rz| ddurYtj|drYd| ddS| ddusg| ddurr| d| ddStd|dtd t|d) zEncode example into a format for Arrow. Args: value (`str`, `bytes`, `nibabel.Nifti1Image` or `dict`): Data passed as input to Nifti feature. Returns: `dict` with "path" and "bytes" fields rNrNrMrNrLrMzTA nifti sample should have one of 'path' or 'bytes' but they are missing or None in .zPA nifti sample should be a string, bytes, Path, nibabel image, or dict, but got )r NIBABEL_AVAILABLEnibabel isinstancestrrabsoluterM bytearray spatialimages SpatialImageencode_nibabel_imagedictgetosrNisfile ValueErrortype)r rTrCr#r#r$encode_examplens,       zNifti.encode_examplercCsjtjrddl}ntd|duri}|d|d}}|dur|dur+td|d|dr@t|d d r@|d d }t|rM||}t|S|d d }|tj r]tj ntj }t ||} | durp| | d nd} t| d } t|d | d} || }Wdt|S1swYt|Sddl} |dddkr| |}|j|}t|S)aDecode example NIfTI file into nibabel image object. Args: value (`str` or `dict`): A string with the absolute NIfTI file path, a dictionary with keys: - `path`: String with absolute or relative NIfTI file path. - `bytes`: The bytes of the NIfTI file. token_per_repo_id (`dict`, *optional*): To access and decode NIfTI files from private repositories on the Hub, you can pass a dictionary repo_id (`str`) -> token (`bool` or `str`). Returns: `nibabel.Nifti1Image` objects rNz:To support decoding NIfTI files, please install 'nibabel'.rNrMzBA nifti should have one of 'path' or 'bytes' but both are None in rXzgzip://::repo_idtokenrbdownload_configr s)r rYrZ ImportErrorrf startswithrsplitload HF_ENDPOINTHUB_DATASETS_URLHUB_DATASETS_HFFS_URLrrcr rgzip decompressrE from_bytesr)r rTtoken_per_repo_idrCrNr;nifti source_urlpatternsource_url_fieldsrmrpfrxr#r#r$decode_examplesD           zNifti.decode_examplestoragecsduritfddtjfdd|Dtd}tjdd|dDtd}tjj||gd dg| d }t ||j S) a8Embed NifTI files into the Arrow array. Args: storage (`pa.StructArray`): PyArrow array to embed. Returns: `pa.StructArray`: Array in the NifTI arrow storage type, that is `pa.struct({"bytes": pa.binary(), "path": pa.string()})`. Ncs|dd}|tjrtjntj}t||}|dur#|dnd}t|d}t |d|d }| WdS1s@wYdS)Nrirjrkrlrnro) rsrrr rurvrwrrcr rread)rNr}r~rrmrpr)r{r#r$ path_to_bytess  $z*Nifti.embed_storage..path_to_bytescs8g|]}|dur|ddur|dn|dndqS)NrMrNr#).0x)rr#r$ s*z'Nifti.embed_storage..rgcSs$g|]}|durtj|ndqSrR)rdrNbasename)rrNr#r#r$rs$rNrMmask) rpaarray to_pylistbinaryrstring StructArray from_arraysis_nullrrO)r rr{ bytes_array path_arrayr#)rr{r$ embed_storages    zNifti.embed_storagercCs(ddlm}|jr |S|d|ddS)zfIf in the decodable state, return the feature itself, otherwise flatten the feature into a dictionary.r)ValuerrrL)featuresrrH)r rr#r#r$flattens z Nifti.flattencCs<tj|jr%tjdgt|td}tjj||gddg| d}nstj |jrJtjdgt|t d}tjj||gddg| d}nNtj |jr|j ddkr_|d}ntjdgt|td}|j ddkr{|d}ntjdgt|t d}tjj||gddg| d}t||jS)aCast an Arrow array to the Nifti arrow storage type. The Arrow types that can be converted to the Nifti pyarrow storage type are: - `pa.string()` - it must contain the "path" data - `pa.binary()` - it must contain the NIfTI bytes - `pa.struct({"bytes": pa.binary()})` - `pa.struct({"path": pa.string()})` - `pa.struct({"bytes": pa.binary(), "path": pa.string()})` - order doesn't matter Args: storage (`Union[pa.StringArray, pa.StructArray, pa.BinaryArray]`): PyArrow array to cast. Returns: `pa.StructArray`: Array in the Nifti arrow storage type, that is `pa.struct({"bytes": pa.binary(), "path": pa.string()})`. NrrMrNrr)rtypes is_stringrgrlenrrrr is_binaryr is_structget_field_indexrrrO)r rrrr#r#r$ cast_storage s     zNifti.cast_storagerR)"r?r@rArBrHbool__annotations__rrKr r\rrrstructrrrOrrQrSr rMr^rbrhrrrrr StringArray BinaryArrayrr#r#r#r$rG?s  "$ (?(( rGFimgrU force_bytesrVcCs@t|dr|jdur|s|jdj}|ddS|}d|dS)a Encode a nibabel image object into a dictionary. If the image has an associated file path, returns the path. Otherwise, serializes the image content into bytes. Args: img: A nibabel image object (e.g., Nifti1Image). force_bytes: If `True`, always serialize to bytes even if a file path exists. Needed to upload bytes properly. Returns: dict: A dictionary with "path" or "bytes" field. rNr*rW)r8rr+r0)rrr+ bytes_datar#r#r$ra/s    ra)F))rd dataclassesrrpathlibrtypingrrrrr r pyarrowrr download.download_configr tablerutils.file_utilsrrutils.py_utilsrrrZrCrrrYrDrErrGrrbr\rMrar#r#r#r$s(      (0p