o ?7i_4@sUdZddlZddlZddlmZmZmZmZddlmZm Z ddl Z e e Z GdddZdaeeed<defd d ZdS) zw Network Traffic Statistics Service Aggregates and queries network traffic data using Redis for real-time statistics. N)DictListOptionalAny)datetime timedeltac@s(eZdZdZd+defddZ  d,deded ed ed ed ed eedeefddZde ee ffddZ d-dede ee ffddZ d.dede e ee ffddZd.dede e ee ffddZd/dedede e ee ffd d!Zd"ed#efd$d%Zd&edefd'd(Zde ee ffd)d*ZdS)0TrafficStatsServicez Service for aggregating and querying network traffic statistics. Uses Redis for: - Sliding window counters (1min, 5min, 15min, 1hour) - Per-endpoint traffic accumulation - Per-tenant bandwidth tracking Ntraffic: key_prefixcCs.||_||_|du|_|jstddSdS)z Initialize traffic stats service. Args: redis_client: Redis client instance (optional) key_prefix: Prefix for Redis keys Nz:Redis client not provided. Traffic stats will be disabled.) redis_clientr enabledloggerwarning)selfr r rM/lsinfo/ai/hellotax_ai/base_platform/app/services/monitoring/traffic_stats.py__init__s  zTrafficStatsService.__init__endpointmethod request_size response_size status_code duration_ms tenant_iduser_idc  Cs|jsdSztt} ||} |dd|d| dD]>} |jd| d| || } |j| dd|j| d | |j| d ||j| d ||j| || d q|jd |} |j| dd|j| d | |j| d ||j| d ||j| d|r|jd|}|j|dd|j|d | |j|d|r|jd|}|j|dd|j|d | |j|d|jj |jd|| iddWdSt y}zt d|WYd}~dSd}~ww)a Record a request's traffic metrics. Args: endpoint: Normalized endpoint path method: HTTP method request_size: Request body size in bytes response_size: Response body size in bytes status_code: HTTP status code duration_ms: Request duration in milliseconds tenant_id: Tenant ID (optional) user_id: User ID (optional) Nzrequests:totalzbandwidth:total1min5min15min1hourwindow::requests bandwidth request_bytesresponse_bytes endpoint:iQztenant:zuser:endpoints:by_bandwidthT)incrz Failed to record traffic stats: ) r inttime_increment_counterr _window_secondsr hincrbyexpirezadd Exceptionr error)rrrrrrrrr current_timetotal_bandwidthwindow window_key endpoint_key tenant_keyuser_keyerrrrecord_request(sN      z"TrafficStatsService.record_requestreturnc Cs*|js|Szott}|jd|d}|j|}t|dd}t|dd}t|dd}t|dd}|d}|d} t|d t| d t d |||||dkrdt||d nd|dkrpt||d ndd d WSt y} zt d | |WYd} ~ Sd} ~ ww)z{ Get current real-time traffic statistics. Returns: Dict with current traffic metrics z window:1min:<requestsr bandwidth request_bytesresponse_bytesgN@r'requests_per_sec bytes_per_sec timestamptotal_requests total_bytesr%r&avg_request_sizeavg_response_sizecurrent last_minutezFailed to get current stats: N)r _empty_statsr+r,r r hgetallgetroundrutcnow isoformatr2r r3) rr4r7 window_datar#r$r%r&rDrEr;rrrget_current_statsts:   z%TrafficStatsService.get_current_statsr periodc Cs|js |dddSzFtt}||}||}|jd|d|}|j|}|t|ddt|ddt|ddt|ddt d WSt yo}zt d ||dddWYd }~Sd }~ww) z Get bandwidth usage over a time period. Args: period: Time period (1min, 5min, 15min, 1hour) Returns: Dict with bandwidth usage metrics r)rWrIrHr!r"r@r?rArB)rWrIrHr%r&rFzFailed to get bandwidth usage: N)r r+r,r.r r rPrQrrSrTr2r r3)rrWr4window_seconds window_idr7rUr;rrrget_bandwidth_usages(     z'TrafficStatsService.get_bandwidth_usage limitc Cs(|jsgSzr|jj|jdd|ddd}g}|D]Z\}}|d}|jd|}|j|}t|dd} t|d d} t|d d} t|d d} ||| | | | | dkrct | | d nd| dkrot | | d ndd q|WSt y} zt d| gWYd} ~ Sd} ~ ww)z Get traffic statistics grouped by endpoint. Args: limit: Maximum number of endpoints to return Returns: List of endpoint traffic stats r)rrT) withscoresutf-8r(r?r@rArBr')rr#rIr%r&rJrKz#Failed to get traffic by endpoint: N) r r zrevranger decoderPr+rQappendrRr2r r3)rr\ top_endpointsresultsendpoint_bytesr5rr8 endpoint_datar#r$r%r&r;rrrget_traffic_by_endpointsB       z+TrafficStatsService.get_traffic_by_endpointc Cs|jsgSzeg}d} |jj||jddd\}}|||dkr$nq g}|d|D]-}|ddd }|j|}t| d d} t| d d} | t|| | d q-|j d ddd|d|WSt y} zt d| gWYd} ~ Sd} ~ ww)z Get traffic statistics grouped by tenant. Args: limit: Maximum number of tenants to return Returns: List of tenant traffic stats rTztenant:*d)matchcountNr^r"r?r@)rr#rIcSs|dS)NrIr)xrrrsz;TrafficStatsService.get_traffic_by_tenant..)keyreversez!Failed to get traffic by tenant: )r r scanr extendr`splitrPr+rQrasortr2r r3) rr\ tenant_keyscursorkeysrcr9r tenant_datar#r$r;rrrget_traffic_by_tenantsB      z)TrafficStatsService.get_traffic_by_tenantr$byc CsP|jsgSz||WSty'}ztd|gWYd}~Sd}~ww)z Get top bandwidth consumers (users or tenants). Args: limit: Maximum number of consumers to return by: Sort by 'bandwidth' or 'requests' Returns: List of top consumers zFailed to get top consumers: N)r rfr2r r3)rr\rxr;rrrget_top_consumers"s  z%TrafficStatsService.get_top_consumersrmvaluecCs |j|}|j||dS)zIncrement a Redis counterN)r r incrby)rrmrzfull_keyrrrr-7sz&TrafficStatsService._increment_counterr6cCsddddd}||dS)zGet window size in secondsr>i,iir)rQ)rr6windowsrrrr.<s  z#TrafficStatsService._window_secondscCs(ddtdddddddddS)zReturn empty stats structurerrCrGrL)rrSrT)rrrrrOFs z TrafficStatsService._empty_stats)Nr )NN)r )r[)r[r$)__name__ __module__ __qualname____doc__strrr+rr<rrrVrZrrfrwryr-r.rOrrrrrs<  L- ! 0$0 r_traffic_stats_servicer=c CstdurUz0ddl}ddlm}|jr|j|jdd}n|j|j|j|j |j dd}t |at dWtStyT}zt d|t dd aWYd}~tSd}~wwtS) z-Get or create traffic stats service singletonNr)settingsF)decode_responses)hostportdbpasswordrz,Traffic stats service initialized with Redisz.Failed to initialize Redis for traffic stats: )r )rredis app.configr REDIS_URLfrom_urlRedis REDIS_HOST REDIS_PORTREDIS_DBREDIS_PASSWORDrr infor2r)rrr r;rrrget_traffic_stats_service]s"  r)rr,loggingtypingrrrrrrjson getLoggerr~r rr__annotations__rrrrrs M