|
Server : Apache System : Linux server.mata-lashes.com 3.10.0-1160.90.1.el7.x86_64 #1 SMP Thu May 4 15:21:22 UTC 2023 x86_64 User : matalashes ( 1004) PHP Version : 8.1.29 Disable Function : NONE Directory : /usr/lib/python3.6/site-packages/pip/_vendor/chardet/__pycache__/ |
Upload File : |
3
�υ_ � @ s4 d dl mZ d dlmZmZmZ G dd� de�ZdS )� )�
CharSetProber)�CharacterCategory� ProbingState�SequenceLikelihoodc sb e Zd ZdZdZdZdZd� fdd� Z� fd d
�Ze d d � �Z
e d
d� �Z dd� Z dd� Z
� ZS )�SingleByteCharSetProber�@ i gffffff�?g�������?FNc sJ t t| �j� || _|| _|| _d | _d | _d | _d | _ d | _
| j � d S )N) �superr �__init__�_model� _reversed� _name_prober� _last_order�
_seq_counters� _total_seqs� _total_char�
_freq_char�reset)�self�model�reversedZ name_prober)� __class__� �%/usr/lib/python3.6/sbcharsetprober.pyr ' s z SingleByteCharSetProber.__init__c s: t t| �j� d| _dgtj� | _d| _d| _d| _ d S )N� � )
r r r r
r Zget_num_categoriesr r r r )r )r r r r 5 s z SingleByteCharSetProber.resetc C s | j r| j jS | jd S d S )N� charset_name)r r r
)r r r r r ? s z$SingleByteCharSetProber.charset_namec C s | j r| j jS | jjd�S d S )N�language)r r r
�get)r r r r r F s z SingleByteCharSetProber.languagec C sn | j d s| j|�}|s | jS | j d }x�t|�D ]�\}}|| }|tjk rZ| jd7 _|| jk r�| jd7 _| j | jk r�| j
d7 _
| j s�| j | j | }| j d | }n || j | j }| j d | }| j | d7 < || _ q2W | j d }| jt
jk�rh| j
| jk�rh| j� }|| jk�r@| jjd||� t
j| _n(|| jk �rh| jjd||| j� t
j| _| jS )NZkeep_english_letter�char_to_order_mapr Zprecedence_matrixr z$%s confidence = %s, we have a winnerz9%s confidence = %s, below negative shortcut threshhold %s)r
Zfilter_international_words�state� enumerater ZCONTROLr � SAMPLE_SIZEr r
r r r r Z DETECTING�SB_ENOUGH_REL_THRESHOLD�get_confidence�POSITIVE_SHORTCUT_THRESHOLDZlogger�debugZFOUND_ITZ_state�NEGATIVE_SHORTCUT_THRESHOLDZNOT_ME) r Zbyte_strr �i�c�orderr r Z
confidencer r r �feedM sF
z SingleByteCharSetProber.feedc C sN d}| j dkrJd| jtj | j | jd }|| j | j }|dkrJd}|S )Ng{�G�z�?r g �?Ztypical_positive_ratiog�G�z��?)r r r ZPOSITIVEr
r r )r �rr r r r# | s
z&SingleByteCharSetProber.get_confidence)FN)�__name__�
__module__� __qualname__r! r" r$ r& r r �propertyr r r* r# �
__classcell__r r )r r r ! s
/r N)Z
charsetproberr Zenumsr r r r r r r r �<module> s