|
Server : Apache/2.2.17 (Unix) mod_ssl/2.2.17 OpenSSL/0.9.8e-fips-rhel5 DAV/2 PHP/5.2.17 System : Linux localhost 2.6.18-419.el5 #1 SMP Fri Feb 24 22:47:42 UTC 2017 x86_64 User : nobody ( 99) PHP Version : 5.2.17 Disable Function : NONE Directory : /proc/21573/root/usr/lib/python2.4/site-packages/urlgrabber/ |
Upload File : |
mò
AÝrMc @ s d k Z d k Z d k Z d k Z d k Z d k Z d k Z d d „ Z d a d a
d d d „ Z d f d „ ƒ YZ d f d „ ƒ YZ
d a d a d d
„ Z d e
f d „ ƒ YZ e Z d
e
f d „ ƒ YZ d f d „ ƒ YZ d e f d „ ƒ YZ d f d „ ƒ YZ d d „ Z d d d „ Z d „ Z e d j oºe e i ƒ d j oF e i d d j o2 e d d d d d d d d d d ƒ n e d d d d d d< d= d> ƒ e d% d d d d d? d@ dA dB ƒ e d& d' d d( d dC dD dE dF ƒ e d) d* d d d dG dH dI ƒ e d+ d, d d- d dJ dK dL ƒ e d. d/ d d0 d dM dN dO ƒ e d1 d2 d d d dP ƒ e d3 d4 d d5 d dQ ƒ e d6 d7 d d8 d dR ƒ e d9 d d d d dS dT dU dV dW dX dY dZ d[ d\ d] d^ d_ d` da db dc dd de ƒ n d S(f Ni c C sc yQ d } t i | t i | ƒ } t i d | ƒ d } | d j o d Sn | SWn d Sn Xd S( s Get the real terminal width t abcdefght hhhhi i iP N( t buft fcntlt ioctlt fdt termiost
TIOCGWINSZt structt unpackt ret( R R
R ( ( t7 /usr/lib/python2.4/site-packages/urlgrabber/progress.pyt terminal_width s
f1.0c C sD t i ƒ } t d j p | t | j o t | ƒ a | a n t S( s6 Get the real terminal width, but cache it for a bit. N( t timet nowt _term_width_valt Nonet _term_width_lastt
cache_timeoutR R ( R R R ( ( R t terminal_width_cached- s
t TerminalLinec B sM t Z d Z d e d d d „ Z d „ Z d d „ Z e d „ Z d „ Z RS(
sB Help create dynamic progress bars, uses terminal_width_cached(). i i f1.0c C s\ | d j o
| } n | | _ t | | ƒ | _ | i | j o
| | _ n t | _
d S( N( t beg_lenR t min_restt selft _min_lenR R R t _llent Falset _fin( R R R R R ( ( R t __init__; s
c C s | i | i S( s Usable length for elements. N( R R R ( R ( ( R t __len__D s i c C s' | i | j o d Sn | i | | S( sw After a fixed length, split the rest of the line length among
a number of different elements (default=2). i N( R R t fixedt elements( R R R ( ( R t
rest_splitH s c C sh | d j o t | ƒ } n t | ƒ | j o
t | _ n | i o d Sn | i t | ƒ 8_ | S( s‹ If there is room left in the line, above min_len, add element.
Note that as soon as one add fails all the rest will fail too. t N( t full_lenR t lent elementR t TrueR R ( R R$ R" ( ( R t addO s
c C s | i S( sA Current rest of line, same as .rest_split(fixed=0, elements=1). N( R R ( R ( ( R t rest] s ( t __name__t
__module__t __doc__R R R R R& R' ( ( ( R R 8 s t BaseMeterc B sh t Z d „ Z d d d d d d d „ Z d d „ Z d d „ Z d d „ Z d d „ Z d d „ Z RS( Nc C sa d | _ d | _ d | _ d | _ d | _ d | _ d | _ d | _ d | _
t ƒ | _ d S( Nf0.29999999999999999i (
R t
update_periodR t filenamet urlt basenamet textt sizet
start_timet last_amount_readt last_update_timet
RateEstimatort re( R ( ( R R b s c C s | | _ | | _ | | _ | | _ | | _ | d j o t | ƒ d | _ n | d j o t
i
ƒ } n | | _ | i i
| | ƒ d | _ | | _ | i | ƒ d S( Nt Bi ( R- R R. R/ R0 R1 R t
format_numbert fsizeR R
R2 R6 t startR3 R4 t _do_start( R R- R. R/ R1 R R0 ( ( R R: o s
c C s d S( N( ( R R ( ( R R; s c C s| | d j o t i ƒ } n | | i | i j p | i o9 | i i | | ƒ | | _ | | _ | i
| | ƒ n d S( N( R R R
R R4 R, R6 t updatet amount_readR3 t
_do_update( R R= R ( ( R R< „ s
" c C s d S( N( ( R R= R ( ( R R> s c C sV | d j o t i ƒ } n | i i | | ƒ | | _ | | _ | i | | ƒ d S( N(
R R R
R R6 R< R= R3 R4 t _do_end( R R= R ( ( R t end’ s
c C s d S( N( ( R R= R ( ( R R? ™ s (
R( R) R R R: R; R< R> R@ R? ( ( ( R R+ a s
i c C s | a | a d S( N( R1 t _text_meter_total_sizet
downloadedt _text_meter_sofar_size( R1 RB ( ( R t text_meter_total_size¡ s t TextMeterc B s/ t Z e i d „ Z d d „ Z d d „ Z RS( Nc C s t i | ƒ | | _ d S( N( R+ R R t fo( R RF ( ( R R × s
c C s¦ | i i ƒ } t | ƒ }
t | ƒ } | i d j o
| i } n
| i } t | i i ƒ ƒ } d } t o t | } | d t } n t d d d d ƒ }
|
i d | ƒ } | i d j oh |
i d |
ƒ } |
i d d ƒ } |
i d | ƒ } d |
i ƒ |
i ƒ | | | | | f } nY| i i ƒ } t | ƒ } | i i ƒ } |
i d | ƒ } |
i d
ƒ } | d j o
d } n |
i d | d
t" d ƒ ƒ} |
i d | d ƒ } |
i d | ƒ } d |
i$ d d d ƒ } d t& | | ƒ } | | t& | | ƒ d j o | d 7} n |
i d | | | f ƒ } d |
i ƒ |
i ƒ | | | | | | | | f
} | i) i* | ƒ | i) i+ ƒ d S( Nid i i s | %5sBs %9st i s %5sB/ss %-*.*s%s%s%s%s
s ETA R! s (%i%%)R" s (100%)s %2i%%i t =f0.5t -s [%-*.*s]s %-*.*s%s%s%s%s%s%s%s
(, R R6 t elapsed_timet etimet format_timet fetimeR8 R= t freadR0 R R/ t average_ratet ave_dlt
sofar_sizeRA RC t sofar_pcR t tlR& t ui_sizeR1 t ui_timet ui_endt ui_rateR' t outt remaining_timet rtimet frtimet
fraction_readt fract ui_sofar_pcR# t ui_pcR t blent intt bart ui_barRF t writet flush( R R= R RU R0 RN RW R` RT RX RM Rc RK RS R_ R[ R] RQ R^ RZ Rb RV RP RR ( ( R R> Û sJ
/
4c C sO t | i i ƒ ƒ } t | ƒ } | i d j o
| i } n
| i
} t d ƒ } | i
d | ƒ } | i
d | ƒ } | i d j o
| | i j } | o | i
d ƒ }
n | i
d d ƒ }
d | i ƒ | i ƒ | | | |
f } | i i | ƒ | i i ƒ | o d Sn t o t | 7a n t t j o d a d a n d S( Ni s | %5sBs %9ss ... RG i s
%-*.*s%s%s%s
i ( RL R R6 RJ t
total_timeR8 R= t
total_sizeR0 R R/ R RS R& RT RU R1 t not_doneRV R' RX RF Rd Re RA RC ( R R= R Rf RU Rg R0 Rh RT RS RV RX ( ( R R? s0
(
( R( R) t syst stderrR R R> R? ( ( ( R RE Ö s 6t MultiFileHelperc B sA t Z d „ Z d „ Z d „ Z d „ Z d d „ Z d „ Z RS( Nc C s t i | ƒ | | _ d S( N( R+ R R t master( R Rl ( ( R R 8 s
c C s | i i | | ƒ d S( N( R Rl t start_meterR ( R R ( ( R R; < s c C s | i i | | ƒ d S( N( R Rl t update_meterR ( R R= R ( ( R R> ? s c C s? t | | i ƒ | _ t | i ƒ | _ | i i | | ƒ d S( N(
RL R R R2 t ftotal_timeR8 R3 t ftotal_sizeRl t end_meter( R R= R ( ( R R? C s c C s | i i | | | ƒ d S( N( R Rl t
failure_metert messageR ( R Rs R ( ( R t failureH s c C s | i i | | ƒ d S( N( R Rl t
message_meterRs ( R Rs ( ( R Rs K s ( R( R) R R; R> R? R Rt Rs ( ( ( R Rk 7 s t MultiFileMeterc B sÅ t Z e Z d „ Z d d d d „ Z d „ Z d d „ Z d „ Z d „ Z
d „ Z d „ Z d „ Z
d
„ Z d „ Z d „ Z d
„ Z d „ Z d „ Z d „ Z d „ Z d „ Z d „ Z RS( Nc C s‹ g | _ g | _ t i ƒ | _ d | _ d | _ d | _ d | _
d | _ d | _ d | _
d | _ d | _ d | _ t ƒ | _ d S( Nf0.29999999999999999i ( R t meterst in_progress_meterst threadt
allocate_lockt _lockR, R t numfilest finished_filest failed_filest
open_filesRg t failed_sizeR2 t finished_file_sizeR4 R5 R6 ( R ( ( R R P s c C s’ | d j o t i ƒ } n | | _ d | _ d | _ d | _ | | _ d | _ | | _
d | _ | | _ | i
i | | ƒ | i | ƒ d S( Ni ( R R R
R| R R} R~ R Rg R€ R2 R R4 R6 R: R; ( R R| Rg R ( ( R R: a s
c C s d S( N( ( R R ( ( R R; o s c C s. | d j o t i ƒ } n | i | ƒ d S( N( R R R
R R? ( R R ( ( R R@ r s
c C s d S( N( ( R R ( ( R R? v s c C s | i i ƒ d S( N( R R{ t acquire( R ( ( R t locky s c C s | i i ƒ d S( N( R R{ t release( R ( ( R t unlockz s c C s# | i | ƒ } | i i | ƒ | S( N( R t helperclasst newmeterRw t append( R R‡ ( ( R t newMeter~ s c C s | i i | ƒ d S( N( R Rw t removet meter( R R‹ ( ( R t removeMeterƒ s c C s‰ | | i j o t d ƒ ‚ n | i i ƒ z7 | | i j o# | i i | ƒ | i d 7_ n Wd | i i ƒ X| i
| | ƒ d S( Ns attempt to use orphaned meteri ( R‹ R Rw t
ValueErrorR{ R‚ Rx Rˆ R R„ t _do_start_meterR ( R R‹ R ( ( R Rm ˆ s
c C s d S( N( ( R R‹ R ( ( R RŽ ” s c C s| | | i j o t d ƒ ‚ n | | i | i j p | i o6 | i i | i ƒ | ƒ | | _ | i
| | ƒ n d S( Ns attempt to use orphaned meter( R‹ R Rw R R R4 R, R6 R< t _amount_readt _do_update_meter( R R‹ R ( ( R Rn — s " c C s d S( N( ( R R‹ R ( ( R R s c C s° | | i j o t d ƒ ‚ n | i i ƒ z^ y | i i | ƒ Wn t j
o n X| i d 8_ | i d 7_ | i
| i 7_
Wd | i i ƒ X| i
| | ƒ d S( Ns attempt to use orphaned meteri ( R‹ R Rw R R{ R‚ Rx RŠ R R} R R3 R„ t
_do_end_meterR ( R R‹ R ( ( R Rq £ s
c C s d S( N( ( R R‹ R ( ( R R‘ ± s c C sÚ | | i j o t d ƒ ‚ n | i i ƒ z… y | i i | ƒ Wn t j
o n X| i d 8_ | i d 7_ | i
o& | i d j o | i | i
7_ n
d | _ Wd | i i
ƒ X| i | | | ƒ d S( Ns attempt to use orphaned meteri ( R‹ R Rw R R{ R‚ Rx RŠ R R~ R1 R€ R R„ t _do_failure_meterRs R ( R R‹ Rs R ( ( R Rr ´ s
c C s d S( N( ( R R‹ Rs R ( ( R R’ Å s c C s d S( N( ( R R‹ Rs ( ( R Ru È s c C s. | i } x | i D] } | | i 7} q W| S( N( R R t totRx t mR3 ( R R” R“ ( ( R R Í s
( R( R) Rk R† R R R: R; R@ R? Rƒ R… R‰ RŒ Rm RŽ Rn R Rq R‘ Rr R’ Ru R ( ( ( R Rv N s( t TextMultiFileMeterc B sD t Z e i d „ Z d „ Z d „ Z d „ Z d „ Z d „ Z RS( Nc C s | | _ t i | ƒ d S( N( RF R Rv R ( R RF ( ( R R Õ s c
C sT | i i ƒ z2d } | i }
| i p d } d t |
ƒ | d } | i
i } | i
}
d | i
i ƒ p d d } | i
i ƒ } | i
i ƒ } | d j o
d } n | | } t | ƒ d } t |
ƒ d } t | d ƒ } t | d ƒ } d | |
| | | | | | | f } | i i d | ƒ | i i ƒ Wd | i i! ƒ Xd S( NsD files: %3i/%-3i %3i%% data: %6.6s/%-6.6s %3i%% time: %8.8s/%8.8si id f0.48999999999999999i R7 s %-79.79ss
(" R R{ R‚ t formatR} t dfR| t tft floatt pfR6 R3 t ddRg t tdR\ t pdRJ t dtRY t rtR t ttR8 t fddt ftdRL t fdtt fttRX RF Rd Re R„ ( R R‹ R RX RŸ R¤ Rš R¢ R R˜ Rœ R› R– R— Rž R¡ R£ R ( ( R R Ú s.
& c C s | i i ƒ z d } | i } | i }
t |
ƒ d } | i i ƒ } t | d ƒ } t |
| ƒ d } d | | | | | f } | i i d | d ƒ Wd | i i ƒ X| i | | ƒ d S( Ns %-30.30s %6.6s %8.8s %9.9sR7 i s B/ss %-79.79ss
s
( R R{ R‚ R– R‹ R/ t fnR3 R1 R8 R9 R6 RJ t etRL t fett frateRX RF Rd R„ R R ( R R‹ R R¨ R– R9 R§ R¦ RX R¥ R1 ( ( R R‘ õ s
c C sõ | i i ƒ zÐ d } | i } t | ƒ t d ƒ t d ƒ f j o | i ƒ } n | p
d g } n d | | d | d p d f } | i i d | d ƒ x* | d D] } | i i d
| d ƒ q W| i i ƒ Wd | i | | ƒ Xd S( Ns %-30.30s %6.6s %sR! u s %-79st FAILEDi s
s
i s ( R R{ R‚ R– R‹ R/ R¥ t typeRs t
splitlinesRX RF Rd R” R„ R R ( R R‹ Rs R R– R” R¥ RX ( ( R R’ s
%
" c C s& | i i ƒ z Wd | i i ƒ Xd S( N( R R{ R‚ R„ ( R R‹ Rs ( ( R Ru s
c C sS | i d | ƒ | i i ƒ z! | i i d ƒ | i i ƒ Wd | i i ƒ Xd S( Ns
(
R R R R R{ R‚ RF Rd Re R„ ( R R ( ( R R? s
(
R( R) Ri Rj R R R‘ R’ Ru R? ( ( ( R R• Ô s R5 c B sq t Z d d „ Z d d d „ Z d d „ Z d „ Z d „ Z d „ Z d „ Z d „ Z
d
„ Z d d „ Z RS(
Nf5.0c C s
| | _ d S( N( t timescaleR ( R R¬ ( ( R R ) s c C sN | d j o t i ƒ } n | | _ | | _ | | _ d | _ d | _ d S( Ni ( R R R
t totalR R2 R4 R3 t ave_rate( R R R ( ( R R: , s
c C s¬ | d j o t i ƒ } n | d j o# | | _ d | _ d | _ d Sn | | i } | | i } | i o. | | _ | i
| | | i | i ƒ | _ n | | _ d S( Ni ( R R R
R= R R4 R3 R® t time_difft read_difft _temporal_rolling_aveR¬ ( R R= R R° R¯ ( ( R R< 4 s
%c C s | i S( s/ get the average transfer rate (in bytes/second)N( R R® ( R ( ( R RO J s c C s | i | i S( sE the time between the start of the transfer and the most recent updateN( R R4 R2 ( R ( ( R RJ N s c C s3 | i p | i o d Sn | i | i | i S( s estimated time remainingN( R R® R R R3 ( R ( ( R RY R s c C sH | i d j o d Sn- | i d j o d Sn t | i ƒ | i Sd S( s[ the fraction of the data that has been read
(can be None for unknown transfer size)i f1.0N( R R R R™ R3 ( R ( ( R R\ W s c C s7 | | } | d j o
d } n | i | | | | ƒ S( sq a temporal rolling average performs smooth averaging even when
updates come at irregular intervals. This is performed by scaling
the "epsilon" according to the time since the last update.
Specifically, epsilon = time_diff / timescale
As a general rule, the average will take on a completely new value
after 'timescale' seconds.i f1.0N( R¯ R¬ t epsilonR t _rolling_aveR° t last_ave( R R¯ R° R´ R¬ R² ( ( R R± ` s
c C sh y | | } Wn t j
o
d } n X| d j o | Sn | d j o | Sn | | d | | S( sK perform a "rolling average" iteration
a rolling average "folds" new data into an existing average with
some weight, epsilon. epsilon must be between 0.0 and 1.0 (inclusive)
a value of 0.0 means only the old value (initial value) counts,
and a value of 1.0 means only the newest value is considered.i N( R° R¯ t recent_ratet ZeroDivisionErrorR R´ R² ( R R¯ R° R´ R² Rµ ( ( R R³ l s
f15.0c C st | d j o d Sn t t i | | ƒ t i d ƒ ƒ } t | ƒ } | d j o | Sn t t | ƒ | ?| >ƒ S( s— round the remaining time, depending on its size
If rt is between n*start_time and (n+1)*start_time round downward
to the nearest multiple of n (for any counting number n).
If rt < start_time, round down to the nearest 1.
For example (for start_time = 15.0):
2.7 -> 2.0
25.2 -> 25.0
26.4 -> 26.0
35.3 -> 34.0
63.6 -> 60.0
i f0.0i N( RŸ Ra t matht logR2 t shiftR™ ( R RŸ R2 R¹ ( ( R t _round_remaining_time} s
&
(
R( R) R R R: R< RO RJ RY R\ R± R³ Rº ( ( ( R R5 ( s c C s® | d j p
| d j o | o d Sqª d Snz | t d ƒ j o d Sn_ t | ƒ } | d } | d } | o) | d } | d } d | | | f Sn d | | f Sd S( Ni s --:--:--s --:--t inft Infinitei< s %02i:%02i:%02is %02i:%02i( t secondsR t use_hoursR™ Ra t minutest hours( R½ R¾ RÀ R¿ ( ( R RL ‘ s
RG c C s d d d d d d d d d g } | o
d
} n d } d } d
} t | ƒ d } x3 | | j o% | | j o | d } | | } qW Wt | ƒ t d ƒ j p t | ƒ t d ƒ j o
d } n | d j o
d } n d } | t
| p d
ƒ | | | f S( s4 Turn numbers into human-readable metric-like numbersR! t kt Mt Gt Tt Pt Et Zt Yf1000.0f1024.0iç i i l s %i%s%sf9.9499999999999993s %.1f%s%ss %.0f%s%sN( t symbolst SIt stept thresht depthR# t max_deptht numberRª R– R™ t space( RÏ RÊ RÐ RÍ R– RÉ RÌ RË RÎ ( ( R R8 ¢ s$ !
2
c G sÁ t ƒ } d | | | f } | i | d | | | d | ƒ| } d }
xe | D]] \ } } |
d 7}
xD | | |
t | ƒ j o( | | 7} | i | ƒ t i | ƒ qh WqO W| i | ƒ d S( Ns (%d/%d): %ss" http://www.example.com/path/to/fn/R0 i i ( RE t tmt curR“ R¥ R0 R: R1 t begt numt offt argst inct delayR# R< R
t sleepR@ ( R¥ RÒ R“ RÓ R1 RÖ RÔ R0 RØ RÑ RÕ R× ( ( R t _tstÉ s
t __main__i R iè i' i@B s sm-1.0.0-1.fc8.i386.rpmi
f0.20000000000000001f0.10000000000000001id f0.25s s-1.0.1-1.fc8.i386.rpms m-1.0.1-2.fc8.i386.rpmi iˆ s1 large-file-name-Foo-11.8.7-4.5.6.1.fc8.x86_64.rpmi s2 large-file-name-Foo2-11.8.7-4.5.6.2.fc8.x86_64.rpmi i!¡ s2 large-file-name-Foo3-11.8.7-4.5.6.3.fc8.x86_64.rpmi i²q s2 large-file-name-Foo4-10.8.7-4.5.6.1.fc8.x86_64.rpmi s2 large-file-name-Foo5-10.8.7-4.5.6.2.fc8.x86_64.rpmi i‰ s2 large-file-name-Foo6-10.8.7-4.5.6.3.fc8.x86_64.rpmi iN s1 large-file-name-Foox-9.8.7-4.5.6.1.fc8.x86_64.rpmf0.5i † ( i
f0.20000000000000001( i
f0.10000000000000001( id f0.25( i
f0.20000000000000001( id f0.10000000000000001( id f0.10000000000000001( id f0.25( i
f0.20000000000000001( id f0.10000000000000001( id f0.10000000000000001( id f0.25( iè f0.20000000000000001( iè f0.10000000000000001( i' f0.10000000000000001( iè f0.20000000000000001( iè f0.10000000000000001( i' f0.10000000000000001( iè f0.20000000000000001( iè f0.10000000000000001( i' f0.10000000000000001( id f0.10000000000000001( id f0.10000000000000001( i f0.10000000000000001( i
f0.5( i † f0.10000000000000001( i' f0.10000000000000001( i' f0.10000000000000001( i' f0.10000000000000001( i † f0.10000000000000001( i' f0.10000000000000001( i' f0.10000000000000001( i' f0.10000000000000001( i † f0.10000000000000001( i' f0.10000000000000001( i' f0.10000000000000001( i' f0.10000000000000001( i † f0.10000000000000001( i' f0.10000000000000001( i' f0.10000000000000001( i' f0.10000000000000001( i † f0.10000000000000001( i f0.10000000000000001( Ri R
R· Ry R R R R R R R R R R+ RA RC RD RE t text_progress_meterRk Rv R• R5 RL R8 RÚ R( R# t argv( RE RL RD R RÚ R RÜ R R· R Rv R8 R Ri R5 R+ Ry R• Rk R
R ( ( R t ? sh
)> 5_†Ti '
*2