Skip to content

Commit

Permalink
Deploying to gh-pages from @ 9150c55 🚀
Browse files Browse the repository at this point in the history
  • Loading branch information
JarryShaw committed Oct 12, 2024
1 parent 6826bc9 commit 91f744f
Show file tree
Hide file tree
Showing 32 changed files with 389 additions and 389 deletions.
2 changes: 1 addition & 1 deletion aux.html
Original file line number Diff line number Diff line change
Expand Up @@ -141,7 +141,7 @@ <h2>Redis Clinic<a class="headerlink" href="#redis-clinic" title="Link to this h
<p>Since Redis may take more and more memory as the growth of crawled
data and task queues, this script will truncate the Redis task queues
(<code class="docutils literal notranslate"><span class="pre">queue_requests</span></code> &amp; <code class="docutils literal notranslate"><span class="pre">queue_selenium</span></code>), as well as the corresponding
<a class="reference external" href="https://docs.python.org/3/library/pickle.html#module-pickle" title="(in Python v3.12)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">pickle</span></code></a> caches of <a class="reference internal" href="darc/link.html#darc.link.Link" title="darc.link.Link"><code class="xref py py-class docutils literal notranslate"><span class="pre">darc.link.Link</span></code></a>.</p>
<a class="reference external" href="https://docs.python.org/3/library/pickle.html#module-pickle" title="(in Python v3.13)"><code class="xref py py-mod docutils literal notranslate"><span class="pre">pickle</span></code></a> caches of <a class="reference internal" href="darc/link.html#darc.link.Link" title="darc.link.Link"><code class="xref py py-class docutils literal notranslate"><span class="pre">darc.link.Link</span></code></a>.</p>
<div class="admonition note">
<p class="admonition-title">Note</p>
<p>We used Lua scrpit to slightly accelerate the whole procedure, as
Expand Down
162 changes: 81 additions & 81 deletions config.html

Large diffs are not rendered by default.

88 changes: 44 additions & 44 deletions darc/const.html

Large diffs are not rendered by default.

12 changes: 6 additions & 6 deletions darc/db.html
Original file line number Diff line number Diff line change
Expand Up @@ -34,7 +34,7 @@

<dl class="py data">
<dt class="sig sig-object py" id="darc.db.BULK_SIZE">
<span class="sig-prename descclassname"><span class="pre">darc.db.</span></span><span class="sig-name descname"><span class="pre">BULK_SIZE</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.12)"><span class="pre">int</span></a></em><a class="headerlink" href="#darc.db.BULK_SIZE" title="Link to this definition"></a></dt>
<span class="sig-prename descclassname"><span class="pre">darc.db.</span></span><span class="sig-name descname"><span class="pre">BULK_SIZE</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.13)"><span class="pre">int</span></a></em><a class="headerlink" href="#darc.db.BULK_SIZE" title="Link to this definition"></a></dt>
<dd><dl class="field-list simple">
<dt class="field-odd">Default<span class="colon">:</span></dt>
<dd class="field-odd"><p><code class="docutils literal notranslate"><span class="pre">100</span></code></p>
Expand All @@ -55,7 +55,7 @@

<dl class="py data">
<dt class="sig sig-object py" id="darc.db.LOCK_TIMEOUT">
<span class="sig-prename descclassname"><span class="pre">darc.db.</span></span><span class="sig-name descname"><span class="pre">LOCK_TIMEOUT</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><a class="reference external" href="https://docs.python.org/3/library/functions.html#float" title="(in Python v3.12)"><span class="pre">float</span></a><span class="w"> </span><span class="p"><span class="pre">|</span></span><span class="w"> </span><a class="reference external" href="https://docs.python.org/3/library/constants.html#None" title="(in Python v3.12)"><span class="pre">None</span></a></em><a class="headerlink" href="#darc.db.LOCK_TIMEOUT" title="Link to this definition"></a></dt>
<span class="sig-prename descclassname"><span class="pre">darc.db.</span></span><span class="sig-name descname"><span class="pre">LOCK_TIMEOUT</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><a class="reference external" href="https://docs.python.org/3/library/functions.html#float" title="(in Python v3.13)"><span class="pre">float</span></a><span class="w"> </span><span class="p"><span class="pre">|</span></span><span class="w"> </span><a class="reference external" href="https://docs.python.org/3/library/constants.html#None" title="(in Python v3.13)"><span class="pre">None</span></a></em><a class="headerlink" href="#darc.db.LOCK_TIMEOUT" title="Link to this definition"></a></dt>
<dd><dl class="field-list simple">
<dt class="field-odd">Default<span class="colon">:</span></dt>
<dd class="field-odd"><p><code class="docutils literal notranslate"><span class="pre">10</span></code></p>
Expand All @@ -77,7 +77,7 @@

<dl class="py data">
<dt class="sig sig-object py" id="darc.db.MAX_POOL">
<span class="sig-prename descclassname"><span class="pre">darc.db.</span></span><span class="sig-name descname"><span class="pre">MAX_POOL</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.12)"><span class="pre">int</span></a></em><a class="headerlink" href="#darc.db.MAX_POOL" title="Link to this definition"></a></dt>
<span class="sig-prename descclassname"><span class="pre">darc.db.</span></span><span class="sig-name descname"><span class="pre">MAX_POOL</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.13)"><span class="pre">int</span></a></em><a class="headerlink" href="#darc.db.MAX_POOL" title="Link to this definition"></a></dt>
<dd><dl class="field-list simple">
<dt class="field-odd">Default<span class="colon">:</span></dt>
<dd class="field-odd"><p><code class="docutils literal notranslate"><span class="pre">1_000</span></code></p>
Expand All @@ -95,10 +95,10 @@

<dl class="py data">
<dt class="sig sig-object py" id="darc.db.REDIS_LOCK">
<span class="sig-prename descclassname"><span class="pre">darc.db.</span></span><span class="sig-name descname"><span class="pre">REDIS_LOCK</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><a class="reference external" href="https://docs.python.org/3/library/functions.html#bool" title="(in Python v3.12)"><span class="pre">bool</span></a></em><a class="headerlink" href="#darc.db.REDIS_LOCK" title="Link to this definition"></a></dt>
<span class="sig-prename descclassname"><span class="pre">darc.db.</span></span><span class="sig-name descname"><span class="pre">REDIS_LOCK</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><a class="reference external" href="https://docs.python.org/3/library/functions.html#bool" title="(in Python v3.13)"><span class="pre">bool</span></a></em><a class="headerlink" href="#darc.db.REDIS_LOCK" title="Link to this definition"></a></dt>
<dd><dl class="field-list simple">
<dt class="field-odd">Default<span class="colon">:</span></dt>
<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/constants.html#False" title="(in Python v3.12)"><code class="xref py py-data docutils literal notranslate"><span class="pre">False</span></code></a></p>
<dd class="field-odd"><p><a class="reference external" href="https://docs.python.org/3/library/constants.html#False" title="(in Python v3.13)"><code class="xref py py-data docutils literal notranslate"><span class="pre">False</span></code></a></p>
</dd>
<dt class="field-even">Environ<span class="colon">:</span></dt>
<dd class="field-even"><p><span class="target" id="index-3"></span><code class="xref std std-envvar docutils literal notranslate"><span class="pre">DARC_REDIS_LOCK</span></code></p>
Expand All @@ -113,7 +113,7 @@

<dl class="py data">
<dt class="sig sig-object py" id="darc.db.RETRY_INTERVAL">
<span class="sig-prename descclassname"><span class="pre">darc.db.</span></span><span class="sig-name descname"><span class="pre">RETRY_INTERVAL</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.12)"><span class="pre">int</span></a></em><a class="headerlink" href="#darc.db.RETRY_INTERVAL" title="Link to this definition"></a></dt>
<span class="sig-prename descclassname"><span class="pre">darc.db.</span></span><span class="sig-name descname"><span class="pre">RETRY_INTERVAL</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><a class="reference external" href="https://docs.python.org/3/library/functions.html#int" title="(in Python v3.13)"><span class="pre">int</span></a></em><a class="headerlink" href="#darc.db.RETRY_INTERVAL" title="Link to this definition"></a></dt>
<dd><dl class="field-list simple">
<dt class="field-odd">Default<span class="colon">:</span></dt>
<dd class="field-odd"><p><code class="docutils literal notranslate"><span class="pre">10</span></code></p>
Expand Down
10 changes: 5 additions & 5 deletions darc/error.html
Original file line number Diff line number Diff line change
Expand Up @@ -108,7 +108,7 @@
<dt class="field-odd">Parameters<span class="colon">:</span></dt>
<dd class="field-odd"><ul class="simple">
<li><p><strong>link</strong> (<a class="reference internal" href="link.html#darc.link.Link" title="darc.link.Link"><em>darc.link.Link</em></a>) – Original link object.</p></li>
<li><p><strong>drop</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#bool" title="(in Python v3.12)"><em>bool</em></a>) – </p></li>
<li><p><strong>drop</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#bool" title="(in Python v3.13)"><em>bool</em></a>) – </p></li>
</ul>
</dd>
<dt class="field-even">Keyword Arguments<span class="colon">:</span></dt>
Expand All @@ -123,7 +123,7 @@
<span class="sig-name descname"><span class="pre">__init__</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">link</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">None</span></span></em>, <em class="sig-param"><span class="o"><span class="pre">*</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">drop</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">True</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../_modules/darc/error.html#LinkNoReturn.__init__"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#darc.error.LinkNoReturn.__init__" title="Link to this definition"></a></dt>
<dd><dl class="field-list simple">
<dt class="field-odd">Parameters<span class="colon">:</span></dt>
<dd class="field-odd"><p><strong>drop</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#bool" title="(in Python v3.12)"><em>bool</em></a>) – </p>
<dd class="field-odd"><p><strong>drop</strong> (<a class="reference external" href="https://docs.python.org/3/library/functions.html#bool" title="(in Python v3.13)"><em>bool</em></a>) – </p>
</dd>
<dt class="field-even">Return type<span class="colon">:</span></dt>
<dd class="field-even"><p>None</p>
Expand All @@ -150,7 +150,7 @@
<dl class="py exception">
<dt class="sig sig-object py" id="darc.error.SiteNotFoundWarning">
<em class="property"><span class="pre">exception</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">darc.error.</span></span><span class="sig-name descname"><span class="pre">SiteNotFoundWarning</span></span><a class="reference internal" href="../_modules/darc/error.html#SiteNotFoundWarning"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#darc.error.SiteNotFoundWarning" title="Link to this definition"></a></dt>
<dd><p>Bases: <a class="reference internal" href="#darc.error._BaseWarning" title="darc.error._BaseWarning"><code class="xref py py-class docutils literal notranslate"><span class="pre">_BaseWarning</span></code></a>, <a class="reference external" href="https://docs.python.org/3/library/exceptions.html#ImportWarning" title="(in Python v3.12)"><code class="xref py py-class docutils literal notranslate"><span class="pre">ImportWarning</span></code></a></p>
<dd><p>Bases: <a class="reference internal" href="#darc.error._BaseWarning" title="darc.error._BaseWarning"><code class="xref py py-class docutils literal notranslate"><span class="pre">_BaseWarning</span></code></a>, <a class="reference external" href="https://docs.python.org/3/library/exceptions.html#ImportWarning" title="(in Python v3.13)"><code class="xref py py-class docutils literal notranslate"><span class="pre">ImportWarning</span></code></a></p>
<p>Site customisation not found.</p>
</dd></dl>

Expand Down Expand Up @@ -206,14 +206,14 @@
<dl class="py exception">
<dt class="sig sig-object py" id="darc.error._BaseException">
<em class="property"><span class="pre">exception</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">darc.error.</span></span><span class="sig-name descname"><span class="pre">_BaseException</span></span><a class="reference internal" href="../_modules/darc/error.html#_BaseException"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#darc.error._BaseException" title="Link to this definition"></a></dt>
<dd><p>Bases: <a class="reference external" href="https://docs.python.org/3/library/exceptions.html#Exception" title="(in Python v3.12)"><code class="xref py py-class docutils literal notranslate"><span class="pre">Exception</span></code></a></p>
<dd><p>Bases: <a class="reference external" href="https://docs.python.org/3/library/exceptions.html#Exception" title="(in Python v3.13)"><code class="xref py py-class docutils literal notranslate"><span class="pre">Exception</span></code></a></p>
<p>Base exception class for <a class="reference internal" href="index.html#module-darc" title="darc"><code class="xref py py-mod docutils literal notranslate"><span class="pre">darc</span></code></a> module.</p>
</dd></dl>

<dl class="py exception">
<dt class="sig sig-object py" id="darc.error._BaseWarning">
<em class="property"><span class="pre">exception</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">darc.error.</span></span><span class="sig-name descname"><span class="pre">_BaseWarning</span></span><a class="reference internal" href="../_modules/darc/error.html#_BaseWarning"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#darc.error._BaseWarning" title="Link to this definition"></a></dt>
<dd><p>Bases: <a class="reference external" href="https://docs.python.org/3/library/exceptions.html#Warning" title="(in Python v3.12)"><code class="xref py py-class docutils literal notranslate"><span class="pre">Warning</span></code></a></p>
<dd><p>Bases: <a class="reference external" href="https://docs.python.org/3/library/exceptions.html#Warning" title="(in Python v3.13)"><code class="xref py py-class docutils literal notranslate"><span class="pre">Warning</span></code></a></p>
<p>Base warning for <a class="reference internal" href="index.html#module-darc" title="darc"><code class="xref py py-mod docutils literal notranslate"><span class="pre">darc</span></code></a> module.</p>
</dd></dl>

Expand Down
Loading

0 comments on commit 91f744f

Please sign in to comment.