Code

Add guess page layout#9

Code

Merged

kmike merged 40 commits intoTeamHG-Memex:masterTeamHG-Memex/html-text:masterfrom Kebniss:add-guess-page-layoutKebniss/html-text:add-guess-page-layoutCopy head branch name to clipboardSep 25, 2018

+2,509-49

Commits

Commits on Aug 24, 2018

• add first working approach plus debug code

  Kebniss

  committed
  0ae6d24

  Copy full SHA for 0ae6d24

• add newline only at the end of selected tags

  Kebniss

  committed
  566dc9b

  Copy full SHA for 566dc9b

Commits on Aug 27, 2018

• fix multiple consecutive newlines

  Kebniss

  committed
  587e9a7

  Copy full SHA for 587e9a7

• add guess_space = False option

  Kebniss

  committed
  6c9d27e

  Copy full SHA for 6c9d27e

Commits on Aug 28, 2018

• move add space and newline checks to a function

  Kebniss

  committed
  c22f3fa

  Copy full SHA for c22f3fa

• add tests guess_page_layout

  Kebniss

  committed
  8a78fc5

  Copy full SHA for 8a78fc5

Commits on Aug 29, 2018

• remove old test

  Kebniss

  committed
  a783e31

  Copy full SHA for a783e31

Commits on Aug 30, 2018

• guess_punct_space = False behavior same as before this PR

  Kebniss

  committed
  cb8dc1c

  Copy full SHA for cb8dc1c

• fix tests

  Kebniss

  committed
  fb599bc

  Copy full SHA for fb599bc

• fixed tests

  Kebniss

  committed
  90e37b7

  Copy full SHA for 90e37b7

• fix indent and make add_space more readable

  Kebniss

  committed
  ae26d29

  Copy full SHA for ae26d29

Commits on Aug 31, 2018

• add double newline before and after title, p and h tags

  Kebniss

  committed
  bb33d4b

  Copy full SHA for bb33d4b

Commits on Sep 6, 2018

• by default tail of root node will not be extracted

  Kebniss

  committed
  3069a73

  Copy full SHA for 3069a73

• add test

  Kebniss

  committed
  dd03201

  Copy full SHA for dd03201

Commits on Sep 7, 2018

• fix indentation

  Kebniss

  committed
  0f2fb2b

  Copy full SHA for 0f2fb2b

• newline tags as set and extendable, add new features comments, delete new argument

  Kebniss

  committed
  e8da507

  Copy full SHA for e8da507

Commits on Sep 8, 2018

• make html_to_text private, fix its signature

  Kebniss

  committed
  0b9d139

  Copy full SHA for 0b9d139

• add new tags to handle

  Kebniss

  committed
  ba7cdc0

  Copy full SHA for ba7cdc0

Commits on Sep 10, 2018

• handle more tags

  Kebniss

  committed
  952d895

  Copy full SHA for 952d895

Commits on Sep 11, 2018

• remove cleaning of inline tags

  Kebniss

  committed
  9dafbf0

  Copy full SHA for 9dafbf0

• fix bug with multiple newlines

  Kebniss

  committed
  b3229d6

  Copy full SHA for b3229d6

• remove newline

  Kebniss

  committed
  695b458

  Copy full SHA for 695b458

• add test html without text

  Kebniss

  committed
  03259b9

  Copy full SHA for 03259b9

• fix newline + space bug

  Kebniss

  committed
  cba531f

  Copy full SHA for cba531f

• add bad punct test

  Kebniss

  committed
  9811349

  Copy full SHA for 9811349

• add newline

  Kebniss

  committed
  d47138c

  Copy full SHA for d47138c

• add tests on real webpages

  Kebniss

  committed
  76f9028

  Copy full SHA for 76f9028

• tests to hopefully make codecov happy

  Kebniss

  committed
  05c7702

  Copy full SHA for 05c7702

• remove pathlib import

  Kebniss

  committed
  4505e24

  Copy full SHA for 4505e24

• fix test

  Kebniss

  committed
  a27e4c8

  Copy full SHA for a27e4c8

Commits on Sep 12, 2018

• remove space

  Kebniss

  committed
  b926c8c

  Copy full SHA for b926c8c

Commits on Sep 19, 2018

• handle list of selectors

  Kebniss

  committed
  73f49ad

  Copy full SHA for 73f49ad

• a list of selectors returns a list of texts

  Kebniss

  committed
  15d22e0

  Copy full SHA for 15d22e0

Commits on Sep 20, 2018

• selectors_to_text add to res only if something is extracted

  Kebniss

  committed
  8f68b2c

  Copy full SHA for 8f68b2c

• selectors_to_text merge results as in previous implementation

  Kebniss

  committed
  cf02b94

  Copy full SHA for cf02b94

• update readme

  Kebniss

  committed
  7aec8d2

  Copy full SHA for 7aec8d2

• update history

  Kebniss

  committed
  7653bf9

  Copy full SHA for 7653bf9

• update readme

  Kebniss

  committed
  4300fe6

  Copy full SHA for 4300fe6

• update readme and add newline personalization tests

  Kebniss

  committed
  4772061

  Copy full SHA for 4772061

• change documentation

  Kebniss

  committed
  05b979a

  Copy full SHA for 05b979a