Code

Tokenizer updates#317

Code

Merged

duckdoom4 merged 22 commits intodeveloprenpy/vscode-language-renpy:developfrom update-custom-containersrenpy/vscode-language-renpy:update-custom-containersCopy head branch name to clipboardJun 2, 2023

+8,448-3,885

Commits

Commits on Jun 1, 2023

• WIP: Tokenizer update

  duckdoom4

  committed
  067cfd8

  Copy full SHA for 067cfd8

• Split ATL patterns into it's own file

  duckdoom4

  committed
  9f76f2e

  Copy full SHA for 9f76f2e

• Update typescript file generator

  duckdoom4

  committed
  2b2f2e1

  Copy full SHA for 2b2f2e1

• replace with auto-generated ATL patterns

  duckdoom4

  committed
  b0babe5

  Copy full SHA for b0babe5

• Added sort function for vector

  duckdoom4

  committed
  5f90dca

  Copy full SHA for 5f90dca

• WIP: auto generate python and renpy patterns

  Show description for f5c0349
  duckdoom4

  committed
  f5c0349

  Copy full SHA for f5c0349

• Switch last token to be the important one

  Show description for 664bf2c
  duckdoom4

  committed
  664bf2c

  Copy full SHA for 664bf2c

• Added missing token cases

  duckdoom4

  committed
  73d2a69

  Copy full SHA for 73d2a69

• Update tokenizer to match textmate behaviour on range patterns

  Show description for 54866ee
  duckdoom4

  committed
  54866ee

  Copy full SHA for 54866ee

• Move to separate functions

  duckdoom4

  committed
  1f45b1d

  Copy full SHA for 1f45b1d

• WIP optimizations

  duckdoom4

  committed
  960840a

  Copy full SHA for 960840a

• Fix bugs

  duckdoom4

  committed
  106e309

  Copy full SHA for 106e309

• Code cleanup and fixes

  duckdoom4

  committed
  215b571

  Copy full SHA for 215b571

• Delete all token position update code

  duckdoom4

  committed
  6404550

  Copy full SHA for 6404550

• Update pattern generator

  Show description for 653bedf
  duckdoom4

  committed
  653bedf

  Copy full SHA for 653bedf

• Fix some bugs in the syntax patterns

  Show description for a5f33cb
  duckdoom4

  committed
  a5f33cb

  Copy full SHA for a5f33cb

• Ignore generated files

  duckdoom4

  committed
  e7b6e12

  Copy full SHA for e7b6e12

• Delete this file as it is no longer used

  duckdoom4

  committed
  0755894

  Copy full SHA for 0755894

• Fix custom color style injection

  duckdoom4

  committed
  256dadc

  Copy full SHA for 256dadc

Commits on Jun 2, 2023

• Fixed merge error

  duckdoom4

  committed
  14ac5d8

  Copy full SHA for 14ac5d8

• Use dataclass annotation

  duckdoom4

  committed
  c9654b5

  Copy full SHA for c9654b5

• Don't display unmatched tokens to the end user

  Show description for bb1d8d9
  duckdoom4

  committed
  bb1d8d9

  Copy full SHA for bb1d8d9