Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fixes issue 228 #234

Merged
merged 12 commits into from
Oct 23, 2024
Merged

Fixes issue 228 #234

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
12 commits
Select commit Hold shift + click to select a range
8e4fa72
Fixes issue 228
zoobereq Oct 4, 2024
7634e0b
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Oct 4, 2024
a50a8b6
Fixes issue 228
zoobereq Oct 4, 2024
a3dca5f
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Oct 4, 2024
b86da7d
Expands Whitelist and removes redundant [0-9]+-[A-Za-z] (and in rever…
zoobereq Oct 18, 2024
3d90ae6
Updates the cache
zoobereq Oct 18, 2024
d75d338
Finalizes the fix
zoobereq Oct 18, 2024
6e9392f
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Oct 18, 2024
23a7d34
Removes unused imports and variables
zoobereq Oct 21, 2024
84b086e
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Oct 21, 2024
bdc4514
Removes redundant abbreviation mappings
zoobereq Oct 23, 2024
40db609
Updates the cache
zoobereq Oct 23, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion Jenkinsfile
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -12,7 +12,7 @@ pipeline {
environment {

AR_TN_CACHE='/home/jenkinsci/TestData/text_norm/ci/grammars/04-24-24-0'
DE_TN_CACHE='/home/jenkinsci/TestData/text_norm/ci/grammars/10-14-24-0'
DE_TN_CACHE='/home/jenkinsci/TestData/text_norm/ci/grammars/10-23-24-0'
EN_TN_CACHE='/home/jenkinsci/TestData/text_norm/ci/grammars/09-04-24-0'
ES_TN_CACHE='/home/jenkinsci/TestData/text_norm/ci/grammars/09-25-24-0'
ES_EN_TN_CACHE='/home/jenkinsci/TestData/text_norm/ci/grammars/08-30-24-0'
Expand Down
14 changes: 14 additions & 0 deletions nemo_text_processing/text_normalization/de/data/whitelist.tsv
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -5,3 +5,17 @@ Mr. mister
Mrs. misses
Ms. miss
Nr. nummer
2D zwei-D
2-D zwei-D
3D drei-D
3-D drei-D
3-D-Mammogram drei-D-Mammogram
3D-Mammogram drei-D-Mammogram
2-D-Mammogram zwei-D-Mammogram
2D-Mammogram zwei-D-Mammogram
3-D-Mammographie drei-D-Mammographie
3D-Mammographie drei-D-Mammographie
2-D-Mammographie zwei-D-Mammographie
2D-Mammographie zwei-D-Mammographie
3-D-Drucker drei-D-Drucker
3D-Drucker drei-D-Drucker
1 change: 1 addition & 0 deletions nemo_text_processing/text_normalization/de/verbalizers/electronic.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -17,6 +17,7 @@

from nemo_text_processing.text_normalization.de.utils import get_abs_path
from nemo_text_processing.text_normalization.en.graph_utils import (
NEMO_ALPHA,
NEMO_NOT_QUOTE,
NEMO_SIGMA,
NEMO_SPACE,
Expand Down
6 changes: 5 additions & 1 deletion tests/nemo_text_processing/de/data_text_normalization/test_cases_electronic.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -12,4 +12,8 @@ w w w punkt amazon punkt com punkt de.~www.amazon.com.de.
h t t p s doppelpunkt slash slash w w w punkt a b c punkt com slash a b fragezeichen gleichheitszeichen drei bindestrich slash a b s slash eins~https://www.abc.com/ab?=3-/abs/1
at j e n s e n~@jensen
at j e n s e n punkt m [email protected]
at w e z y r eins neun acht sechs~@wezyr1986
at w e z y r eins neun acht sechs~@wezyr1986
zwei-D-Mammogram~2D-Mammogram
zwei-D-Mammogram~2-D-Mammogram
drei-D-Drucker~3D-Drucker
drei-D-Drucker~3-D-Drucker
Loading