Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add documentation in TASK for nlp and lstm task #565

Closed
wants to merge 6 commits into from

Conversation

walidabn
Copy link
Collaborator

@walidabn walidabn commented Feb 6, 2023

closes #491

Simple nlp task with lstm to do sentiment analysis. We document in TASK.md the details of this NLP task, along with our tokenization preprocessing function.

@martinjaggi
Copy link
Member

can you rename the PR as it's not just documentation but also the code for NLP tasks?

in terms of code, the different nodes currently don't use the same vocabulary, because not based on the a shared tokenizer. the tokenizer should be specified in the task definition. we can wait for #572, then this should be simple afterwards

@martinjaggi
Copy link
Member

not closing yet

@martinjaggi martinjaggi reopened this Mar 29, 2023
@s314cy
Copy link
Contributor

s314cy commented May 4, 2023

as discussed with @walidabn, this PR is superseded by #577

the discojs-core/src/default_tasks/sentiment.ts task might be included later on as a classic NLP use-case, in addition to LLM's

@s314cy s314cy closed this May 4, 2023
@s314cy s314cy deleted the 491-nlp-usecase branch August 8, 2023 08:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

add NLP usecase
3 participants