Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add links from newsletter #565

Open
haesleinhuepf opened this issue Dec 20, 2024 · 1 comment · May be fixed by #606
Open

Add links from newsletter #565

haesleinhuepf opened this issue Dec 20, 2024 · 1 comment · May be fixed by #606
Assignees
@marabuuu

Comments

@haesleinhuepf
Copy link
Member

We should go through all NFDI4BioImage newsletters, extract all links and check if they are already in our database: https://nfdi4bioimage.de/?id=157062#c896618
@marabuuu marabuuu self-assigned this Jan 21, 2025
@marabuuu
Copy link
Collaborator

marabuuu commented Jan 21, 2025 •
edited
Loading

Steps

  • 1. Access Newsletter

  • 2. Extract All URLs

  • 3. Check if URLs are already present in yml file

  • 4. Create one GitHub Issue for all new entries to add and put them in the body of the Issue or create one Issue per Link (using GitHub API)

  • 5. Automate using GitHub Actions to periodically check newsletter page

Considerations

  • archived newsletters are in pdf format → download pdfs to folder "newsletters" in repo → add folder "newsletters" to gitignore

marabuuu added a commit that referenced this issue Jan 21, 2025
@marabuuu
add notebook to try out #565
5acdb0f
marabuuu added a commit that referenced this issue Jan 21, 2025
@marabuuu
add newsletters folder with pdf files to gitignore #565
566a345
marabuuu added a commit that referenced this issue Jan 21, 2025
@marabuuu
compare links with links in yml file #565
320b3cc
marabuuu added a commit that referenced this issue Jan 28, 2025
@marabuuu
add yml file for github actions #565
f2eb9ff
marabuuu added a commit that referenced this issue Jan 28, 2025
@marabuuu
keep newsletter number as help to trace back were links come from #565
fa6c0ec
marabuuu added a commit that referenced this issue Jan 28, 2025
@marabuuu
add better structured python file #565
92697ca
marabuuu added a commit that referenced this issue Jan 28, 2025
@marabuuu
remove try out notebook #565
c1b4604
marabuuu added a commit that referenced this issue Jan 28, 2025
@marabuuu
only ignore pdf files as .txt file should be needed for github action…
4f19a65 
… to work #565
marabuuu added a commit that referenced this issue Jan 28, 2025
@marabuuu
add bs4 to requirements as I was using it to get the pdfs of newslett…
c6166e7 
…ers from the website with it #565
@marabuuu marabuuu linked a pull request Jan 28, 2025 that will close this issue
Open
marabuuu added a commit that referenced this issue Jan 29, 2025
@marabuuu
trying to resolve merge conflicts by replacing library bs4 with lxml #…
36350a3 
…565
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@marabuuu marabuuu

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Newsletter import NFDI4BIOIMAGE/training
2 participants
@haesleinhuepf @marabuuu