Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Refactor to improve performance on large instances #261

Merged
merged 61 commits into from
Aug 20, 2022
Merged

Refactor to improve performance on large instances #261

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
61 commits
Select commit Hold shift + click to select a range
7ed74a4
Remove old db classes
marcelklehr Jul 22, 2022
909712c
Introduce queue infrastructure
marcelklehr Jul 22, 2022
b2b8b6b
Implement classify jobs
marcelklehr Jul 22, 2022
72c8d82
Remove old Classify jobs
marcelklehr Jul 22, 2022
1e8d761
Refactor classifier classes
marcelklehr Jul 22, 2022
7e2b459
Swap javascript face classifier file names
marcelklehr Jul 22, 2022
31ea344
QueueService#insertIntoQueue: Add enabled check
marcelklehr Jul 22, 2022
2b480a5
ImagenetClassifier: conditionally add files to landmarks queue
marcelklehr Jul 22, 2022
afc37c3
Remove unnecessary files
marcelklehr Jul 22, 2022
74302e6
Remove unused Finder classes
marcelklehr Jul 25, 2022
3859f93
Fix ClassifierJob
marcelklehr Jul 25, 2022
324906b
Fix QueueService
marcelklehr Jul 25, 2022
1d875a7
Implement SchedulerJob and StorageCrawlJob
marcelklehr Jul 25, 2022
83dc5e6
Implement FileListener
marcelklehr Jul 25, 2022
db15ca6
cs:fix
marcelklehr Jul 25, 2022
f0299a3
SchedulerJob: Add ObjectHomeMountProvider
marcelklehr Jul 26, 2022
77db016
Remove unused class InitialCrawlJob
marcelklehr Jul 25, 2022
18e5ad3
info.xml: Add jobs
marcelklehr Jul 25, 2022
b348537
info.xml: Remove jobs
marcelklehr Jul 26, 2022
a73dc9a
Small fixes
marcelklehr Jul 26, 2022
f07f1ee
Fix StorageCrawlJob
marcelklehr Jul 26, 2022
a2a6f26
BackgroundJobs: Make sure fs is mounted
marcelklehr Jul 26, 2022
5686c62
Classifier: Don't run if there's no files
marcelklehr Jul 26, 2022
a4ea18d
ClassifierJob: Remove from JobList if there's no files left
marcelklehr Jul 26, 2022
410095a
cs:fix
marcelklehr Jul 27, 2022
40580af
Implement ClusterFacesJob
marcelklehr Jul 27, 2022
666bfdb
FileListener: Fix NodeCreated hook
marcelklehr Jul 27, 2022
addfa54
Remove classify commands
marcelklehr Jul 27, 2022
ee75a5d
Turn SchedulerJob into a oneshot job and add an admin button to sched…
marcelklehr Jul 27, 2022
c4dd566
Remove old command tests
marcelklehr Jul 29, 2022
e955222
Implement classifier class test
marcelklehr Jul 29, 2022
092c7c2
Implement classifier class test
marcelklehr Jul 29, 2022
7dbf89f
Implement classifier class test
marcelklehr Jul 29, 2022
28ac4d0
Add a few tests
marcelklehr Aug 1, 2022
8e6a4fa
Fix ClassifierTest
marcelklehr Aug 1, 2022
438522d
Test all classifiers
marcelklehr Aug 2, 2022
68cd658
Upgrade phpunit.xml schema
marcelklehr Aug 2, 2022
51fa8c0
Remove unused files
marcelklehr Aug 2, 2022
4118347
Refactor StorageCrawlJob & FileListener to use explicit list of suppo…
marcelklehr Aug 2, 2022
f69aac7
LandmarksClassifier: Fix conditional tags
marcelklehr Aug 3, 2022
d5108d7
QueueService: Add clearQueue method
marcelklehr Aug 3, 2022
0aabbc8
ClassifierTest: Add pipeline tests for landmarks and faces
marcelklehr Aug 3, 2022
da1657d
ClassifierJob: Avoid errors when testing
marcelklehr Aug 3, 2022
887427a
ClassifierTest: Extract job list into a field
marcelklehr Aug 3, 2022
fdd1ff8
phpunit CI: Test on nc25 only
marcelklehr Aug 3, 2022
068c03c
info.xml: Bump supported nc version
marcelklehr Aug 3, 2022
f7f05dc
CI: Remove backgroundjob tests
marcelklehr Aug 3, 2022
8a405fa
CI: Run phpunit on alpine as well
marcelklehr Aug 3, 2022
561b466
Add test for movinet pipeline
marcelklehr Aug 3, 2022
2d54a76
CI: Fix alpine installation
marcelklehr Aug 3, 2022
ed2722a
Add musicnn pipeline test
marcelklehr Aug 3, 2022
f88d67f
Fix ClassifyMusicnnJob
marcelklehr Aug 3, 2022
62d25c1
CI: Fix alpine
marcelklehr Aug 4, 2022
c16cb4f
Phpunit: Skip movinet,musicnn tests on alpine
marcelklehr Aug 4, 2022
73169e7
PHPuni: Skip testLandmarksPipeline when running in WASM mode
marcelklehr Aug 4, 2022
c4ae8c6
Add recrawl command
marcelklehr Aug 4, 2022
8003b29
Log exception
marcelklehr Aug 18, 2022
3f79c92
StorageCrawlJob: Remove unnecessary condition
marcelklehr Aug 18, 2022
e41ef0d
composer: Put phpunit in dev deps
marcelklehr Aug 19, 2022
a4df0fa
Do not put test images into repo
marcelklehr Aug 19, 2022
a8260eb
Make QueueMapper#getTableName throw to avoid headache
marcelklehr Aug 19, 2022
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
155 changes: 0 additions & 155 deletions .github/workflows/audio-command-test.yml
View file
Open in desktop

This file was deleted.

183 changes: 0 additions & 183 deletions .github/workflows/image-command-test.yml
View file
Open in desktop

This file was deleted.

Loading