Releases: tomasnorre/crawler
Releases · tomasnorre/crawler
[RELEASE] Crawler version 11.0.4
Fixed
- Crawler could not index frontend because of trustedHostPattern mismatch
- Fatal PHP error is thrown in the backend crawler log
- Prevent buildQueue from creating entries for non-localized pages
- CrawlerController checking if URL is correct ObjectType fixed
Deprecated
Functions & Properties
- ConfigurationRepository->getCrawlerConfigurationRecords()
- ProcessRepository->findByProcessId()
- QueueRepository->countAllUnassignedPendingItems()
- QueueRepository->countPendingItemsGroupedByConfigurationKey()
- QueueRepository->getSetIdWithUnprocessedEntries()
- QueueRepository->getTotalQueueEntriesByConfiguration()
- QueueRepository->getLastProcessedEntriesTimestamps()
- QueueRepository->getLastProcessedEntries()
- QueueRepository->getPerformanceData()
- QueueRepository->isPageInQueueTimed()
- QueueRepository->getAvailableSets()
- QueueRepository->findByQueueId()
New Contributors
- @andreashager made their first contribution in #899
- @LukeDberg made their first contribution in #891
[RELEASE] Crawler version 11.0.3
Added
- PHP 8.1 compatibility
Fixed
- PHP8 undefined array key when creating/updating/saving configuration record
- RestrictedPages is getting crawled when Crawler Configuration contains the belonging UserGroup
Contributors
[RELEASE] Crawler version 11.0.2
Added
- Docs: Troubleshooting - Site based baseVariants not used
- Docs: Example on how to exclude pages recursively from being crawled
- Docs: Respecting Categories in News to prevent double indexing
- Docs: Set correct main branch name
Fixed
- DateTime parse error in backend module when displaying log
- PHP8 undefined array keys in CrawlerController, ConfigurationService and middlewares
- Text not displayed in confirm dialog in backend module
New Contributors
- @kpnielsen made their first contribution in #866
[RELEASE] Crawler version 11.0.1
Changed
- Use more expressive message for excluded doktypes when building queue
Fixed
- Set
result_data
back tojson_encode($result)
to ensure correct result handling in backend - Removes QueueRepository from FrontendUserAuthenticator Middleware, to ensure FE plugins can be rendered
- PHP 8.0 compatibility problems. Undefined indexes resolved
- Change requests to write to Header to ensure StaticFileCache is working
- Switched back to fetch() instead of fetchAssociative() to keep support for legacy TYPO3 installations
[RELEASE] Crawler version 11.0.0
Only added functionality is added here, please see the
https://github.com/tomasnorre/crawler/blob/main/CHANGELOG.md
for more changes.
Added
- Support for TYPO3 11 LTS
- PHP 8.0 Support
- Display error messages in buildQueue command in CLI
- PSR-14 ModifySkipPageEvent
- PSR-14 AfterUrlCrawledEvent
- PSR-14 InvokeQueueChangeEvent
- PSR-14 AfterUrlCrawledEvent
- PSR-14 BeforeQueueItemAddedEvent
- PSR-14 AfterQueueItemAddedEvent
[RELEASE] Crawler version 10.0.2
Added
- Replace in composer for aoepeople/crawler
Changed
- Changed composer package name to tomasnorre/crawler
[RELEASE] Crawler version 10.0.1
- Fixed
Exclude Pages in Crawler configs accepts e.g.6+3
again, page id 6 & depth 3
[RELEASE] Crawler version 10.0.0
-
Added
Added information about indexed_search money pool -
Fixed
Add processId to finished QueueEntries to ensure the process will been seen as successful instead of cancelled.
Fix type error when exclude subcfg is not defined
Sites/URLs get crawled but not indexed @twestner -
Removed Properties
!!! CrawlerController->tableName
!!! ConfigurationRepository->tableName
!!! ProcessRepository->tableName
!!! QueueRepository->tableName
[RELEASE] Crawler version 9.2.4
Fixes:
- Date parsing for immediate queue entries
[RELEASE] Crawler version 9.2.3
[RELEASE] Crawler version 9.2.3