Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
method ```chunk``` was not taking into consideration the overlap length when checking for the ```while``` loop and as a result it was running endlessly making the RAM go OOM. So added following functionality: 1. If the length of current document is lesser than overlap then no need to chunk it just return it. 2. Check if the start + overlap is lesser than content length to avoid endless chunking. Fixes #1703 ## Type of change Please check the options that are relevant: - [x] Bug fix (non-breaking change which fixes an issue) - [] New feature (non-breaking change which adds functionality) - [ ] Breaking change (fix or feature that would cause existing functionality to not work as expected) - [ ] Model update - [ ] Infrastructure change ## Checklist - [x] My code follows Phidata's style guidelines and best practices - [x] I have performed a self-review of my code - [ ] I have added docstrings and comments for complex logic - [x] My changes generate no new warnings or errors - [ ] I have added cookbook examples for my new addition (if needed) - [ ] I have updated requirements.txt/pyproject.toml (if needed) - [x] I have verified my changes in a clean environment
- Loading branch information