Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: ScrapeGraph AI component updates and add new component ScrapgraphSearch API #6305

Merged
merged 9 commits into from
Feb 12, 2025

Conversation

VinciGit00
Copy link
Contributor

@VinciGit00 VinciGit00 commented Feb 12, 2025

Add search endpoint according to https://docs.scrapegraphai.com/services/searchscraper

This pull request includes several updates to the ScrapeGraph components, including dependency updates, new API integration, and enhancements to existing APIs.

Dependency Updates:

  • Updated scrapegraph-py dependency from version 1.10.2 to 1.12.0 in pyproject.toml.

New API Integration:

  • Added ScrapeGraphSearchApi component with methods for initializing and using the ScrapeGraph search functionality.

Enhancements to Existing APIs:

  • Modified ScrapeGraphMarkdownifyApi to use MessageTextInput for the url input and set tool_mode to True. [1] [2]
  • Enhanced ScrapeGraphSmartScraperApi by adding a new prompt input and updating the scrape method to include user_prompt. [1] [2] [3]

Codebase Maintenance:

  • Updated __init__.py to include the new ScrapeGraphSearchApi in the __all__ list.

@dosubot dosubot bot added size:M This PR changes 30-99 lines, ignoring generated files. enhancement New feature or request labels Feb 12, 2025
Copy link
Contributor

autofix-ci bot commented Feb 12, 2025

Hi! I'm autofix logoautofix.ci, a bot that automatically fixes trivial issues such as code formatting in pull requests.

I would like to apply some automated changes to this pull request, but it looks like I don't have the necessary permissions to do so. To get this pull request into a mergeable state, please do one of the following two things:

  1. Allow edits by maintainers for your pull request, and then re-trigger CI (for example by pushing a new commit).
  2. Manually fix the issues identified for your pull request (see the GitHub Actions output for details on what I would like to change).

@github-actions github-actions bot added enhancement New feature or request and removed enhancement New feature or request labels Feb 12, 2025
@edwinjosechittilappilly edwinjosechittilappilly changed the title feat: add search feat: add search component in Scrapegraph ai Bundle Feb 12, 2025
@github-actions github-actions bot added enhancement New feature or request and removed enhancement New feature or request labels Feb 12, 2025
@github-actions github-actions bot added enhancement New feature or request and removed enhancement New feature or request labels Feb 12, 2025
@github-actions github-actions bot added enhancement New feature or request and removed enhancement New feature or request labels Feb 12, 2025
Copy link
Collaborator

@edwinjosechittilappilly edwinjosechittilappilly left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

use MessageTextInput instead of StrInput (This change to be done in other scrapegraph component in a follow up PR). also add option tool_mode=True, where its a user input (not secrets) so the user can use the component as a tool.
add uv lock file.
Also Mention the icon name to the one that you have added to in styleutils.ts in earlier PR

@github-actions github-actions bot added enhancement New feature or request and removed enhancement New feature or request labels Feb 12, 2025
@VinciGit00 VinciGit00 changed the title feat: add search component in Scrapegraph ai Bundle feat: add search component in Scrapegraph ai Bundle and refactoring of older components Feb 12, 2025
@github-actions github-actions bot added enhancement New feature or request and removed enhancement New feature or request labels Feb 12, 2025
@github-actions github-actions bot added enhancement New feature or request and removed enhancement New feature or request labels Feb 12, 2025
@github-actions github-actions bot added enhancement New feature or request and removed enhancement New feature or request labels Feb 12, 2025
@github-actions github-actions bot added enhancement New feature or request and removed enhancement New feature or request labels Feb 12, 2025
@edwinjosechittilappilly edwinjosechittilappilly changed the title feat: add search component in Scrapegraph ai Bundle and refactoring of older components feat: ScrapeGraph AI component updates and add new component ScrapgraphSearch API Feb 12, 2025
Copy link
Collaborator

@edwinjosechittilappilly edwinjosechittilappilly left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@dosubot dosubot bot added the lgtm This PR has been approved by a maintainer label Feb 12, 2025
@github-actions github-actions bot added enhancement New feature or request and removed enhancement New feature or request labels Feb 12, 2025
@github-actions github-actions bot added enhancement New feature or request and removed enhancement New feature or request labels Feb 12, 2025
@edwinjosechittilappilly edwinjosechittilappilly added this pull request to the merge queue Feb 12, 2025
Merged via the queue into langflow-ai:main with commit 898775c Feb 12, 2025
34 of 35 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request lgtm This PR has been approved by a maintainer size:M This PR changes 30-99 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants