Agenteval integration into autogenstudio #3256
Closed
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Co-authored-by: Mark Sze <[email protected]>
* Added _configure_openai_config_for_bedrock to include aws variables in openai_config, necessary for setting AnthropicBedrock as client. * Removed aws_session_token from required_keys * Removed check for aws_session_token * Removed all checks for aws_session_token * Ran pre-commit --------- Co-authored-by: Chi Wang <[email protected]> Co-authored-by: HRUSHIKESH DOKALA <[email protected]>
Fixed formatting for "clear_history" Co-authored-by: Chi Wang <[email protected]>
* +mdb atlas * Update test/agentchat/contrib/vectordb/test_mongodb.py Co-authored-by: HRUSHIKESH DOKALA <[email protected]> * update test_mongodb.py; we dont need to do the assert .collection_name vs .name * Try fix mongodb service * Try fix mongodb service * Update username and password * Update autogen/agentchat/contrib/vectordb/mongodb.py * closer --- but im not super thrilled about the solution... * PYTHON-4506 Expanded tests and simplified vector search pipelines * Update mongodb.py * Update mongodb.py - Casey * search_index_magic index_name change; keeping track of lucene indexes is tricky * Fix format * Fix tests * hacking trying to figure this out * Streamline checks for indexes in construction and restructure tests * Add tests for score_threshold, embedding inclusion, and multiple query tests * refactored create_collection to meet base object requirements * lint * change the localhost port to 27017 * add test to check that no embedding is there unless explicitly provided * Update logger * Add test get docs with ids=None * Rename and update notebook * have index management include waiting behaviors * Adds further optional waits or users and tests. Cleans up upsert. * ensure the embedding size for multiple embedding inputs is equal to dimensions * fix up tests and add configuration to ensure documents and indexes are READY for querying * fix import failure * adjust typing for 3.9 * fix up the notebook output * changed language to communicate time taken on first init_chat call * replace environment variable usage --------- Co-authored-by: Fabian Valle <[email protected]> Co-authored-by: HRUSHIKESH DOKALA <[email protected]> Co-authored-by: Li Jiang <[email protected]> Co-authored-by: Casey Clements <[email protected]> Co-authored-by: Jib <[email protected]> Co-authored-by: Jib <[email protected]> Co-authored-by: Cozypet <[email protected]>
Co-authored-by: gongwn1 <[email protected]>
* update markdown hyperlinks to stable urls * update notebook images and text * re-write observability section * Updated section * update wording * added newline * update styling in image tags to be jsx compatible * added text * update link * simplified text * created blog * replace flow images with fewer shadows * reformat line * add authors * updated discord link and direct paths to image URLS * removed images since they are not stored in the AgentOps github * remove trailing whitespaces * removed newline * removed whitespace * Update website/blog/2024-07-25-AgentOps/index.mdx Co-authored-by: Mark Sze <[email protected]> * single quotes with double quotes --------- Co-authored-by: Braelyn Boynton <[email protected]> Co-authored-by: Mark Sze <[email protected]>
….md extension in the link for ConversableAgent (#3221) ConversableAgent has a break link in website/docs/Use-Cases/agent_chat.md file
Co-authored-by: Chi Wang <[email protected]> Co-authored-by: Qingyun Wu <[email protected]>
* Add gpt-4o-mini to model list * Fix formatting issue and verify with pre-commit * Remove extra space * Minor change to make pre-commit (formatting checks) pass --------- Co-authored-by: Qingyun Wu <[email protected]> Co-authored-by: Chi Wang <[email protected]> Co-authored-by: HRUSHIKESH DOKALA <[email protected]> Co-authored-by: Ian <[email protected]>
* update markdown hyperlinks to stable urls * update notebook images and text * re-write observability section * Updated section * update wording * added newline * update styling in image tags to be jsx compatible * added text * update link * simplified text * created blog * replace flow images with fewer shadows * reformat line * add authors * updated discord link and direct paths to image URLS * removed images since they are not stored in the AgentOps github * remove trailing whitespaces * removed newline * removed whitespace * Update website/blog/2024-07-25-AgentOps/index.mdx Co-authored-by: Mark Sze <[email protected]> * single quotes with double quotes * fix widths --------- Co-authored-by: Braelyn Boynton <[email protected]> Co-authored-by: Mark Sze <[email protected]>
* bump version * update * format --------- Co-authored-by: kevin666aa <[email protected]> Co-authored-by: Yiran Wu <[email protected]> Co-authored-by: Chi Wang <[email protected]>
* [Typo] Update MongoDB Notebook to acknlowedge >=M10 support The notebook instructions state we support only >=M30 clusters for AutoGen. This is slightly misleading. We support >=M10 clusters or any cluster that allows for index creation from client code. This support is continually updating so this PR updates the language to reflect that. * Add link! --------- Co-authored-by: Li Jiang <[email protected]>
Co-authored-by: HRUSHIKESH DOKALA <[email protected]>
* fix broken reference links that's pointing to a page that doesn't exists * Fix 2 broken links and use the correct format --------- Co-authored-by: Chi Wang <[email protected]>
* Update error language and corresponding tests * Updated another test to use the new error message
…alling in Ollama (#3197) * Recreated documentation for Local LLMs - LiteLLM and Ollama * Added Docker = False for code execution example --------- Co-authored-by: Chi Wang <[email protected]>
* add SendAsync api and tests * update example to use new sendAsync API
|
| GitGuardian id | GitGuardian status | Secret | Commit | Filename | |
|---|---|---|---|---|---|
| 10404693 | Triggered | Generic High Entropy Secret | d344481 | test/oai/test_utils.py | View secret |
| 10404695 | Triggered | Generic High Entropy Secret | d5911f0 | test/oai/test_utils.py | View secret |
| 10404695 | Triggered | Generic High Entropy Secret | 42b4cb4 | test/oai/test_utils.py | View secret |
| 10404696 | Triggered | Generic High Entropy Secret | d344481 | test/oai/test_utils.py | View secret |
| 10422482 | Triggered | Generic High Entropy Secret | d344481 | test/oai/test_utils.py | View secret |
| 10493810 | Triggered | Generic Password | 45faf8f | notebook/agentchat_pgvector_RetrieveChat.ipynb | View secret |
| 10493810 | Triggered | Generic Password | 153bac5 | notebook/agentchat_pgvector_RetrieveChat.ipynb | View secret |
| 10493810 | Triggered | Generic Password | 45faf8f | notebook/agentchat_pgvector_RetrieveChat.ipynb | View secret |
| 10493810 | Triggered | Generic Password | 153bac5 | notebook/agentchat_pgvector_RetrieveChat.ipynb | View secret |
| 10493810 | Triggered | Generic Password | 45faf8f | notebook/agentchat_pgvector_RetrieveChat.ipynb | View secret |
| 11616921 | Triggered | Generic High Entropy Secret | 83a7162 | notebook/agentchat_agentops.ipynb | View secret |
| 11616921 | Triggered | Generic High Entropy Secret | 9671680 | notebook/agentchat_agentops.ipynb | View secret |
| 12853598 | Triggered | Generic High Entropy Secret | d344481 | test/oai/test_utils.py | View secret |
| 12853599 | Triggered | Generic High Entropy Secret | d344481 | test/oai/test_utils.py | View secret |
| 12853600 | Triggered | Generic High Entropy Secret | d344481 | test/oai/test_utils.py | View secret |
| 12853601 | Triggered | Generic High Entropy Secret | d344481 | test/oai/test_utils.py | View secret |
| 12853602 | Triggered | Generic High Entropy Secret | d344481 | test/oai/test_utils.py | View secret |
🛠 Guidelines to remediate hardcoded secrets
- Understand the implications of revoking this secret by investigating where it is used in your code.
- Replace and store your secrets safely. Learn here the best practices.
- Revoke and rotate these secrets.
- If possible, rewrite git history. Rewriting git history is not a trivial act. You might completely break other contributing developers' workflow and you risk accidentally deleting legitimate data.
To avoid such incidents in the future consider
- following these best practices for managing and storing secrets including API keys and other credentials
- install secret detection on pre-commit to catch secret before it leaves your machine and ease remediation.
🦉 GitGuardian detects secrets in your source code to help developers and security teams secure the modern development process. You are seeing this because you or someone else with access to this repository has authorized GitGuardian to scan your pull request.
|
Closing because of inactivity. Please reopen if you are still working on it. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Why are these changes needed?
Changes to integrate the AgentEval criteria generation and quantification into AutogenStudio.
Related issue number
#2162
Checks