Sync langchain V0.2 with main branch #131
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
* add jupyter notebooks that can be directly opened on colab * update the links in the readme * Prompt to rerun task sampling when no episodes are retrieved
* Update server.py * Update mypy.yml * Update tests.yml * Update parallel.py Co-authored-by: Armaan Khetarpaul <[email protected]>
* support agentprofile and environmentprofile serialization * convert json to jsonl * pass pre-commit test * add missing attribute * support other serialization * precommit check * support testing of serialization * support testing of serialization * support testing of serialization * change the data path * fix ruff * support concurrency control * support concurrency control
* support agentprofile and environmentprofile serialization * convert json to jsonl * pass pre-commit test * add missing attribute * support other serialization * precommit check * support testing of serialization * support testing of serialization * support testing of serialization * change the data path * fix ruff * support automatic package bump
* add benchmark social agents * add benchmark agents * Add sotopia_benchmark cli api * fix pre-commit * add evaluator model argument * finish benchmarking * benchmark done * chore: Fix formatting issue in redis_stats.ipynb and cli.py * switch back to LLM_Name * merge main * add together ai * fix naming error * roll back to llama2 * chore: Update langchain-together dependency to version 0.1.2 * use chatopenai for together models * add logging * fix pre-commit * add more logging options * probably fix the event loop closed error: following NVIDIA/NeMo-Guardrails#336 * modify cli; fix model position bug * chore: Update benchmark tag to "benchmark_{model}_final" * Refactor _iterate_all_env_agent_combo_not_in_db function * chore: Update python version to 3.11.2 * change to dict comparison * ignore jsonl * ✨ finish benchmarking script * chore: Refactor server.py and redis_stats.ipynb * add type ignore * push for the eval * Refactor run_async_benchmark_in_batch function * Refactor run_async_benchmark_in_batch function * add doc * precommit fix * pre-commit * refactor * update w feedback * pre commit * chore: Update authors in pyproject.toml and fetch benchmark_agents.json from Hugging Face API * hotfix * chore: Remove unnecessary type hint in benchmark/cli.py --------- Co-authored-by: Hao <[email protected]>
Bumps [google-generativeai](https://github.com/google/generative-ai-python) from 0.5.4 to 0.6.0. - [Release notes](https://github.com/google/generative-ai-python/releases) - [Changelog](https://github.com/google-gemini/generative-ai-python/blob/main/RELEASE.md) - [Commits](google-gemini/generative-ai-python@v0.5.4...v0.6.0) --- updated-dependencies: - dependency-name: google-generativeai dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* bump the version, test release to PyPi * Update README.md * Update README.md * Update README.md * bumpy version to 0.0.9 * Update Sotopia presentation information in README.md
* remove pandas #82 * ✅ add tests to verify the serialization without pandas works
Bumps [pettingzoo](https://github.com/Farama-Foundation/PettingZoo) from 1.24.0 to 1.24.3. - [Release notes](https://github.com/Farama-Foundation/PettingZoo/releases) - [Commits](Farama-Foundation/PettingZoo@1.24.0...1.24.3) --- updated-dependencies: - dependency-name: pettingzoo dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* support agentprofile and environmentprofile serialization * convert json to jsonl * pass pre-commit test * add missing attribute * support other serialization * precommit check * support testing of serialization * support testing of serialization * support testing of serialization * change the data path * fix ruff * support codecov * support codecov * support codecov * fix pre-commit * update poetry lock * add codecov badge * add codecov comment --------- Co-authored-by: Hao <[email protected]>
* git ignore * add nextra site * change path to docs * Add installation instruction (#76) * fix an accordion bug * Add tabs for choosing platform in Redis Instructions * add platform tab * updated open in colab instruction
Bumps [google-generativeai](https://github.com/google/generative-ai-python) from 0.6.0 to 0.7.0. - [Release notes](https://github.com/google/generative-ai-python/releases) - [Changelog](https://github.com/google-gemini/generative-ai-python/blob/main/RELEASE.md) - [Commits](google-gemini/generative-ai-python@v0.6.0...v0.7.0) --- updated-dependencies: - dependency-name: google-generativeai dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Bumps [lxml](https://github.com/lxml/lxml) from 4.9.4 to 5.2.2. - [Release notes](https://github.com/lxml/lxml/releases) - [Changelog](https://github.com/lxml/lxml/blob/master/CHANGES.txt) - [Commits](lxml/lxml@lxml-4.9.4...lxml-5.2.2) --- updated-dependencies: - dependency-name: lxml dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Bumps [anthropic](https://github.com/anthropics/anthropic-sdk-python) from 0.26.1 to 0.28.1. - [Release notes](https://github.com/anthropics/anthropic-sdk-python/releases) - [Changelog](https://github.com/anthropics/anthropic-sdk-python/blob/main/CHANGELOG.md) - [Commits](anthropics/anthropic-sdk-python@v0.26.1...v0.28.1) --- updated-dependencies: - dependency-name: anthropic dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* upgrade langchain and remove sync apis * remove return prompt from agenerate * remove prompt from agenerate * add sync apis
Bumps [fastapi](https://github.com/tiangolo/fastapi) from 0.109.2 to 0.110.3. - [Release notes](https://github.com/tiangolo/fastapi/releases) - [Commits](fastapi/fastapi@0.109.2...0.110.3) --- updated-dependencies: - dependency-name: fastapi dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* git ignore * add nextra site * change path to docs * Add installation instruction (#76) * fix an accordion bug * Add tabs for choosing platform in Redis Instructions * add platform tab * updated open in colab instruction * add agents.md/environments.md rename all_the_issues to troubleshooting * add auto set script * add more dataset choices * adding download data menu and protection when the path exists * Unify benchmark and install into `sotopia` cli command * move install and benchmark in to folders * make flow more rigorious and add tests * update linux direction * add restart directions * remove _renderer * add use docker test * call -> run * add shell=True * mkdir when the dirctory doesn't exist * remove docker test due to memory limit * add prompt mocking * add install cli * add a sleep to make sure that the redis is launched before stopping * add matrix os in pytest * add poetry to path on macos * Use install poetry action * make redis directory on mac * avoid permission issue on mac * update macos test * test docker * install docker with brew * set up docker * give up testing docker on mac * check if docker daemon is up and brew update * improve prompts * update prompt tests --------- Co-authored-by: XuhuiZhou <[email protected]> Co-authored-by: Ruiyi Wang <[email protected]>
Bumps [anthropic](https://github.com/anthropics/anthropic-sdk-python) from 0.28.1 to 0.30.0. - [Release notes](https://github.com/anthropics/anthropic-sdk-python/releases) - [Changelog](https://github.com/anthropics/anthropic-sdk-python/blob/main/CHANGELOG.md) - [Commits](anthropics/anthropic-sdk-python@v0.28.1...v0.30.0) --- updated-dependencies: - dependency-name: anthropic dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* add a test case for a single dimension evaluation * fix the single dimension bug --------- Co-authored-by: XuhuiZhou <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Closes #
📑 Description
✅ Checks
type/descript(e.g.feature/add-llm-agents)ℹ Additional Information