Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

refactor: Replace pexpect with libtmux in BashSession #4881

Draft
wants to merge 149 commits into
base: main
Choose a base branch
from
Draft

refactor: Replace pexpect with libtmux in BashSession #4881

wants to merge 149 commits into from
+1,585 −677

Conversation

xingyaoww
Copy link
Collaborator

@xingyaoww xingyaoww commented Nov 10, 2024 •
edited by github-actions bot
Loading

  • Simplified implementation using libtmux instead of pexpect
  • Added proper handling of command errors, interactive commands, and timeouts
  • Added test suite to verify behavior
  • Improved output handling and error detection

End-user friendly description of the problem this fixes or functionality that this introduces

  • Include this change in the Release Notes. If checked, you must provide an end-user friendly description for your change below

Give a summary of what the PR does, explaining any non-trivial design decisions

Collaborated with OpenHands:

Link of any specific issues this addresses

To run this PR locally, use the following command:

docker run -it --rm   -p 3000:3000   -v /var/run/docker.sock:/var/run/docker.sock   --add-host host.docker.internal:host-gateway   -e SANDBOX_RUNTIME_CONTAINER_IMAGE=docker.all-hands.dev/all-hands-ai/runtime:043cc16-nikolaik   --name openhands-app-043cc16   docker.all-hands.dev/all-hands-ai/openhands:043cc16

openhands-agent and others added 30 commits November 10, 2024 18:12
@openhands-agent
refactor: Replace pexpect with libtmux in BashSession
7b86e33 
- Simplified implementation using libtmux instead of pexpect
- Added proper handling of command errors, interactive commands, and timeouts
- Added test suite to verify behavior
- Improved output handling and error detection
@xingyaoww
update poetry and implement pwd
9e5653c
@xingyaoww
add CmdOutputMetadata to get a lot of info from ps1
522eb53
@xingyaoww
handle and test on multiple PS1 block
d60065b
@xingyaoww
greatly simplify command to not accepting blocking/keep_prompt, we sh…
e304973 
…ould do it in the CmdOutputObservation end for keep_prompt
@xingyaoww
fix PS1 so PS1JSON works
c743833
@xingyaoww
support pid
49eae72
@xingyaoww
preliminary impl of bash
363b379
@xingyaoww
slight refactor of cmd
ffa0676
@xingyaoww
add blocking back
554e03a
@xingyaoww
add blocking back
2b252e0
@openhands-agent
Improve test coverage for CmdOutputMetadata
e994620 
- Add tests for missing fields in PS1 metadata
- Add tests for malformed values in numeric fields
- Add tests for boolean values in numeric fields
- Fix JSON parsing in test_ps1_metadata_json_structure
- Fix handling of malformed values in from_ps1_match
@openhands-agent
Refactor error handling in CmdOutputMetadata
1935483 
- Move error handling from from_ps1_match to from_ps1
- Let from_ps1_match raise exceptions for invalid data
- Update tests to match new error handling behavior
@openhands-agent
Improve CmdOutputMetadata handling of malformed values and line endings
23ddbe4 
- Add support for float values in numeric fields
- Fix regex pattern to handle different line endings
- Add more test cases for edge cases
- Keep valid string fields when numeric fields fail to parse
@openhands-agent
Refactor PS1 metadata regex pattern
744938c 
- Use re.escape() to properly escape special characters in markers
- Use constants to avoid duplication
- Update tests to use constants and handle newlines consistently
@xingyaoww
update test bash session to be compatible with latest interface
f5518bf
@xingyaoww
make sure ps1 end begin with newline
aaed596
@xingyaoww
add newline suffix for test
71e4ec5
@xingyaoww
add test
3a2443f
@xingyaoww
add testcase & tweak for ps1
ceb0d32
@xingyaoww
remove re escape
145f141
@xingyaoww
tweak ps1
56e4df5
@xingyaoww
fix bash session arg
9e43ee5
@xingyaoww
make action execution server compatible
ed382c6
@xingyaoww
remove command id from agent obs & make other places compatible with …
8e4180f 
…the new change
@xingyaoww
fix typo
3c68c7d
@xingyaoww
fix typo
d82c420
@xingyaoww
do not wrap lines in tmux captured output
010e453
@xingyaoww
use pwd to get working_dir
4aeb681
@xingyaoww
use PROMPT_COMMAND to make sure PS1 changes
28615cd
xingyaoww and others added 30 commits November 27, 2024 19:39
@xingyaoww
get bash session tests working with pipe-pane
96fa5be
@xingyaoww
ok we may need to live with color when doing pipe-pane
a657690
@xingyaoww
Merge commit '082a55195ffa669ff71669156f9d8aa887217075' into feature/…
8132820 
…tmux-shell
@xingyaoww
add tests back
3ad3a39
@xingyaoww
add destructor
f360b87
@xingyaoww
cleanup bracketed-paste
49be926
@xingyaoww
only .close() if not closed
6fd958c
@xingyaoww
Merge commit '5069a8700a8fc1219b10e2b57b1922eab995ec9f' into feature/…
61ebe54 
…tmux-shell
@xingyaoww
remove ansi test
6db1672
@xingyaoww
improve debug log
b1652be
@xingyaoww
feat: display exact error for runtime requests exception handling
c50a45e
@xingyaoww
Merge commit 'c50a45e9f058182def36c4a07650323ebaee020a' into feature/…
fb19118 
…tmux-shell
@xingyaoww
fix action execution detail
40e6767
@xingyaoww
fix action execution detail
a5815e6
@xingyaoww
replace all occurences of requests.HTTPError
dce4a38
@xingyaoww
replace all occurences of requests.HTTPError
f05af62
@xingyaoww
simplify error
ab4f0e4
@xingyaoww
Merge commit 'ab4f0e497046c97e47e3d2cf369bdd16f6593a09' into feature/…
3d03509 
…tmux-shell
@xingyaoww
only print stacktrace
84c75e4
@xingyaoww
get pipe to work for bash session (kinda)
79410c5
@xingyaoww
do not reset pane every time
a878109
@xingyaoww
remove extra debug; fix session test
115cde3
@xingyaoww
fix bug for very long outputs
990fb03
@xingyaoww
reduce freq of getting pane output & parse ps1
cc44952
@xingyaoww
Merge commit '1b8104ba14234599ce3a19e266582be7b87cf23c' into feature/…
ba52ac5 
…tmux-shell
@xingyaoww
get read -p test back
be8c9d5
@xingyaoww
disable enter name check
aee78f3
@xingyaoww
fix cleanup
dc2c23b
@xingyaoww
always combine outputs between matches on all cases
8db6055
@xingyaoww
fix combine output bugs
043cc16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@xingyaoww @diwu-sf @openhands-agent