Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

VirtualEnv with Pandas and MySQL 5.7 Support #1

Open
mblomdahl opened this issue Sep 10, 2022 · 0 comments
Open

VirtualEnv with Pandas and MySQL 5.7 Support #1

mblomdahl opened this issue Sep 10, 2022 · 0 comments
Assignees

Comments

@mblomdahl
Copy link
Member

We need a Python 3 virtualenv to work from, it should have everything needed to create a simple command line tool which queries Bamboo's MySQL database and return the data as easily managed DataFrames. E.g.

pip install pandas click ipython sqlalchemy pymysql wheel
@mblomdahl mblomdahl self-assigned this Sep 10, 2022
mblomdahl added a commit that referenced this issue Sep 10, 2022
    pip install pandas click ipython sqlalchemy pymysql wheel

This is the basis for the initial `requirements.txt`.

(Also added some useful Getting Started info to README.)
mblomdahl added a commit that referenced this issue Sep 12, 2022
After hours and hours of troubleshooting, this is the initial (failing) stab at getting Bamboo to communicate with MySQL 5.7, upon performing the _Setting Up Database_ steps during the basic Bamboo configuration guide, we keep getting these errors in MySQL server:

    2022-09-12T19:02:41.813374Z 5 [Note] Aborted connection 5 to db: 'bamboo' user: 'bamboouser' host: '172.20.0.3' (Got an error reading communication packets)
    2022-09-12T19:02:43.815778Z 6 [Note] Aborted connection 6 to db: 'bamboo' user: 'bamboouser' host: '172.20.0.3' (Got an error reading communication packets)
    ...

This is the error detail at maximum error log verbosity, and Bamboo fails without clear error message and redirects back to the _Configure Database Connection Parameters Form_.

We should proceed with using Postgres as database instead, and see if we can make the Python Pandas abstract away the RDBMS differences.
mblomdahl added a commit that referenced this issue Sep 12, 2022
Initial Bamboo configuration screens must still be filled in with DB parameters and data import options, but apart from this it is up and running upon 'docker-compose up'.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant