#793: Added support Pandas 2 pyarrow dtype columns for emitting data from Python UDFs #795

tkilias · 2023-05-04T07:23:48Z

Fixes #793
Fixes #796

All Submissions:

Check if your pull request goes to the correct bash branch (develop or master)?
Is the title of the Pull Request correct?
Is the title of the corresponding issue correct?
Have you updated the changelog?
Have you checked to ensure there aren't other open Pull Requests for the same update/change?
Are you mentioning the issue which this PullRequest fixes ("Fixes...")

When integrating to Develop branch:

Remember to merge with "Squash and Merge"

When integrating to Main branch:

Remember to merge with "Merge"

… template flavors and replace asscalar with item in test dataframe.py, because asscalar was removed

…h NAN. - Refactor and split Pandas Tests - Add tests for more dtypes to Pandas Tests

… the user guide.

doc/changes/changes_6.1.0.md

doc/user_guide/py_dataframe.md

Co-authored-by: Thomas Ubensee <[email protected]>

…_to_pandas_2

…into feature/793_update_to_pandas_2

doc/changes/changes_6.1.0.md

* #792: Updated script-languages-container-tool to 0.17.0 and script-languages-container-ci to 1.1.0 (#799) * #800: Updated Ubuntu packages (#801) * #803: Updated Ubuntu packages (#804) * #814: Updated packages (#815) * #793: Added support for Pandas 2 pyarrow dtype columns for emitting data from Python UDFs (#795) * #796: Fixed silent data corruption when emitting dataframes with float16 dtype columns from Python UDFs --------- Co-authored-by: Thomas Ubensee <[email protected]>

tkilias linked an issue May 4, 2023 that may be closed by this pull request

Update Pandas package to version 2.0 in standard 8.0 flavor and the template flavors #793

Closed

tkilias force-pushed the feature/793_update_to_pandas_2 branch 2 times, most recently from c0a0092 to e018cfc Compare May 23, 2023 08:35

tkilias added 5 commits May 25, 2023 17:05

Update pandas to 2.0.1 in standard-EXASOL-8.0.0 flavor and compatible…

8bd3906

… template flavors and replace asscalar with item in test dataframe.py, because asscalar was removed

Add handleEmitPyFloat to also support float pyarrow dtype columns wit…

4755c07

…h NAN. - Refactor and split Pandas Tests - Add tests for more dtypes to Pandas Tests

Add a mapping table between dtypes and db types for dataframe emit to…

7a16826

… the user guide.

Remove wrong separator lines from py_dataframe.md

527dde0

Update submodule

283eee6

tkilias force-pushed the feature/793_update_to_pandas_2 branch from cf6ab5c to 283eee6 Compare May 25, 2023 15:08

tkilias changed the title ~~#793: Update Pandas package to version 2.0 in standard 8.0 flavor and the template flavors~~ #793: Update Pandas package to version 2.0 in standard 8.0 flavor and the template flavors and support pyarrow dtypes for emit May 26, 2023

tkilias changed the title ~~#793: Update Pandas package to version 2.0 in standard 8.0 flavor and the template flavors and support pyarrow dtypes for emit~~ #793: Added support Pandas 2 pyarrow dtype columns for emit in Python UDFs May 26, 2023

tkilias changed the title ~~#793: Added support Pandas 2 pyarrow dtype columns for emit in Python UDFs~~ #793: Added support Pandas 2 pyarrow dtype columns for emitting data from Python UDFs May 26, 2023

Updated changelog and package diffs

9bd8fb2

tkilias linked an issue May 26, 2023 that may be closed by this pull request

Emitting a Dataframe with dtype float16 from a Python-UDF leads to silent data corruption #796

Closed