Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

FEAT: Properly implement map operator #4909

Open
noloerino opened this issue Aug 31, 2022 · 0 comments · May be fixed by #5118
Open

FEAT: Properly implement map operator #4909

noloerino opened this issue Aug 31, 2022 · 0 comments · May be fixed by #5118
Assignees
@noloerino
Labels
Epic Internals Internal modin functionality new feature/request 💬 Requests and pull requests for new features P2 Minor bugs or low-priority feature requests

Comments

@noloerino
Copy link
Collaborator

Most of the behavior for the map operator proposed in the Modin research papers is actually covered by the broadcast_* methods on dataframe/partition manager classes. We should refactor the codebase to use the logic for broadcast within map instead, which hopefully enables performance improvements.

map should also have an optional dtypes argument to hint the type of the resulting dataframe.

See also: stale algebra tracking issue #2924.
@noloerino noloerino added new feature/request 💬 Requests and pull requests for new features P2 Minor bugs or low-priority feature requests Internals Internal modin functionality labels Aug 31, 2022
@noloerino noloerino self-assigned this Aug 31, 2022
@noloerino noloerino mentioned this issue Aug 31, 2022
Open
@noloerino noloerino mentioned this issue Oct 5, 2022
Open
3 tasks
@noloerino noloerino linked a pull request Oct 12, 2022 that will close this issue
Draft
7 tasks
noloerino added a commit to noloerino/modin that referenced this issue Nov 1, 2022
@noloerino
FEAT-modin-project#4909: Properly implement map operator
f4fc351 
Signed-off-by: Jonathan Shi <[email protected]>
noloerino added a commit to noloerino/modin that referenced this issue Dec 6, 2022
@noloerino
FEAT-modin-project#4909: Properly implement map operator
da415ad 
Signed-off-by: Jonathan Shi <[email protected]>
@noloerino noloerino added the Epic label Dec 13, 2022
@noloerino noloerino mentioned this issue Dec 13, 2022
Open
@noloerino noloerino mentioned this issue Dec 13, 2022
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@noloerino noloerino

Labels
Epic Internals Internal modin functionality new feature/request 💬 Requests and pull requests for new features P2 Minor bugs or low-priority feature requests
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

FEAT-#4909: Properly implement map operator noloerino/modin
1 participant
@noloerino