Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[GPU] Allow base mode reshape to be optimized for case where batch can be squeezed #27830

Open
wants to merge 3 commits into
base: master
Choose a base branch
from
Open

[GPU] Allow base mode reshape to be optimized for case where batch can be squeezed #27830

wants to merge 3 commits into from
+131 −12

Conversation

andrew-k-park
Copy link
Contributor

Details:

  • If reshape is base mode, padding is manually propagated only in specific cases (e.g. crop + reshape)
  • In other cases, reshape containing dynamic padding is not optimized because padding propagation is not allowed during shape inference
  • Therefore, like whisper-base model, even if the input of reshape includes dynamic padding, if the batch dimension can be squeezed, reshape is allowed to be optimized and propagated padding

Tickets:

  • 145274

@andrew-k-park andrew-k-park requested review from a team as code owners November 29, 2024 13:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
category: GPU OpenVINO GPU plugin under_perf_check
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@andrew-k-park