Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[NPU][EISW-138991] Weights separation PoC #27084

Draft
wants to merge 47 commits into
base: master
Choose a base branch
from
Draft

[NPU][EISW-138991] Weights separation PoC #27084

wants to merge 47 commits into from
+1,174 −210

Conversation

razvanapetroaie
Copy link
Contributor

Details:

  • item1
  • ...

Tickets:

  • ticket-id

@github-actions github-actions bot added the category: NPU OpenVINO NPU plugin label Oct 16, 2024
razvanapetroaie and others added 25 commits October 28, 2024 12:56
@razvanapetroaie
Adding weights I/O prefixes
788dfcb
@razvanapetroaie
Parsing I/O weights in the plugin-driver adapter
b3c3574
@razvanapetroaie
Some more adjustments to acommodate the new I/O prefixes
111aedd
@razvanapetroaie
Adding the compileWS method
73c7f1c
@razvanapetroaie
Implemented the compileWS method for the plugin-driver adapter
283bb45
@razvanapetroaie
Using the compileWS method instead of compile one
35729af
@razvanapetroaie
Enabling the WS path via a new config option
f5900d5
@razvanapetroaie
Skipping the weights inputs inside the L0 infer request
59074ef
@razvanapetroaie
Adding the signatures for the "runInit" calls
f345d87
@razvanapetroaie
Switching to reusing the Executor ctor
eec036d
@razvanapetroaie
Rewritten the "runInit" signatures
f5bad76
@razvanapetroaie
Extracting weights pointers
671de43
@razvanapetroaie
Starting the pipeline construction
d3452cc
@razvanapetroaie
Creating remote tensors for init input
e061e3f
@razvanapetroaie
Setting init outputs as main inputs upon inference request creation
0634e56
@razvanapetroaie
First version which is runnable by bapp
9e5dc3d
@razvanapetroaie
Small adjustments required for acommodating the most recent compiled …
f329c21 
…models
@razvanapetroaie
Some adjustments
382893b
@razvanapetroaie
Using topological sorting for weights identification
a5b8ed2
@razvanapetroaie
SIT accurate solution on resnet 50, but it's not a nice one
0bd457b
@razvanapetroaie
Adding time checks
54df505
@nikita-kud @razvanapetroaie
Use modified model for Init
9fc8f8b
@razvanapetroaie
Using the "initModel" as a local variable
04ad63f
@razvanapetroaie
Moving the compiler object within the CompiledModel class
4fd3039
@razvanapetroaie
Solving build issues related to batching
8a4a7b4
@razvanapetroaie razvanapetroaie force-pushed the EISW-138991-weights-separation-poc branch from c1a3146 to 8a4a7b4 Compare October 28, 2024 16:20
@razvanapetroaie razvanapetroaie force-pushed the EISW-138991-weights-separation-poc branch from 79514cb to 8f7b2a9 Compare November 5, 2024 18:23
@github-actions github-actions bot added the category: samples OpenVINO Runtime Samples label Nov 6, 2024
@razvanapetroaie razvanapetroaie force-pushed the EISW-138991-weights-separation-poc branch from c48b923 to d31dac5 Compare November 21, 2024 12:34
@razvanapetroaie razvanapetroaie force-pushed the EISW-138991-weights-separation-poc branch from 608a788 to b847a4b Compare November 25, 2024 17:33
@razvanapetroaie razvanapetroaie force-pushed the EISW-138991-weights-separation-poc branch from 82b8ba5 to 6d2b567 Compare November 26, 2024 18:28
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
category: NPU OpenVINO NPU plugin category: samples OpenVINO Runtime Samples
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@razvanapetroaie @nikita-kud