Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Cherry-pick memory usage improvements PRs #27700

Open
wants to merge 3 commits into
base: releases/2024/5
Choose a base branch
from
Open

Cherry-pick memory usage improvements PRs #27700

wants to merge 3 commits into from

Conversation

akuporos
Copy link
Contributor

@akuporos akuporos commented Nov 22, 2024 •
edited
Loading

akuporos and others added 2 commits November 22, 2024 12:35
@akuporos
[PyOV] Improve import_model memory consumption (openvinotoolkit#27451)
b8a0dfe 
### Details:
 - Writing to stringstream caused additional copy
- Usage of fstream also caused extra memory usage. Also we needed to
proper handle saving/removal of the tmp_file.
- So I've squeezed two `import_model` methods to one and I've
implemented/reused custom buffer that wraps interactions with python
memory without extra copies

### Tickets:
 - EISW-137436
@praasz @akuporos
[core] On Linux try return not used memory to system on compile model…
a558dce 
… destructor (openvinotoolkit#27534)

### Details:
- Optimize Linux process using OV memory consumption by returning not
used memory to the system when compiled model is destroyed.
- It should optimize memory usage by C++ and Python applications, as
Linux avoid reclaim memory until process end especially for small chunks
of allocations.

### Tickets:
 - CVS-149497
@akuporos akuporos requested review from a team as code owners November 22, 2024 12:38
@akuporos akuporos added this to the 2024.6 milestone Nov 22, 2024
@github-actions github-actions bot added category: inference OpenVINO Runtime library - Inference category: Python API OpenVINO Python bindings labels Nov 22, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@praasz praasz praasz approved these changes

@rkazants rkazants rkazants approved these changes

@ilya-lavrenov ilya-lavrenov Awaiting requested review from ilya-lavrenov

Assignees

@ilya-lavrenov ilya-lavrenov

Labels
category: inference OpenVINO Runtime library - Inference category: Python API OpenVINO Python bindings
Projects
None yet
Milestone
2024.6
Development

Successfully merging this pull request may close these issues.
4 participants
@akuporos @rkazants @praasz @ilya-lavrenov