Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Cherry-pick memory usage improvements PRs #27700

Open
wants to merge 3 commits into
base: releases/2024/5
Choose a base branch
from
Open

Cherry-pick memory usage improvements PRs #27700

wants to merge 3 commits into from

Commits on Nov 22, 2024

  1. [PyOV] Improve import_model memory consumption (openvinotoolkit#27451) 

    ### Details:
 - Writing to stringstream caused additional copy
- Usage of fstream also caused extra memory usage. Also we needed to
proper handle saving/removal of the tmp_file.
- So I've squeezed two `import_model` methods to one and I've
implemented/reused custom buffer that wraps interactions with python
memory without extra copies

### Tickets:
 - EISW-137436
    @akuporos
    akuporos committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    b8a0dfe View commit details
    Browse the repository at this point in the history

  2. [core] On Linux try return not used memory to system on compile model… 

    … destructor (openvinotoolkit#27534)

### Details:
- Optimize Linux process using OV memory consumption by returning not
used memory to the system when compiled model is destroyed.
- It should optimize memory usage by C++ and Python applications, as
Linux avoid reclaim memory until process end especially for small chunks
of allocations.

### Tickets:
 - CVS-149497
    @praasz @akuporos
    praasz authored and akuporos committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    a558dce View commit details
    Browse the repository at this point in the history

  3. Update src/inference/src/cpp/compiled_model.cpp 

    Co-authored-by: Roman Kazantsev <[email protected]>
    @akuporos @rkazants
    akuporos and rkazants authored Nov 22, 2024
    Configuration menu
    Copy the full SHA
    f8032c2 View commit details
    Browse the repository at this point in the history