[CPU]whisper readvalue optimize

[xipingyan]

Details:

• New ReadValueWithSubgraph node.
• Move ReadValue's initial subgraph nodes to ReadValueWithSubgraph
• Mirror ReadValueWithSubgraph to MemoryInput
• *Upgrade MemoryInput and MemoryInputBase in order to let them support multiple inputs"
• Call new interface Init and Activate of ov::intel_cpu::Graph, avoid to memory copy. Refer: [CPU] Introduce SubModel op and Composite node #25385
• Depends on [CPU] Drop redundant MemoryOutput nodes #27189

Tickets:

• 128743

[maxnick]

Shouldn't we pass the variable here?

[xipingyan]

Move some parameters to constructor of ReadValueWithSubgraph and add associated constructor.

[maxnick]

Above we enforced the output memory descriptor of the subgraph to be the same as in the node, so we don't need to redefine the node config. The only thing we really need to do here is inserting a sanity check:

    // for the output descriptors, use the configuration of the graph's output nodes
    auto outputDescriptors = m_graph.getOutputMemoryDescriptors();

    const auto& desc = outputDescriptors.front();

    // just a sanity check
    CPU_NODE_ASSERT(desc->isCompatible(*(config.outConfs.front().getMemDesc())), "Unexpected node <-> subgraph output memory descriptor mismatch");

Just to make sure that the output memory descriptor has been really enforced.

[xipingyan]

Hi @maxnick , if we enforce memory descriptor here, the subGraph also need to re-init(https://github.com/xipingyan/openvino/blob/7060e852ef2ff532351b3e8421c127515322767f/src/plugins/intel_cpu/src/nodes/memory.cpp#L683).
Because subGraph->Init can only call once(second call can trigger crash).
So I removed MemoryInput::selectOptimalPrimitiveDescriptor(), and move then to here.

[maxnick]

We don't need to enforce it exactly here! It's already enforced in

        std::vector<Input::OutputConfig> graphOutputConfig;
        for (auto&& portConfig : config.outConfs) {
            auto desc = portConfig.getMemDesc();
            graphOutputConfig.emplace_back(node::Input::OutputConfig{desc, true});
        }

My comment was about exactly these lines of code

        std::vector<PortConfig> outConfs;

        outConfs.emplace_back(desc, BlockedMemoryDesc::FULL_MASK, 0);  // use the memory from the first input inPlace

        const NodeConfig config(inConfs, outConfs);

        supportedPrimitiveDescriptors.clear();
        supportedPrimitiveDescriptors.emplace_back(config, impl_desc_type::undef);

        selectPrimitiveDescriptorByIndex(0);

We mustn't call these methods, as they redefine the node port descriptors, but we don't need to redefine them at all, as the dependency is directed toward the subgraph, i.e. we enforce the existing node memory descriptors in the subgraph to allow memory substitution. That's it.

[xipingyan]

Sorry, updated.