CreateSessionFromArrayWithPrepackedWeightsContainer property

Pointer<NativeFunction<OrtStatusPtr Function(Pointer<OrtEnv> env, Pointer<Void> model_data, Size model_data_length, Pointer<OrtSessionOptions> options, Pointer<OrtPrepackedWeightsContainer> prepacked_weights_container, Pointer<Pointer<OrtSession>> out)>> CreateSessionFromArrayWithPrepackedWeightsContainer
getter/setter pair

\brief Create session from memory with prepacked weights container

Same functionality offered by OrtApi::CreateSessionFromArray except that a container that contains pre-packed weights' buffers is written into/read from by the created session. This is useful when used in conjunction with OrtApi::AddInitializer which injects shared initializer info into sessions. Wherever possible, the pre-packed versions of these shared initializers are cached in this container so that multiple sessions can just re-use these instead of duplicating these in memory.

\paramin env \paramin model_data Array of bytes holding the model \paramin model_data_length Number of bytes in model_data_model \paramin options \paramin prepacked_weights_container \paramout out Newly created ::OrtSession. Must be freed with OrtApi::ReleaseSession

\snippet{doc} snippets.dox OrtStatus Return Value

Implementation

external ffi.Pointer<
  ffi.NativeFunction<
    OrtStatusPtr Function(
      ffi.Pointer<OrtEnv> env,
      ffi.Pointer<ffi.Void> model_data,
      ffi.Size model_data_length,
      ffi.Pointer<OrtSessionOptions> options,
      ffi.Pointer<OrtPrepackedWeightsContainer> prepacked_weights_container,
      ffi.Pointer<ffi.Pointer<OrtSession>> out,
    )
  >
>
CreateSessionFromArrayWithPrepackedWeightsContainer;