CreateSessionWithPrepackedWeightsContainer property

Pointer<NativeFunction<OrtStatusPtr Function(Pointer<OrtEnv> env, Pointer<Char> model_path, Pointer<OrtSessionOptions> options, Pointer<OrtPrepackedWeightsContainer> prepacked_weights_container, Pointer<Pointer<OrtSession>> out)>> CreateSessionWithPrepackedWeightsContainer
getter/setter pair

\brief Create session with prepacked weights container

Same functionality offered by OrtApi::CreateSession except that a container that contains pre-packed weights' buffers is written into/read from by the created session. This is useful when used in conjunction with OrtApi::AddInitializer which injects shared initializer info into sessions. Wherever possible, the pre-packed versions of these shared initializers are cached in this container so that multiple sessions can just re-use these instead of duplicating these in memory.

\paramin env OrtEnv instance instance \paramin model_path Null terminated string of the path (wchar on Windows, char otherwise) \paramin options \paramin prepacked_weights_container \paramout out Newly created ::OrtSession. Must be freed with OrtApi::ReleaseSession

\snippet{doc} snippets.dox OrtStatus Return Value

Implementation

external ffi.Pointer<
  ffi.NativeFunction<
    OrtStatusPtr Function(
      ffi.Pointer<OrtEnv> env,
      ffi.Pointer<ffi.Char> model_path,
      ffi.Pointer<OrtSessionOptions> options,
      ffi.Pointer<OrtPrepackedWeightsContainer> prepacked_weights_container,
      ffi.Pointer<ffi.Pointer<OrtSession>> out,
    )
  >
>
CreateSessionWithPrepackedWeightsContainer;