genkit_hybrid 0.1.0 copy "genkit_hybrid: ^0.1.0" to clipboard
genkit_hybrid: ^0.1.0 copied to clipboard

Provider-agnostic hybrid routing for Genkit — combine on-device and cloud models behind one routing policy.

Changelog #

0.1.0 #

Initial release.

  • hybridModel(branches, strategy) — combine N named Genkit Model actions behind one routing policy; returns an ordinary Model.
  • hybridModelOnDeviceCloud(onDevice, cloud, strategy) — binary façade with kOnDevice / kCloud keys.
  • RoutingStrategy interface returning an ordered list of branch keys (single = pre-routing, multi = fallback, empty = no decision).
  • Built-in strategies: PreRoutingStrategy, FallbackStrategy, ConnectivityStrategy, InputSizeStrategy, and combinators FirstMatch, WithFallback.
  • Streaming fallback only before the first emitted token.
  • Transient-vs-permanent error policy: fallback on availability errors, immediate propagation of permanent ones.
0
likes
160
points
--
downloads

Documentation

API reference

Publisher

unverified uploader

Weekly Downloads

Provider-agnostic hybrid routing for Genkit — combine on-device and cloud models behind one routing policy.

Homepage
Repository (GitHub)
View/report issues

Topics

#genkit #llm #ai #on-device #routing

License

MIT (license)

Dependencies

genkit

More

Packages that depend on genkit_hybrid