Recipes/πŸ€– AI & ML/Inference Engine
πŸ€–

Inference Engine

intermediate

ONNX model inference

ONNX model Γ§Δ±karΔ±mΔ±

Estimated Time
⏱️ 1-2 months
Essential Crates
πŸ“¦ 1

Tags

inferenceonnxmlproduction

Required Crates

⭐ Essential

ort
ONNX Runtime

ONNX Runtime

crates.io β†’
ort = "2"

β—‹ Optional

tract-onnx
Pure Rust ONNX

Saf Rust ONNX

crates.io β†’
tract-onnx = "0.21"

Starter Template

Copy this Cargo.toml to get started:

[package]
name = "my-inference-engine"
version = "0.1.0"
edition = "2021"

[dependencies]
ort = "2"
tract-onnx = "0.21"
thiserror = "1"
tracing = "0.1"

Related Patterns

Learn these patterns to build this project effectively:

πŸ”— stream-processing

Other AI & ML Projects

Tensor Library
advanced

N-dimensional array operations

Neural Network
advanced

Deep learning framework

Vector Database
advanced

Similarity search with embeddings

Embeddings
intermediate

Text and image embeddings