Recipes/🤖 AI & ML/Inference Engine
🤖

Inference Engine

intermediate

ONNX model inference

ONNX model cikarimi

Estimated Time
⏱️ 1-2 months
Essential Crates
📦 1

Tags

inferenceonnxmlproduction

Required Crates

⭐ Essential

ort
ONNX Runtime

ONNX Runtime

crates.io →
ort = "2"

○ Optional

tract-onnx
Pure Rust ONNX

Saf Rust ONNX

crates.io →
tract-onnx = "0.21"

Starter Template

Copy this Cargo.toml to get started:

[package]
name = "my-inference-engine"
version = "0.1.0"
edition = "2021"

[dependencies]
ort = "2"
tract-onnx = "0.21"
thiserror = "1"
tracing = "0.1"

Related Patterns

Learn these patterns to build this project effectively:

🔗 stream-processing

Other AI & ML Projects

Tensor Library
advanced

N-dimensional array operations

Neural Network
advanced

Deep learning framework

Vector Database
advanced

Similarity search with embeddings

Embeddings
intermediate

Text and image embeddings