Run Ollama on Jetson Orin Nano: Build a Local AI Server on Turing Pi 2.5

Blog

Run Ollama on Jetson Orin Nano: Build a Local AI Server on Turing Pi 2.5

The previous guide, Preparing NVIDIA Jetson as an AI Node on Turing Pi 2.5, established the operational foundation for a long-running accelerated node. Docker can access the GPU, models and application data have predictable locations on the NVMe, the Jetson has a stable network identity, and basic logging and health checks are in place. This […]

Preparing NVIDIA Jetson as an AI Node on Turing Pi 2.5

A working Jetson installation is not automatically a maintainable AI server. In our complete setup guide, we installed an 8GB NVIDIA Jetson Orin Nano on Turing Pi 2.5, flashed Jetson Linux to a 500GB NVMe drive, connected over Ethernet and SSH, and verified JetPack and CUDA. We then covered the Jetson modules supported by Turing […]

Local AI on Turing Pi with NVIDIA Jetson: When Edge AI Makes Sense

Cloud AI made powerful models easy to access. Send a request to an API, wait for a response, and someone else’s infrastructure handles the compute. That model works well, but it is not the right architecture for every workload. Private documents, camera streams, microphone audio, local automation, repeated inference, unreliable connectivity, and latency-sensitive systems can […]

NVIDIA Jetson on Turing Pi 2.5: Supported Modules and What You Can Build

In NVIDIA Jetson Orin Nano Super on Turing Pi 2.5: Complete Setup Guide, we moved an 8GB Jetson Orin Nano module from NVIDIA’s developer kit to Turing Pi 2.5, flashed Jetson Linux directly through the board, booted from NVMe, connected over Ethernet and SSH, and verified JetPack and CUDA. Once that node is running, the […]

NVIDIA Jetson Orin Nano Super on Turing Pi 2.5: Complete Setup Guide

If you already have a Jetson Orin Nano Developer Kit, have a spare Jetson module sitting around, or are buying a standalone module that needs a board to run on, Turing Pi 2.5 gives it a very different home from NVIDIA’s usual developer-kit carrier. The Jetson can be installed directly as one of the Turing […]

RK3588 Architecture Deep Dive: CPU, GPU, NPU and Memory Explained

The RK3588 is often introduced as a list of specifications: eight CPU cores, a Mali-G610 GPU, a 6 TOPS NPU, 8K-class video support, and high-speed I/O. Those specifications are useful, but they do not explain how the chip behaves under real workloads. An application does not simply “run on the RK3588.” Latency-sensitive work may run […]

Self-Hosted CI on Turing Pi: Gitea Actions with an ARM64 Runner

Once your code is already living in Gitea, the next repetitive step is usually obvious: every push still depends on someone remembering to run the tests, build the project, and check that nothing broke. That works for a personal repository until it does not. A small change skips a local test. A pull request builds […]

Vaultwarden on Turing Pi: Self-Hosting a Bitwarden-Compatible Password Manager on ARM64

Passwords are among the most sensitive services you can move into a homelab. A password manager must remain available, synchronize reliably across devices, use HTTPS correctly, and have backups that can actually be restored. Vaultwarden provides a lightweight, unofficial implementation of the Bitwarden client API. It works with the official Bitwarden browser extensions, mobile apps, […]

Running LFM2.5-2.6B Locally on RK3588 with llama.cpp: Turing Pi RK1 Setup and Benchmark

Small language models are reaching the point where running one locally on an ARM board no longer feels like a proof of concept. Liquid AI’s LFM2.5-2.6B is built for efficient on-device inference, and the official GGUF release means it can run directly through llama.cpp without a separate model-conversion workflow. In this guide, we run the […]

Sign in
Sign up
Already have an account? Sign in
Password Reset
Enter the email address you used when you joined and we’ll send you instructions to reset your password.