The right hardware depends on what your team will ask it to do. A named-user licence is not a promise of that many simultaneous AI generations, and a product-page specification cannot replace a test using your document types and expected usage.
Describe the workload before choosing hardware
- How many people need accounts, and how many are likely to query at the same time?
- How many documents and pages do you expect to index, and how quickly will that library grow?
- What share of the library is scanned or image-based and needs OCR?
- Which file types, tables, languages, and page layouts are common in your real workflow?
- Must the box remain offline after setup, and are remote model endpoints prohibited by policy?
- What answer latency and indexing delay are acceptable to the people using it?
Run a representative pilot
Use a non-sensitive test set that resembles production: ordinary PDFs, the hardest scans you expect, and questions with known answers. Measure upload-to-index completion, time until the first answer token, total answer time, and behavior while several users query together. Repeat after the device has been working long enough to reveal sustained thermal or memory issues.
The published appliance configuration is Raspberry Pi 5 class. The setup guide recommends active cooling and a reliable power supply. The repository has some x86_64 installation support, but that alone does not establish a validated or commercially supported x86 product; no NPU configuration should be assumed available without confirmation.
When to request a workload review
If you expect a large OCR-heavy archive, sustained concurrent queries, strict air-gap controls, or a need for a different hardware platform, share the workload profile before ordering. We can discuss fit and possible configurations without promising unmeasured performance.
- Team size and expected simultaneous users
- Approximate document count, page count, and storage growth
- Scanned-document proportion and OCR requirements
- Offline/network restrictions and required integrations