Sybyr Systems is offering baseline stand-alone Knowledge Assistants for professional services firms, on your hardware or ours (NVIDIA GeForce RTX 50 Series Desktop PCs and Laptops).
Minimum system requirements (our baseline desktop PC system):
HARDWARE:
NVIDIA GeForce RTX 50 Series Desktop PCs and Laptops*
Liquid-cooled 14th Gen Intel Processors:
Intel i7 or i9 CPU
NVidia RTX5050 Graphics Card by Gigabyte or MSI with 8gb VRAM
64GB Crucial or other DDR4 RAM
1000W Power Supply (recommended)
Crucial or other 1TB NVMe SSD
Peripherals are TBD (monitor, keyboard, mouse/trackball)
Desktop PCs and Laptops (see TUXEDO and Framework notebooks)
Ubuntu 20.04 Operating System (selected for stability):
Ollama Inference Engine
NVidia Graphics drivers
NVidia CUDA toolkit
Opensource (free) Large Language Models:
Available Open-source LLMs and LRMs*:
NAME
SIZE
NAME
SIZE
qwen2.5vl:72b
48 GB
qwen2.5vl:32b
21 GB
qwen2.5vl:7b
6.0 GB
gpt-oss:120b
65 GB
gpt-oss:20b
13 GB
gpt-oss:latest
13 GB
granite4:1b
3.3 GB
granite4:latest
2.1 GB
nawalkhan/legal-llm:latest
4.8 GB
initium/law_model:Q8_0
7.7 GB
dolphin-llama3:70b
39 GB
dolphin-llama3:8b-256k
4.7 GB
dolphin-llama3:8b
4.7 GB
smurugadass/llm:latest
32 GB
gemma3:latest
3.3 GB
llama3.2:latest
2.0 GB
deepseek-r1:latest
5.2 GB
mixtral:8x7b
26 GB
granite3.3:latest
4.9 GB
LLaVA:latest
4.7 GB
mistral:7b-instruct
4.4 GB
llama4:Maverick
244 GB
llama3:70b-instruct
39 GB
llama3.1:8b
4.9 GB
mistral:7b
4.4 GB
* Some models will not run on a baseline system (e.g. the llama4:Maverick model in particular). Users are responsible for complying with applicable open source licenses.