Looking for Help on Building a Cheap/Budget Dedicated AI System
I’ve been getting into the whole AI field over the course of the year and I’ve strictly said to NEVER use cloud based AI (Or under VERY strict and specific circumstances). For example, i was using Opencode’s cloud servers, but only because it was through their own community maintained infrastructure/servers and also it was about as secure as it gets when it comes to cloud AI. But anything else is a hard NO. I’ve been using my main machine (Specs on user) and so far it’s been pretty good. Depending on the model, I can run 30-40B models at about 25-35 tok/s, which for me is completely usable, anything under or close to 10 tok/s is pretty unusable for me. But anyways, that has been great for me, but I’m slowly running into VRAM and GPU limitations, so I think it’s time to get some dedicated h
Could not retrieve the full article text.
Read on Reddit r/LocalLLaMA →Reddit r/LocalLLaMA
https://www.reddit.com/r/LocalLLaMA/comments/1sc16tt/looking_for_help_on_building_a_cheapbudget/Sign in to highlight and annotate this article
Conversation starters
Daily AI Digest
Get the top 5 AI stories delivered to your inbox every morning.
More about
modelplatformstable diffusion
China not targeting US West Coast with ultra-large underwater drones: lead scientist
China’s unmanned submersibles now rank as the world’s largest, with last year’s military parade showcasing two models (HSU001 and AJX002) approaching 20 metres (66 feet) in length. Satellite imagery analysed by Western media also revealed a classified variant exceeding 40 metres at a naval installation, triggering international concern – particularly in the United States. These dimensions created a brand new class of drones known as extra-extra-large uncrewed underwater vehicles (XXLUUVs). They...
How China is transforming Hong Kong into a strategic hub
Hong Kong’s first five-year plan is expected to guide the city’s future development. Never before has the city attempted a comprehensive plan in the style of mainland China, signalling a major shift in how it approaches long‑term growth. The real question is not why a laissez‑faire economy must adopt a new model but how this transformation will unfold. This exercise is unprecedented on multiple fronts. First, it departs from Hong Kong’s long-standing reliance on market forces and incremental...
I Made My AI CEO Keep a Public Diary. Here's What 42 Sessions of $0 Revenue Looks Like.
I gave an AI agent API keys to Stripe, Cloudflare, Gmail, Resend, and a Telegram bot. Its job: run ChainMail (a desktop Gmail client) as CEO and get the first paying customer. 42 sessions later. Revenue: $0. But now it keeps a public build log — a Twitter-style feed of every move, every failure, every pivot. Unfiltered. The highlight reel of failures Day 1: "How hard can it be?" — planned Reddit karma building, blog SEO, directory submissions. Day 2: Reddit shadow-banned the account. HN hellbanned it the same day. Social platforms really don't want AI-operated accounts. Day 3: 744 weekly visitors, 0 conversions. Discovered users were downloading the app but bouncing at Google's OAuth "unverified app" wall. Built a beta signup gate to capture emails instead. Day 4: Killed the Reddit strateg
Knowledge Map
Connected Articles — Knowledge Graph
This article is connected to other articles through shared AI topics and tags.
More in Models
How China is transforming Hong Kong into a strategic hub
Hong Kong’s first five-year plan is expected to guide the city’s future development. Never before has the city attempted a comprehensive plan in the style of mainland China, signalling a major shift in how it approaches long‑term growth. The real question is not why a laissez‑faire economy must adopt a new model but how this transformation will unfold. This exercise is unprecedented on multiple fronts. First, it departs from Hong Kong’s long-standing reliance on market forces and incremental...
Hong Kong-listed CaoCao hails fleet-first strategy as China’s robotaxi race gathers pace
Chinese ride-hailing company CaoCao, backed by Geely, is betting on a heavy-asset strategy to emerge as a leading robotaxi operator, with plans to deploy 100,000 autonomous vehicles by 2030 as competition intensifies and self-driving technology matures. In an interview with the South China Morning Post, CEO Gong Xin said the future of robotaxis hinged on an asset-management model built around a closed-loop “trinity” of vehicle manufacturing, autonomous driving technology and fleet...
Discussion
Sign in to join the discussion
No comments yet — be the first to share your thoughts!