Meta’s AI system Llama approved for use by US government - The Independent
<a href="https://news.google.com/rss/articles/CBMiigFBVV95cUxObE1kSFFKSE94ckZ3dHlhYVJJNWFNMDl2V2dieGdYVmFWQ3hwTXZEVnVBYmdJWHVrRF9rbGFUVDczWnVuY01MNExHRXlWbmFDYjFRY3FNZDhmMTJWdVU5dDE0RHJJUmdMT0Q3WTMzSXlSVEdNc0xGOHQzbENlcXJZbmk2RjhSdks1Wmc?oc=5" target="_blank">Meta’s AI system Llama approved for use by US government</a> <font color="#6f6f6f">The Independent</font>
Could not retrieve the full article text.
Read on GNews AI Llama →Sign in to highlight and annotate this article
Conversation starters
Daily AI Digest
Get the top 5 AI stories delivered to your inbox every morning.
More about
llamagovernment
Vulkan backend much easier on the CPU and GPU memory than CUDA.
On linux and compiled my own llama.cpp with CUDA support, top would always show one pegged CPU core at 100% when running Qwen3.5-9B-GGUF:Q4_K_M on my potato like RTX A2000 12GB. Also, nvidia-smi would show 11GB+ of GPU memory usage. Speed is ~30 tokens per second. My system fans would spin up when this single core gets pegged which was annoying to listen to. Decided to compile llama.cpp again with Vulkan backend to see if anything would be different. Well it was a big difference when using the exact same model Now, top is only showing one CPU core at about 30% usage and nvidia-smi is only showing 7.2GB of GPU memory usage. Speed is the same at ~30 tokens per second. No longer have my system fan spinning up when running inferencing. Just curious why the GPU memory footprint is lower and CPU
I have always seen myself as ‘progressive’ – but with AI it’s time to hit the brakes | Peter Lewis
At a time when the populist right is on the rise, progressives are shooting blanks while history rushes headlong into an automated future Canberra rolled out the red carpet this week to one of the AI overlords whose technology is driving the world down the path of creative destruction. Anthropic’s CEO Dario Amodei, the putative “good” tech oligarch, was spinning his version of a machine-driven future with the elan of a man who has untangled the mysteries of the universe – or at least built a predictive text model that can scrape the output of humanity and spit out compelling summaries of our collective consciousness. He regaled the prime minister, assorted elected officials and the tech sector’s glitterati with his pitch for good AI that would transform the economy, before becoming the fir
Knowledge Map
Connected Articles — Knowledge Graph
This article is connected to other articles through shared AI topics and tags.
Discussion
Sign in to join the discussion
No comments yet — be the first to share your thoughts!