Google launches Gemma 4 open models with 140 languages, 400M downloads - geo.tv
Google launches Gemma 4 open models with 140 languages, 400M downloads geo.tv
Could not retrieve the full article text.
Read on Google News: DeepMind →Sign in to highlight and annotate this article
Conversation starters
Daily AI Digest
Get the top 5 AI stories delivered to your inbox every morning.
Knowledge Map
Connected Articles — Knowledge Graph
This article is connected to other articles through shared AI topics and tags.
More in Models
![[D] Hash table aspects of ReLU neural networks](https://d2xsxph8kpxj0f.cloudfront.net/310419663032563854/konzwo8nGf8Z4uZsMefwMr/default-img-earth-satellite-QfbitDhCB2KjTsjtXRYcf9.webp)
[D] Hash table aspects of ReLU neural networks
If you collect the ReLU decisions into a diagonal matrix with 0 or 1 entries then a ReLU layer is DWx, where W is the weight matrix and x the input. What then is Wₙ₊₁Dₙ where Wₙ₊₁ is the matrix of weights for the next layer? It can be seen as a (locality sensitive) hash table lookup of a linear mapping (effective matrix). It can also be seen as an associative memory in itself with Dₙ as the key. There is a discussion here: https://discourse.numenta.org/t/gated-linear-associative-memory/12300 The viewpoints are not fully integrated yet and there are notation problems. Nevertheless the concepts are very simple and you could hope that people can follow along without difficulty, despite the arguments being in such a preliminary state. submitted by /u/oatmealcraving [link] [comments]
Discussion
Sign in to join the discussion
No comments yet — be the first to share your thoughts!