ciflow/torchtitan/178947: Update on "add API to check if a tensor is symm-mem-tensor"
<p>In Helion autotuner, we need clone a input symm memory tensor properly if the kernel inplace update it. That requires us to know if a tensor is a symm memory tensor. Right now I call rendezvous for the tensor. If no exception is thrown, then it's a symm memory tensor. But it's not ideal</p> <ol> <li>there will be a lot of warnings complaining calling rendezvous on non-symm memory tensor</li> <li>I'll need to pass in the process group name to this API. But fundamentally check if a tensor is a symmetric memory tensor does not require the process group name.</li> </ol> <p>[ghstack-poisoned]</p>
In Helion autotuner, we need clone a input symm memory tensor properly if the kernel inplace update it. That requires us to know if a tensor is a symm memory tensor. Right now I call rendezvous for the tensor. If no exception is thrown, then it's a symm memory tensor. But it's not ideal
- there will be a lot of warnings complaining calling rendezvous on non-symm memory tensor
- I'll need to pass in the process group name to this API. But fundamentally check if a tensor is a symmetric memory tensor does not require the process group name.
[ghstack-poisoned]`
Assets 2
Sign in to highlight and annotate this article
Conversation starters
Daily AI Digest
Get the top 5 AI stories delivered to your inbox every morning.
More about
update
OpenAI is now bringing in $2 billion a month — and 3 more highlights from its latest update - MarketWatch
<a href="https://news.google.com/rss/articles/CBMi0ANBVV95cUxPV3VhZjlUcVZqSkw2RTFISVZ0Z25MX1Q3Tmh3OFFucUF4eDVxUHpLZVA4aGg0amttazZSYk5hWFNYVlJqOElrR1l0ejgweVJZMVdFTWlEQzhpMWFHR0FSTDFvdUFnTEVYRE1XdEE0T3pQeGc4WXVleERTbEFUQkFrQWNfSjlUS3RqTlNRbEVlWHZrN3laMlFMZDAwV210eEMwY3FfWjktWWRJdElSazB4NEJwVzZjNVhCRExBTFhhdVF4NmE5d1JwWDFSekRmTGdXRFUwNElHenlDcTZmOEdDUzhlcWpsUnZ2LXlmVXlpYmZkQ2pRRUtWdk84ZDBkWks4NVkxM0ZZZXl3QjR6ajRtZVFHMlBad1NpWWo2ZXExeHA2N3g1bUJkeFpERld2ZGM5WXlfZGxQY1RORTJod3F1eUNOZnFXNVdud2VwV29QaGJkcW1ObG1aSklfc245M0hVendXYjhWN2szNzBlTnEyS3Z2VnVCcEZ4a1JVZ2xpbElVTUZQNjZiU0g0SjBNdFVpWkRFS3U3ZXYyRDJsTllHWjZmU2xoYlRrLTNTR2tKN2xQRHFmRlA3ejhubzJQV2ljSGFDaml6VzduX2FyMjdJYw?oc=5" target="_blank">OpenAI is now bringing in $2 billion a month — and 3 more highlights from its latest update</a> <font col
Hershey applies AI across its supply chain operations
Artificial intelligence is moving beyond software and further into the physical side of business. Companies in food production and logistics are starting to use data systems to support day-to-day decisions, not long-term planning. That change is visible in The Hershey Company’s latest strategy update. At its Investor Day, the company said it plans to use […] The post Hershey applies AI across its supply chain operations appeared first on AI News .
OpenAI is now bringing in $2 billion a month — and 3 more highlights from its latest update - MarketWatch
<a href="https://news.google.com/rss/articles/CBMi0ANBVV95cUxQQ0hDc3dVUFZDTzBWOEtpa2IwcVRlRFVibXZjUHhBUnFLQ3JXRXdTOWgzSHNyUzlvQUVJRXFBMHNnMmg5dmRKN0dsdTlpNHZzUkhCWXpVU0RPY0xsekNYR0JQSXF0NFdPUTg2azlCNDZfc2pWRndIMHA5Uk5RMjEtNlhjb1lPN3lXc19jTUVDRXpKR24zeUhyRmtpdHV1dTFheV93ajBiMmx2ZDI5WnVTRS1lUHFfZjZRU2ktdkhka2l0dVZaR0ZUQUJTUHBrRXdXejVyUnBaR2NEcTliTDNrVzNiSVo3RU5DUldfNnRaYnZ6cnp2QzY2cUlmSXJlMVdvYk9pRXZmYjRwX1FjZkViUHU0RWNJX2E1M3ZQY0RpRl9VdlU2dFBHd3FXWWpEY3hVbldFN3V3NlFpWE5wR3FyZXd1emlKVi1tcWRNeUFCNlFCQnRmZVF4SEdYY1QzZkRYRG5aR25ZTmlWZHp6ZWZ4UnhKR3RBVFRFZUszZDc2T3FpNGtrdTRCSzdhT0dxRmxYVEkwVXpCN201cV9SN1YxMW5LbjVlMGdXcmZBaGRCRFZJdTZRc05Ndmo1NEtLZEVTaHA1amEwMm5tS0JLaEF2dw?oc=5" target="_blank">OpenAI is now bringing in $2 billion a month — and 3 more highlights from its latest update</a> <font col
Knowledge Map
Connected Articles — Knowledge Graph
This article is connected to other articles through shared AI topics and tags.
More in Releases
BOE Warns on Escalating Risks From AI, Fallout From Iran War
Financial institutions’ use of artificial intelligence could increase rapidly and become a financial stability threat, the Bank of England warned on Wednesday, as it also called out the potential for AI to trigger shocks in the private credit markets that ricochet more broadly.
Watch the first crewed Artemis mission take flight
Artemis II, the first crewed mission under the Artemis program , is scheduled to launch today, April 1. NASA is opening a two-hour window for its lift off, starting at 6:24 PM Eastern time, at the Kennedy Space Center in Florida. The agency said the forecast for launch day “shows an 80 percent chance of favorable weather conditions” and that, on March 31, its engineers had finished critical health checks on the Space Launch System rocket that the mission will use. On the evening of March 31, the engineers shifted the launch system into its final configuration. In the early hours of April 1, they will activate the ground launch sequencer. You can start watching Artemis II’s launch event at 7:45AM ET when the Artemis team will load propellant into the SLS rocket. Full launch coverage begins
Discussion
Sign in to join the discussion
No comments yet — be the first to share your thoughts!