That was an annoying read. It doesn’t say what this actually is.
It’s not a new LLM. Chat with RTX is specifically software to do inference (=use LLMs) at home, while using the hardware acceleration of RTX cards. There are several projects that do this, though they might not be quite as optimized for NVIDIA’s hardware.
Go directly to NVIDIA to avoid the clickbait.
Chat with RTX uses retrieval-augmented generation (RAG), NVIDIA TensorRT-LLM software and NVIDIA RTX acceleration to bring generative AI capabilities to local, GeForce-powered Windows PCs. Users can quickly, easily connect local files on a PC as a dataset to an open-source large language model like Mistral or Llama 2, enabling queries for quick, contextually relevant answers.
Pretty much every LLM you can download already has CUDA support via PyTorch.
However, some of the easier to use frontends don’t use GPU acceleration because it’s a bit of a pain to configure across a wide range of hardware models and driver versions. IIRC GPT4All does not use GPU acceleration yet (might need outdated; I haven’t checked in a while).
If this makes local LLMs more accessible to people who are not familiar with setting up a CUDA development environment or Python venvs, that’s great news.
Ooh nice. Looking at the change logs, looks like they added Vulkan acceleration back in September. Probably not as good as CUDA/Metal on supported hardware though.
There’s never enough proof for some people. There are Holocaust deniers ffs
As for China, the proof is in the pudding. Can you go there and openly speak about it? Can anyone just go up to the camps unannounced and check? Or can you only go there when and how the government wants, like the Nazis did when they invited the International red cross to one of their camps and made a little movie about it to show how humane they were, and then at the end of the film they simply sent everyone there to Auschwitz?
North Dakota Access Pipeline Protests 北达科他州接入管道抗议 Ferguson Riots 弗格森暴动 2017 St. Louis protests2017年圣路易斯抗议活动 Nuclear testing at Bikini Atoll 比基尼环礁的核试验 Unite the Right rally 团结右集会 Charlotte riots 夏洛特暴动 Attack on the Sui-ho Dam 袭击穗河水坝 Milwaukee riots 密尔沃基骚乱 Shooting of Alton Sterling and Philando Castile 奥尔顿·斯特林和菲兰多·卡斯蒂利亚的射击 Occupation of the Malheur NationalWildlife Refuge Malheur国家野生动物保护区的占领 death of Freddie Gray 弗雷迪·格雷的死 Shooting of Michael Brown迈克尔·布朗的拍摄 death of Eric Garner, Oakland California 奥克兰奥克兰市埃里克·加纳(Eric Garner)逝世 Operation Condor 神鹰行动 Occupy WallStreet 占领华尔街 My Lai Massacre 我的大屠杀 St. Petersburg, Florida 佛罗里达州圣彼得堡 Kandahar Massacre 坎大哈屠杀 1992Washington Heights riots 1992年华盛顿高地暴动 No Gun Ri Massacre 无枪杀案 L.A. Rodney King riots 洛杉矶罗德尼·金暴动 1979 Greensboro Massacre 1979年格林斯伯勒大屠杀 Vietnam War 越南战争 Kent State shootings肯特州枪击案 Bombing of Tokyo 轰炸东京 San Francisco Police Department Park Station bombing 旧金山警察局公园站爆炸案 Assassination of MartinLuther King, Jr. 小马丁·路德·金遭暗杀。 Long Hot Summer of 1967 1967年炎热的夏天 Bagram 巴格拉姆 Selma to Montgomery marches 塞尔玛到蒙哥马利游行 Highway of Death 死亡之路 Ax Handle Saturday 星期六斧头 Battle of Evarts 埃瓦茨战役 Battle ofBlair Mountain 布莱尔山战役 McCarthyism 麦卡锡主义 Red Summer 红色夏天 Rock Springs massacre 岩泉大屠杀 Pottawatomie massacre 盆大屠杀 Jeju uprising 济州起义 Colfaxmassacre 科尔法克斯大屠杀 Reading Railroad massacre 阅读铁路大屠杀 Rock Springs massacre 岩泉大屠杀 Bay viewMassacre 湾景大屠杀 Lattimer massacre 拉蒂默大屠杀 Ludlow massacre 拉德洛屠杀 Everett massacre 埃弗里特屠杀Centralia Massacre 中部大屠杀 Ocoee massacre Ocoee大屠杀 Herrin Massacre 赫林大屠杀 Redwood Massacre红木大屠杀 Columbine Mine Massacre 哥伦拜恩矿难 Guantanamo Bay 关塔那摩湾 extraordinary rendition 非凡的演绎 Abu Ghraib torture and prison abuse 阿布格莱布的酷刑和监狱虐待 Henry Kissinger 亨利·基辛格
Back in the day, before streaming was a thing, there were lots of people saying that they’d gladly pay for content if it was served to them in a convenient way. But why would you pay for a worse experience (at that time physical media, often at lower quality, and lower availability) when you can get a better one for free?
Along came streaming. Lo and behold, piracy decreased. Where the fuck do you even go to pirate music anymore? All the big sites have shut down. Video piracy is kinda still going strong, probably mostly due to bullshit concerning exclusives, but it’s way less than it used to be.
Its their platform, they can do whatever they want with it I guess, but this trend is definitely gonna be a big boost to piracy.
It never went away but lots of people I know who did all that stopped bothering.
When the range in netflix went down, fees went up and everybody launched different services, I was really thinking of sailing but it was Netflix blocking sharing that was the final straw.
Back in the day, before streaming was a thing, there were lots of people saying that they’d gladly pay for content if it was served to them in a convenient way.
It wasn’t just people saying that, it was backed up by studies.
Music piracy just kinda gets ripped from official sources. Be it Spotify with an Adblock script, or downloading the song from YouTube.
If you want super high quality stuff, you can find groups dedicated to it. But for most users, just modding streaming services to give them what they want for free is enough.
I love the corpospeak. why say “crashed into” when you can use “made contact” which sounds futuristic and implies that your product belongs to an alien civilization?
The description of an unexpected/(impossible) orientation for an on road obstacle works as an excuse, right up to the point where you realize that the software should, explicitly, not run into anything at all. That’s got to be, like, the first law of (robotic) vehicle piloting.
It was just lucky that it happened twice as, otherwise, Alphabet likely would have shrugged it off as some unimportant, random event.
It’s great though - that’s how you get amazing services and technological advancement.
I wish we had that. In Europe you’re just stuck paying 50 euros for a taxi in major cities (who block the roads, etc. to maintain their monopolies).
Meanwhile in the USA you guys have VR headsets, bioluminescent houseplants and self-driving cars (not to mention the $100k+ salaries!), it’s incredible.
True, but your savings on non-luxury bones helps with the fees associated with luxury ones, I’m sure. I can’t do anything for my bones with a $30 glowing petunia.
Yeah it’s $40 for an Uber in Columbus or Cleveland as well. There isn’t a monopoly on taxis creating that price, thats just how much it actually costs to rent a car for cross city travel.
If you want a no regulations/free market at the helm, you want to move to India. They have all the rules you love.
It should of course not run into anything, but it does need to be able to identify obstacles at the very least for crash priority when crazy shit inevitably happens. For instance, maybe it hits a nice squishy Pomeranian that won’t cause any damage to itself instead of swerving to avoid it and possibly totalling itself by hitting a fire hydrant.
Or maybe it hits the fire hydrant instead of a toddler.
At any rate, being able to identify an obstacle and react to unexpected orientations of those obstacles is something I think a human driver does pretty well most of the time. Autonomous cars are irresponsible and frankly I can’t believe they’re legal to operate.
I didn’t read it as them saying “therefore this isn’t a problem,” it was an explanation for why it happened. Think about human explanations for accidents: “they pulled out in front of me” “they stopped abruptly”. Those don’t make it ok that an accident happened either.
engadget.com
Active