QuadratureSurfer

QuadratureSurfer , 6 months ago to technology in Someone made a GPT-like chatbot that runs locally on Raspberry Pi, and you can too

I’ve got it running with a 3090 and 32GB of RAM.

There are some models that let you run with hybrid system RAM and VRAM (it will just be slower than running it exclusively with VRAM).

QuadratureSurfer , 6 months ago to technology in Court blocks $1 billion copyright ruling that punished ISP for its users’ piracy

No analogy is ever going to be perfect when you try to look into the details too much… that’s why it’s an analogy.

QuadratureSurfer , 6 months ago to technology in Someone made a GPT-like chatbot that runs locally on Raspberry Pi, and you can too

Direct link to the GitHub repo:
github.com/nickbild/local_llm_assistant?tab=readm…

It’s a small model by comparison. If you want something that’s offline and actually closer to comparing to ChatGPT 3.5, you’ll want the Mixtral 8x7B model instead (running on a beefy machine):

mistral.ai/news/mixtral-of-experts/

QuadratureSurfer , 6 months ago to technology in This tiny, tamper-proof ID tag can authenticate almost anything

You’d have to read the article to know what they’re getting at.

The use case provided was for businesses like a car wash that puts a sticker on a car windshield. The ML model would be able to detect if the customer attempted to transfer the sticker from one car to another.

A pretrained ML model to detect this is actually a very good use case.

However, I think the implimentation of this as an “anti-tampering detector” is a dangerous route to tread since there are other factors that need to be considered.

QuadratureSurfer , 6 months ago to technology in This tiny, tamper-proof ID tag can authenticate almost anything

To clarify what OP meant by his ‘AI’ statement

The system uses AI to compare glue patterns […]

The researchers noticed that if someone attempted to remove a tag from a product, it would slightly alter the glue with metal particles making the original signature slightly different. To counter this they trained a model:

The researchers produced a light-powered antitampering tag that is about 4 square millimeters in size. They also demonstrated a machine-learning model that helps detect tampering by identifying similar glue pattern fingerprints with more than 99 percent accuracy.

It’s a good use case for an ML model.

In my opinion, this should only be used for continuing to detect the product itself.
The danger that I can see with this product would be a decision made by management thinking that they can rely on this to detect tampering without considering other factors.

The use case provided in the article was for something like a car wash sticker placed on a customers car.

If the customer tried to peel it off and reattach it to a different car, the business could detect that as tampering.

However, in my opinion, there are a number of other reasons where this model could falsely accuse someone of tampering:

• Temperature swings. A hot day could warp the glue/sticker slightly which would cause the antitampering device to go off the next time it’s scanned.
• Having to get the windshield replaced because of damage/cracks. The customer would transfer the sticker and unknowingly void the sticker.
• Kids, just don’t underestimate them.

In the end, most management won’t really understand this device well beyond statements like, “You can detect tampering with more than 99 percent accuracy!” And, unless they inform the customers of how the anti-tampering works, Customers won’t understand why they’re being accused of tampering with the sticker.

QuadratureSurfer , 6 months ago to technology in Are there any genuine benefits to AI?

“AI” is the broadest umbrella term for any of these tools. That’s why I pointed out that OP really should be a bit more specific as to what they mean with their question.

AI doesn’t have the same meaning that it had over 10 years ago when we used to use it exclusively for machines that could think for themselves.

QuadratureSurfer , 6 months ago to technology in More 128TB SSDs are coming as almost no one noticed this launch — another SSD controller that can support up to 128TB appeared paving the way for HDD-beating capacities

Are we including magnetic tape?

Looks like they hit 580 TB a few years ago: pcmag.com/…/fujifilm-and-ibm-set-world-record-wit…

QuadratureSurfer , 6 months ago to technology in Are there any genuine benefits to AI?

AI is a very broad topic. Unless you only want to talk about Large Language Models (like ChatGPT) or AI Image Generators (Midjourney) there are a lot of uses for AI that you seem to not be considering.

It’s great for upscaling old videos: (this would fall under image generating AI since it can be used for colorizing, improving details, and adding in additional frames) so that you end up with something like: www.youtube.com/watch?v=hZ1OgQL9_Cw

It’s useful for scanning an image for text and being able to copy it out (OCR).

It’s excellent if you’re deaf, or sitting in a lobby with a muted live broadcast and want to see what is being said with closed captions (Speech to Text).

Flying your own drone with object detection/avoidance.

There’s a lot more, but basically, it’s great at taking mundane tasks where you’re stuck doing the same (or similar) thing over, and over, and over again, and automating it.

QuadratureSurfer , 6 months ago to technology in Toyota cars collecting and potentially sharing location data and personal information, Choice says, and it's not the only car brand facing privacy concerns

Then they won’t get your messages are any other information specific to your device.

But cars don’t need that connection to phone home with all of the data that the car itself is picking up on. Cars today all have some sort of cheap connection so that they can pass on your data one way or another.

QuadratureSurfer , 6 months ago to technology in Toyota cars collecting and potentially sharing location data and personal information, Choice says, and it's not the only car brand facing privacy concerns

Not just phone numbers and email addresses, but a recent ruling by a federal judge allows them to record and collect text messages without worry:

theverge.com/…/automakers-collect-record-text-mes…

QuadratureSurfer , 6 months ago to technology in Reddit beats film industry again, won’t have to reveal pirates’ IP addresses

Yes? But as the person you are responding to has mentioned, they’re not after the individuals, they’re after the “ISPs who did nothing in response to piracy complaints.”

Having the IP address of those users will reveal which ISP they are using.

Just run a traceroute or tracert command against any website and you can see for yourself how your connection initially goes through your ISP before branching out to the rest of the internet.

QuadratureSurfer , 6 months ago to technology in Canada to ban the Flipper Zero to stop surge in car thefts

So many reposts in this community…

QuadratureSurfer , 6 months ago to technology in Clean energy could be 'closer than ever' after a nuclear fusion machine smashed a record

Someone please correct me if I’m wrong, but isn’t the problem that Uranium has a half-life of a couple hundred million years, while the half life of beryllium is less than a second?

Only Beryllium-10 has a long half-life for beta decay. Adding another neutron drops that back down to a few seconds and additional neutrons drop it back to a fraction of a second. So as long as that specific type of Beryllium isn’t used, it would be fine, right?

Edit: www.thoughtco.com/beryllium-isotopes-603868

QuadratureSurfer , 6 months ago to technology in Midjourney might ban Biden and Trump images this election season

Well, AI spaghetti videos certainly have come a long way: v.redd.it/hz89h0ikv7gc1

QuadratureSurfer , 6 months ago to technology in OpenAI's GPT Trademark Request Has Been Denied

You can run it locally with an RTX 3090 or less (as long as you have enough RAM), but there’s a bit of a tradeoff in speed when using more system RAM vs VRAM.