QuadratureSurfer

QuadratureSurfer , 3 months ago to technology in Neuralink looks to the public to solve a seemingly impossible problem

Sure, but this is just a more visual example of how compression using an ML model can work.

The time you spend reworking the prompt, or tweaking the steps/cfg/etc. is outside of the scope of this example.

And if we’re really talking about creating a good pic it helps to use tools like control net/inpainting/etc… which could still be communicated to the receiving machine, but then you’re starting to lose out on some of the compression by a factor of about 1KB for every additional additional time you need to run the model to get the correct picture.

QuadratureSurfer , 3 months ago to technology in Neuralink looks to the public to solve a seemingly impossible problem

A job interview! (I wish I was joking).

The reward for developing this miraculous leap forward in technology? A job interview, according to Neuralink employee Bliss Chapman. There is no mention of monetary compensation on the web page.

QuadratureSurfer , 3 months ago (edited 3 months ago) to technology in Neuralink looks to the public to solve a seemingly impossible problem

You also have to keep in mind that, the more you compress something, the more processing power you’re going to need.

Whatever compression algorithm that is proposed will also need to be able to handle the data in real-time and at low-power.

But you are correct that compression beyond 200x is absolutely achievable.

A more visual example of compression could be something like one of the Stable Diffusion AI/ML models. The model may only be a few Gigabytes, but you could generate an insane amount of images that go well beyond that initial model size. And as long as someone else is using the same model/input/seed they can also generate the exact same image as someone else. So instead of having to transmit the entire 4k image itself, you just have to tell them the prompt, along with a few variables (the seed, the CFG Scale, the # of steps, etc) and they can generate the entire 4k image on their own machine that looks exactly the same as the one you generated on your machine.

So basically, for only a few bits about a kilobyte, you can get 20+MB worth of data transmitted in this way. The drawback is that you need a powerful computer and a lot of energy to regenerate those images, which brings us back to the problem of making this data conveyed in real-time while using low-power.

Edit:

Tap for some quick napkin mathFor transmitting the information to generate that image, you would need about 1KB to allow for 1k characters in the prompt (if you really even need that),
then about 2 bytes for the height,
2 for the width,
8 bytes for the seed,
less than a byte for the CFG and the Steps (but we’ll just round up to 2 bytes).
Then, you would want something better than just a parity bit for ensuring the message is transmitted correctly, so let’s throw on a 32 or 64 byte hash at the end…
That still only puts us a little over 1KB (1078Bytes)… So for generating a 4k image (.PNG file) we get ~24MB worth of lossless decompression.
That’s 24,000,000 Bytes which gives us roughly a compression of about 20,000x
But of course, that’s still going to take time to decompress as well as a decent spike in power consumption for about 30-60+ seconds (depending on hardware) which is far from anything “real-time”.
Of course you could also be generating 8k images instead of 4k images… I’m not really stressing this idea to it’s full potential by any means.

So in the end you get compression at a factor of more than 20,000x for using a method like this, but it won’t be for low power or anywhere near “real-time”.

QuadratureSurfer , 3 months ago to technology in Neuralink looks to the public to solve a seemingly impossible problem

NAND - one of the 2 you listed, or they give up.

QuadratureSurfer , 3 months ago to technology in Google is losing it

OK, but we’re discussing whether computers are “reliable, predictable, idempotent”. Statements like this about computers are generally made when discussing the internal workings of a computer among developers or at even lower levels among computer engineers and such.

This isn’t something you would say at a higher level for end-users because there are any number of reasons why an application can spit out different outputs even when seemingly given the “same input”.

And while I could point out that Llama.cpp is open source (so you could just go in and test this by forcing the same seed every time…) it doesn’t matter because your statement effectively boils down to something like this:

“I clicked the button (input) for the random number generator and got a different number (output) every time, thus computers are not reliable or predictable!”

If you wanted to make a better argument about computers not always being reliable/predictable, you’re better off pointing at how radiation can flip bits in our electronics (which is one reason why we have implemented checksums and other tools to verify that information hasn’t been altered over time or in transition). Take, for instance, the example of what happened to some voting machines in Belgium in 2003: businessinsider.com/cosmic-rays-harm-computers-sm…

Anyway, thanks if you read this far, I enjoy discussing things like this.

QuadratureSurfer , 3 months ago to technology in Study finds a quarter of all webpages from 2013 to 2023 no longer exist

Shout-out to Archive.org for all the awesome work they do to backup what they can from the internet.

(Especially when some stack overflow answer to a question is just a link to some website that has either changed or no longer exists).

QuadratureSurfer , 3 months ago to technology in CEO of Google Says It Has No Solution for Its AI Providing Wildly Incorrect Information

What I mean is that Journalists feel threatened by it in someway (whether I use the word “potential” here or not is mostly irrelevant).

In the end this is just a theory, but it makes sense to me.

I absolutely agree that management has greatly misunderstood how LLMs should be used. They should be used as a tool, but treated like an intern who’s speaking out loud without citing any sources. All of their statements and work should be double checked.

QuadratureSurfer , 3 months ago to technology in CEO of Google Says It Has No Solution for Its AI Providing Wildly Incorrect Information

Journalists are also in a panic about LLMs, they feel their jobs are threatened by its potential. This is why (in my opinion) we’re seeing a lot of news stories that will focus on any imperfections that can be found in LLMs.

QuadratureSurfer , 3 months ago to technology in Google is losing it

They still are. Giving a generative AI the same input and the same seed results in the same output every time.

QuadratureSurfer , 3 months ago to technology in Google is losing it

Technically, generative AI will always give the same answer when given the same input. But, what happens is a “seed” is mixed in to help randomize things, that way it can give different answers every time even if you ask it the same question.

QuadratureSurfer , 3 months ago to technology in Rabbit Gaslit Me, So I Dug Deeper

Sure, but don’t let that feed into the sentiment that AI = scams. It’s way too broad of a term that covers a ton of different applications (that already work) to be used in that way.

And there are plenty of popular commercial AI products out there that work as well, so trying to say that “pretty much everything that’s commercial AI is a scam” is also inaccurate.

We have:
Suno’s music generation
NVidia’s upscaling
Midjourney’s Image Generation
OpenAI’s ChatGPT
Etc.

So instead of trying to tear down everything and anything “AI”, we should probably just point out that startups using a lot of buzzwords (like “AI”) should be treated with a healthy dose of skepticism, until they can prove their product in a live environment.

QuadratureSurfer , 3 months ago to technology in Rabbit Gaslit Me, So I Dug Deeper

If you think that “pretty much everything AI is a scam”, then you’re either setting your expectations way too high, or you’re only looking at startups trying to get the attention of investors.

There are plenty of AI models out there today that are open source and can be used for a number of purposes: Generating images (stable diffusion), transcribing audio (whisper), audio generation, object detection, upscaling, downscaling, etc.

Part of the problem might be with how you define AI… It’s way more broad of a term than what I think you’re trying to convey.

QuadratureSurfer , 3 months ago to pcgaming in King under the Mountain (Mountaincore) went open source as developer shuts down

I wish more companies would do something like this, rather than just shutting everything down and leaving everyone with nothing.

QuadratureSurfer , 3 months ago to technology in New Windows AI feature records everything you’ve done on your PC

Very true… what I meant to say was:
[…] then this means our data shouldn’t need to leave the device at all […]

QuadratureSurfer , 3 months ago (edited 3 months ago) to gaming in Crazy rumour suggests Microsoft are preparing $16 billion offer for Valve

Well… good thing I’ve been buying what I can through GOG… but this is terrible news, especially with the way Microsoft has been shutting down gaming studios recently.

Edit: meh, this just sounds like clickbait:

• The leak comes from an unknown and unreliable source in the gaming industry.
• Microsoft’s acquisition of Activision Blizzard faced regulatory challenges, making the merger with Valve unlikely.