Twitter had the Arab Spring as this odd formative event, where it suddenly became a source of news information. I think it’s really hard to know how Twitter would have developed without that.
More/better atomic distros, like Silverblue, Kinoite, VanillaOS, etc. Silverblue is already excellent, easy to use and extremely solid, but there are still some odd rough edges that I think would make it less appealing to new users. When we can offer newbies a personally unbreakable Linux system that does basically everything they want and more, then I think it'll be easy to recommend. At this point it's hard to imagine going back to a traditionally updated distro.
The next steps for PipeWire, which has improved and streamlined audio (and sometimes video) handling and production immensely. I can imagine a future where we can easily send, audio, video, midi, and all kinds of other data streams between arbitrary programs on Linux, easily routing things with GUI frontends, having connections establish automatically, etc. I don't know how much this stuff is in the works, but I think PipeWire has a ton of potential left to be explored.
it cannot achieve this via rudimentary statistics alone because the model simply does not have enough parameters to memorize which token is more likely to go next in all cases.
True, hence the limitations. That would require infinite storage and infinite compute capability.
Also, going “one token at a time” is only a “limitation” because LLMs are not accurate enough.
No, it’s done because one letter at a time is too slow. Tokens are a “happy” medium tradeoff.
The space token effectively just makes it reflect on the conversation.
It makes a “break” of the block, which lets it start a new answer instead of continuing on the previous. How it reacts to that depends on the fine tune and filters before the data hits the LLM.
To be clear, I do not believe LLMs are the future.
I have just said that LLM’s we have today can’t fix the problems with false data and hallucinations, because it’s a core principle of how it operates. It will require a new approach.
You could add a rocket engine and wings to a pogo stick, but then it’s no longer a pogo stick but an airplane with a weird landing gear. Today’s LLM’s could give us hints to how to make a better AI, but that would be a different thing than today’s LLM’s. From what has been leaked from OpenAI GPT4 has scaling issues so they use mixture of experts. Just throwing hardware at it is already showing diminishing returns. And we’re learning fascinating new ways of training them, but the inherent problem is the same.
For example, if you ask an LLM if it can give an answer to a question, it will have two paths to go down, positive and negative. Note, at the point where it chooses that it doesn’t know how to finish it, it doesn’t look ahead. But it sees for example that 80% of the answers in the texts it’s been trained on starts with a positive, then it will most likely start with “yes” - and when it does that it will continue to generate an answer - often very convincing and plausibly real looking answer, because it already committed to that path.
And as for the link about teaching it backspace token, the comments there are already pointing out the issue:
It’s interesting that in the examples (Table 3 on page 21), the model uses the backspace token to erase the randomly-added token from the prompt, but it does not seem to ever use the token to correct its own output. I’m curious how frequently the model actually uses this backspace token in practice - and if the answer is “vanishingly rarely”, what is the source of the improved Mauve score and sample diversity they show? Is it just that the different training procedure gives an improvement?
For it to use the backspace, wouldn’t it have to predict the wrong token with greater confidence than the corrected token? I would think this would require more examples of a wrong token + correction than the correct token, which seems a bit odd.
Almost none of the text it’s trained on has a backspace token, and to finetune it in is tricky since it’s a completely new concept - and remember it’s still doing token for token - so it would have to write a token and then right after find out that it’s more likely to send a backspace token than to continue it. It’s interesting, and LLM’s can pick up on some crazy patterns, but I’m skeptical.
…with the James Web Telescope looking for sources of artificial light to identify potential intelligent life, and the news this week of Perseverance searching for microbial life on Mars it feels like we are getting closer to a major discovery. But what - if anything - would it mean for the religions on Earth if life is proven...
Won't happen. Well some fringe group might launch someone. In the right direction, but they won't arrive.
However the universe is large and the speed of light very slow: we will never be able to send humans to another alien. In fact the speed of light is so slow, odds are we will never even get to the point where both civilizations are aware of each other - either we know they existed but they are extinct before we discover it, or they discover us long after we go extinct (of course we won't know that).
Realistically there are only a few stars with in range of where we can establish contact. The farther out we get the less useful contact will be just because by the time we get a response we are likely to have figured it out. If we asked an alien 1 light year away (there are no stars that close to earth) about fusion they can tell us what we are doing wrong and jump start us. However by 20 light years out odds are we will know what we did wrong before their response can reach us so we are limited to sending the latest movies back and forth (open question - we will enjoy each others entertainment), and by 100 light years it is just culture interest. Even if they are very long lived, they may be interested in us, but we won't be able to sustain enough interest in them to answer questions - not to mention their questions will be obsolete (an alien 100 light years out would have just had questions about human life in 1823 reach back to us - we don't really know)
An anticyclone – a high-pressure area – named Cerberus (named after the monster from Dante’s Inferno) coming from the south will cause temperatures to rise above 40°C across much of Italy. This comes after a spring and early summer full of storms and floods....
Are they an actual leftist podcast? Not tankies in disguise?
Also looking into it, it's a true crime podcast? Seems an odd name choice if it isn't somewhat related to politics. Unless I've 100% misunderstood the naming convention.
We can see the posts on both platforms (except for the case of de-federation).
Competition is an odd topic for open source software. For example, whilst mastodon, kbin and lemmy are all competing for attention, they are collectively making the activitypub ecosystem more attractive.
A similar thing happens with linux: Oracle, red hat, canonical etc all compete for market share, but pay for developers to work on the wider linux ecosystem (the kernel as well as GNOME and other apps etc)
It depends on the layout of the phone though. Size of camera module, placement of fingerprint sensors, other sensors/modules, heat sinks. You name it, really.
As such the batteries tend to be oddly shaped, and even spread out in different places to get as much battery in as possible.
For those who watched DS9 during its first airings, did it seem odd to you that Vic Fontaine/James Darren sang entire songs in the later seasons of DS9?...
That’s a very modern attitude to TV that stems from series only having ten odd hours to tell a full serialised story. When you’re telling twenty plus episodic stories in the year, you have time to kick back and show stuff that isn’t crucial to the story.
I found it weird when it aired. My recollection of watching it on TV as a teenager was that Vic became a big presence in the show very suddenly (I may be misremembering and it's been a while since I rewatched DS9) and the amount of screen time they devoted to him in late s6 and s7 felt odd.
Ok this is an odd one. If I am on an Iphone running wefwef (now voyager) and i search for (just for example) [email protected] it will find that community. But if I go to my pc and do the same search it will say “Nothing to see here - this feed is completely empty”. the only differences are : on my phone I have the app on...
Is this how most people type on mobile these days, drawing lines all over a keyboard instead of tapping the individual keys? I've never had an iPhone so I don't even know if they can do this natively, but I know you can switch keyboards at least, so it should still be an option if not.
I worry about Google using the keyboard to violate my privacy so i moved to 8vin. It is a really odd keyboard but you get used to it after a few weeks.
It’ll be interesting to see where this goes, but odds are it will be meaningless - the research is sketchy at best for now.
In my mind with the quality of research out there right now, it will boil down to 3 outcomes:
If you used a lot of artificially sweetened products to avoid consuming lots of sugar, and you would go back to using the same amount of sugar otherwise, then keep using the sweetener. Sugar is far more likely to cause damage to you.
If you think you could cut out the aspartame and cut down on sugar, then do that instead.
If you eat a decent amount of red meat, you may as well continue consuming aspartame. Odds are the meat will cause cancer long before the aspartame does.
The trouble is the news can latch on to the IARC plan to classify it as a class 2B carcinogen (“possibly carcinogenic”). The problem is, the IARC classification is kinda trash for an end user, since it only classifies the quality of the research available. Meat is a class 1 (“known carcinogen”), but so is asbestos and sunlight and alcohol. No one would argue that those are equivalent. Similarly, coffee, pickles and petrol are also 2B classifications. It’s easy for the news to run with “aspartame has been identified as possibly carcinogenic” and be completely correct while also entirely misleading.
Diet Dew instead of coke, but otherwise spot on. I've done enough stupid shit that if fake sugar is what kills me, I've still managed to deny a few odds.
Regardless of whether I meant it as a doorway into conversation – and that wasn’t an excuse, but a threshold to conversation – if you’re going to pin me on it, I’ll say yes, I think the odds are nearly 100% life exists not just elsewhere, but everywhere.
I personally think that’s the inevitable conclusion of 3-dimensional space. That’s just my personal opinion, though.
Call me a hack if you like.
(e: removed unnecessary snark.)
As a college chem professor, the reason for this is nearly always cheating.
“Hmm, you got the right answer with the wrong method, and your friend that you sit next to every day used the right method and got the same exact answer as you, down to the rounding? Haha, what are the odds??!?”
But… you don’t consider T-Mobile, Apple, Intel, or Microsoft to be American state-sponsored companies despite their hundreds of billions in subsidies and tax incentives?
Odd.
The recent CHIPS act gave Intel what, like $20 billion in subsidies. Guess what? That’s what governments do to stimulate economic growth.
In which game did you spend the most hours?
cross-posted from: feddit.de/post/1586067...
deleted_by_author
What developments in the Linux world are you looking forward to the most?
Personally, I’m looking forward to native Wayland support for Wine and KDE’s port to Qt 6.
Why AI detectors think the US Constitution was written by AI (arstechnica.com)
If intelligent life is found in the universe will it change religion(s)?
…with the James Web Telescope looking for sources of artificial light to identify potential intelligent life, and the news this week of Perseverance searching for microbial life on Mars it feels like we are getting closer to a major discovery. But what - if anything - would it mean for the religions on Earth if life is proven...
ESA: Europe braces for sweltering July (www.esa.int)
An anticyclone – a high-pressure area – named Cerberus (named after the monster from Dante’s Inferno) coming from the south will cause temperatures to rise above 40°C across much of Italy. This comes after a spring and early summer full of storms and floods....
The 11-mile long, 600 lbs IMAX print of ‘OPPENHEIMER’ (i.imgur.com)
What is the difference between Lemmy and kbin?
I’m not sure I completely understand the differences. Are they seperate or somehow connected?...
It's official: Smartphones will need to have replaceable batteries by 2027 (www.androidauthority.com)
TL;DR...
Why did Vic Fontaine sang entire songs in the later seasons of DS9?
For those who watched DS9 during its first airings, did it seem odd to you that Vic Fontaine/James Darren sang entire songs in the later seasons of DS9?...
Help with backup solution
So, this is a rather odd request of a backup solution, but it’s kinda what I want right now....
searching for other communites on other instances works on mobile not on pc
Ok this is an odd one. If I am on an Iphone running wefwef (now voyager) and i search for (just for example) [email protected] it will find that community. But if I go to my pc and do the same search it will say “Nothing to see here - this feed is completely empty”. the only differences are : on my phone I have the app on...
Reddit is replacing / modifying the Reddit gold feature, what are your thoughts ? (www.theverge.com)
Do you use the swipe to type feature on your phone?
Is this how most people type on mobile these days, drawing lines all over a keyboard instead of tapping the individual keys? I've never had an iPhone so I don't even know if they can do this natively, but I know you can switch keyboards at least, so it should still be an option if not.
'Get used to a less sweet diet' - expert on aspartame (video) (www.youtube.com)
New research puts age of universe at 26.7 billion years, nearly twice as old as previously believed (phys.org)
Brute Force Solving (lemmy.world)
Pocket Casts Plus increases subscription pricing to $33.99 from $10 (feddit.nl)
cross-posted from: lemdro.id/post/66697
Instance Assistant for Lemmy & Kbin v1.2.0 is now available on Chrome & Firefox!
cross-posted from: lemmy.ca/post/1418762...
Remote Work to Wipe Out $800 Billion From Office Values, McKinsey Says (www.bloomberg.com)
archive.is/QmvwU
China raises five demands during Yellen’s visit (asiatimes.com)