There have been multiple accounts created with the sole purpose of posting advertisement posts or replies containing unsolicited advertising.

Accounts which solely post advertisements, or persistently post them may be terminated.

slacktoid ,
@slacktoid@lemmy.ml avatar

We need a comparison against an average coder. Some fucking baseline ffs.

hayes_ ,

Why would we compare it against an average coder?

ChatGPT wants to be a coding aid/reference material. A better baseline would be the top rated answer for the question on stackoverflow or whether the answer exists on the first 3 Google search results.

BleatingZombie ,

Or a textbook’s explanation

slacktoid ,
@slacktoid@lemmy.ml avatar

Cause people arent looking at chatgpt as an accurate simple code generator, rather a junior dev.

anachronist ,

“Self driving cars will make the roads safer. They won’t be drunk or tired or make a mistake.”

Self driving cars start killing people.

“Yeah but how do they compare to the average human driver?”

Goal post moving.

slacktoid ,
@slacktoid@lemmy.ml avatar

The issue is the powers that be arent comparing chatgpt to a reference manual. Rather another human being.

slacktoid ,
@slacktoid@lemmy.ml avatar

We need a comparison against an average coder. Some fucking baseline ffs.

jsomae ,

Sure, but by randomly guessing code you’d get 0%. Getting 48% right is actually very impressive for an LLM compared to just a few years ago.

xthexder ,
@xthexder@l.sw0.com avatar

Just useful enough to become incredibly dangerous to anyone who doesn’t know what they’re doing. Isn’t it great?

Emmie , (edited )

It’s pretty fun, interesting times ahead. I wonder what kind of bullshit will take place and can’t wait to see that lol. Future won’t be boring guys that is certain

jsomae ,

Now non-coders can finally wield the foot-gun once reserved only for coders! /s

Truth be told, computer engineering should really be something that one needs a licence to do commercially, just like regular engineering. In this modern era where software can be ruinous to someone’s life just like shoddy engineering, why is it not like this already.

iopq ,

Look, nothing will blow up if I mess up my proxy setup on my machine. I just won’t have internet until I revert my change. Why would that be different if I were getting paid for it?

sajran ,

Setting up proxy is not engineering.

iopq ,

I have to actually modify the code to properly package it for my distro, so it’s engineering because I have to make decisions for how things work

sajran ,

I don’t see how this supports your point then. If “setting up proxy” means “packaging it to run on thousands user machines” then isn’t there obvious and huge potential for a disastrous fuckup?

iopq ,

No, because it either runs the program successfully, or it fails to launch. I don’t mess with the protocol. It runs as root because it needs to set the iptables when turned on to be a “global” proxy

cows_are_underrated ,

Nothing happens if you fuck up your proxy, but if you develop an app that gets very popular and don’t care about safety, so hackers are able to take control over your whole Server they can do a lot of damage. If you develop software for critical infrastructure it can actually cost human lives if you fuck up your security systems.

iopq ,

Yes, but people with master’s degrees also fuck this up, so it’s not like some accreditation system will solve the issue of people making mistakes

cows_are_underrated ,

Yeah, but its probably more likely that the untaught might fuck up some stuff.

iopq ,

Is it, though? A lot of self-taught programmers do great work. I’m not sure this is true

InvaderDJ ,

You can also play with it to try and get closer to correct. I had problems with getting an Excel macro working and getting unattended-updates working on my pihole. GPT was wrong at first, but got me partly there and I could massage the question and Google and get closer to the right answer. Without it, I wouldn’t have been able to get any of it, especially with the macro.

yogthos ,
@yogthos@lemmy.ml avatar

Exactly, I also find that it tends to do a pretty good job pointing you in the right direction. It’s way faster than googling or going through sites like stackoverflow because the answers are contextual. You can ask about a specific thing you want to do, and and an answer that gives you a general idea of what to do. For example, I’ve found it to be great for crafting complex sql queries. I don’t really care if the answer is perfect, as long as it gives me an idea of what I need to do.

sirico ,
@sirico@feddit.uk avatar

It’s programming spell check

Crisps ,

In the short term it really helps productivity, but in the end the reward for working faster is more work. Just doing the hard parts all day is going to burn developers out.

birbs ,

I program for a living and I think of it more as doing the interesting tasks all day, rather than the mundane and repetitive. Chat GPT and GitHub Copilot are great for getting something roughly right that you can tweak to work the way you want.

cows_are_underrated ,

I think we must change the way we see AI. A lot of people see it as the holy grail of everything that can do everything we can do, even tho it can’t. AI is a tool for humans to become more efficient in their work. It can do easy tasks for you and sometimes Assist you with harder stuff. It is the same as with Mathematicians and calculators. A good mathematician is able to calculate everytheverything he needs without a calculator, but the calculator makes him much more efficient at calculating stuff. The calculator didn’t replace mathematicians, because you still have to know how to do the stiff you’re doing.

ulterno ,
@ulterno@lemmy.kde.social avatar

You forgot the “at least” before the 52%.

Samueru ,
@Samueru@lemmy.ml avatar

I find it funny that thumbnail with a “fail” I’m actually surprised that it got 48% right.

Evotech ,

Probably more than 52% of what programmers type is wrong too

habl ,

We mostly suck in emails.

lurch ,

The one time it was helpful at work was when I used it to thank and wish a person well that left a company we work with. I couldn’t come up with a good response and ChatGPT just spat real good stuff out in seconds. This is what it’s really good for.

grrgyle ,

Yeah things that follow a kind of lexical “script” that you don’t want to get creative with would be pretty easy to generate. Farewells, greetings, dear Johns, may he rest in peaces, etc etc

iopq , (edited )

ChatGPT: I’m happy for you though, Or sorry that happened

bigkahuna1986 ,

ChatGPT just spat real good stuff out in seconds

There’s an entire episode of south park centered around this premise.

dgmib ,

Sometimes ChatGPT/copilot’s code predictions are scary good. Sometimes they’re batshit crazy. If you have the experience to be able to tell the difference, it’s a great help.

EatATaco ,

Due to confusing business domain terms, we often name variables the form of XY and YX.

One time copilot autogenerated about two hundred lines of a class that was like. XY; YX; XXY; XYX; XYXY; … XXYYXYXYYYXYXYYXY;

It was pretty hilarious.

But that being said, it’s a great tool that has definitely proven to worth the cost…but like with a co-op, you have to check it’s work.

Potatos_are_not_friends ,

Pretty much this. Experienced developers see AI just as a next level lorem Ipsum.

fossilesque ,
@fossilesque@mander.xyz avatar

I find the mistakes it makes and trouble shooting them really good for learning. I’m self taught.

Inktvip ,

The amount of reference material it has is also a big influence. I’ve had to pick up PLC programming a while ago (codesys/structured text, which is kinda based on pascal). While chatgpt understands the syntax it has absolutely no clue about libraries and platform limitations so it keeps hallucinating those based on popular ones in other languages.

Still a great tool to have it fill out things like I/O mappings and the sorts. Just need to give it some examples to work with first.

SpicyLizards ,

I would make some 1000 monkeys with typewriters comment, but I see what most actual contracted devs produce…

Thcdenton ,

It was pretty good for a while! They lowered the power of it like immortan joe. Do not be come addicted to AI

dullbananas ,
@dullbananas@lemmy.ca avatar

If you become addicted to ChatGPT then that makes you a cloud cyborg

finestnothing ,

I use chatgpt semi-often… For generating stuff in a repeating pattern. Any time I have used it to make code, I don’t save any time because I have to debug most of the generated code anyway. My main use case lately is making python dicts with empty keys (e.g. key1, key2… becomes “key1”: “”, “key2”: “”,…) or making a gold/prod level SQL view by passing in the backend names and frontend names (e.g. value_1, value_2… Value 1, Value 2,… Becomes value_1 as Value 1,…).

ramirezmike ,

I know this is gonna sound annoying but I just use vim for stuff like this. Even notepad++ has a macro thing too, right? My coworkers keep saying how much of a productivity boost it is but all I see it do is mess up stuff like this that only takes a few seconds in vim to setup and I know it’ll be correct every time

finestnothing ,

I use vim keybinds (via doom emacs) for this sort of stuff if I’m doing it for personal projects, my professional work is all done in an online platform (no way around it) so it’s just faster and easier to throw the pattern and columns at the integrated chatgpt terminal rather than hop to a local editor and back

Max_P ,
@Max_P@lemmy.max-p.me avatar

I don’t even bother trying with AI, it’s not been helpful to me a single time despite multiple attempts. That’s a 0% success rate for me.

cupcakezealot ,
@cupcakezealot@lemmy.blahaj.zone avatar

ill use copilot in place of most of the times ive searched on stackoverflow or to do mundane things like generate repeated things but relying solely on it is the same as relying solely on stackoverflow.

0x01 ,

I’m a 10 year pro, and I’ve changed my workflows completely to include both chatgpt and copilot. I have found that for the mundane, simple, common patterns copilot’s accuracy is close to 9/10 correct, especially in my well maintained repos.

It seems like the accuracy of simple answers is directly proportional to the precision of my function and variable names.

I haven’t typed a full for loop in a year thanks to copilot, I treat it like an intent autocomplete.

Chatgpt on the other hand is remarkably useful for super well laid out questions, again with extreme precision in the terms you lay out. It has helped me in greenfield development with unique and insightful methodologies to accomplish tasks that would normally require extensive documentation searching.

Anyone who claims llms are a nothingburger is frankly wrong, with the right guidance my output has increased dramatically and my error rate has dropped slightly. I used to be able to put out about 1000 quality lines of change in a day (a poor metric, but a useful one) and my output has expanded to at least double that using the tools we have today.

Are LLMs miraculous? No, but they are incredibly powerful tools in the right hands.

Don’t throw out the baby with the bathwater.

LyD ,

On the other hand, using ChatGPT for your Lemmy comments sticks out like a sore thumb

FaceDeer ,
@FaceDeer@fedia.io avatar

If you're careless with your prompting, sure. The "default style" of ChatGPT is widely known at this point. If you want it to sound different you'll need to provide some context to tell it what you want it to sound like.

Or just use one of the many other LLMs out there to mix things up a bit. When I'm brainstorming I usually use Chatbot Arena to bounce ideas around, it's a page where you can send a prompt to two randomly-selected LLMs and then by voting on which gave a better response you help rank them on a leaderboard. This way I get to run my prompts through a lot of variety.

raspberriesareyummy ,

I’m a 10 year pro,

You wish. The sheer idea of calling yourself a “pro” disqualifies you. People who actually code and know what they are doing wouldn’t dream of giving themselves a label beyond “coder” / “programmer” / “SW Dev”. Because they don’t have to. You are a muppet.

Gsus4 ,
@Gsus4@mander.xyz avatar

elon?

TrickDacy ,
@TrickDacy@lemmy.world avatar

A lot of rage for a small amount of confidence

chiisana ,
@chiisana@lemmy.chiisana.net avatar

Here we observe a pro gatekeeper in their natural habitat…

figaro ,

Hey! So you may have noticed that you got downvoted into oblivion here. It is because of the unnecessary amount of negativity in your comment.

In communication, there are two parts - how it is delivered, and how it is received. In this interaction, you clearly stated your point: giving yourself the title of pro oftentimes means the person is not a pro.

What they received, however, is far different. They received: ugh this sweaty asshole is gatekeeping coding.

If your goal was to convince this person not to call themselves a pro going forward, this may have been a failed communication event.

raspberriesareyummy ,

while your measured response is appreciated, I hardly consider a few dozen downvotes relevant, nor do I care in this case. It’s telling that those who did respond to my comment seem to assume I would consider myself a “pro” when that’s 1) nothing I said and 2) it should be clear from my comment that I consider the expression cringy. Outside memeable content, only idiots call themselves a “pro”. If something is my profession, I could see someone calling themselves a “professional <whatever>” (not that I would use it), but professional has a profoundly distinct ring to it, because it also refers to a code of conduct / a way to conduct business.

“I’m a pro” and anything like it is just hot air coming from bullshitters who are mostly responsible for enshittification of any given technology.

MajorHavoc ,

As a fellow pro, who has no issues calling myself a pro, because I am…

You’re spot on.

The stuff most people think AI is going to do - it’s not.

But as an insanely convenient auto-complete, modern LLMs absolutely shine!

TrickDacy ,
@TrickDacy@lemmy.world avatar

Refreshing to see a reasonable response to coding with AI. Never used chatgpt for it but my copilot experience mirrors yours.

I find it shocking how many developers seem to think so many negative thoughts about it programming with AI. Some guy recently said “everyone in my shop finds it useless”. Hard for me to believe they actually tried copilot if they think that

nephs ,

Omg, I feel sorry for the people cleaning up after those codebases later. Maintaing that kind of careless “quality” lines of code is going to be a job for actual veterans.

And when we’re all retired or dead, the whole world will be a pile of alien artifacts from a time when people were still able to figure stuff out, and llms will still be ridiculously inefficient for precise tasks, just like today.

youtu.be/dDUC-LqVrPU

sylver_dragon ,

I think AI is good with giving answers to well defined problems. The issue is that companies keep trying to throw it at poorly defined problems and the results are less useful. I work in the cybersecurity space and you can’t swing a dead cat without hitting a vendor talking about AI in their products. It’s the new, big marketing buzzword. The problem is that finding the bad stuff on a network is not a well defined problem. So instead, you get the unsupervised models faffing about, generating tons and tons of false positives. The only useful implementations of AI I’ve seen in these tools actually mirrors you own: they can be scary good at generating data queries from natural language prompts. Which is, once again, a well defined problem.

Overall, AI is a tool and used in the right way, it’s useful. It gets a bad rap because companies keep using it in bad ways and the end result can be worse than not having it at all.

jsomae ,

In fairness, it’s possible that if 100 companies try seemingly bad ideas, 1 of them will turn out to be extremely profitable.

Specal ,

I’ve found that the better I’ve gotten at writing prompts and giving enough information for it to not hallucinate, the better answers I get. It has to be treated as what it is, a calculator that can talk, make sure it has all of the information and it will find the answer.

One thing I have found to be super helpful with GPT4o is the ability to give it full API pages so it can update and familiarise it’s self with what it’s working with.

EatATaco ,

Anyone who claims llms are a nothingburger is frankly wrong,

Exactly. When someone says that it either indicates to me that they ignorant (like they aren’t a programmer or haven’t used it) or they are a programmer who has used it, but are not good at all at integrating new tools into their development process.

Don’t throw out the baby with the bathwater.

Yup. The problem I see now is that every mistake an ai makes is parroted over and over here and held up as an example of why the tech is garbage. But it’s cherry picking. Yes, they make mistakes, I often scratch my head at the ai results from Google and know to double check it. But the number of times it has pointed me in the right direction way faster than search results has shown to me already how useful it is.

  • All
  • Subscribed
  • Moderated
  • Favorites
  • [email protected]
  • random
  • lifeLocal
  • goranko
  • All magazines