Viewing a single comment thread. View all comments

HanaBothWays t1_j9vjozc wrote

Reply to comment by disasterbot in Even Hackers are reportedly getting Laid Off by Organized Crime Groups by TradingAllIn

You say that like it’s a joke but with the API version of ChatGPT, someone with little to no coding experience can produce some really sick malware.

It’s like performance-enhancing drugs for script kiddies.

33

SujetoSujetado t1_j9w8ncw wrote

I am a malware developer, this is not true as a general rule, malware code outputted by these language models have been subpar even for script kiddies standards (most code doesn't even work or don't do what it needs to do). Demonstration:
https://www.youtube.com/watch?v=L9w_k2ypRr0

35

deltagear t1_j9wrz7t wrote

The key with chatgpt isn't asking for the whole cake, it's asking for the ingredients.

19

SujetoSujetado t1_j9x03eb wrote

In the video it is tasked with very specific tasks, not whole cakes, injection is just a portion of what a malware does

6

HanaBothWays t1_j9w97n0 wrote

Okay. People on forums frequented by script kiddie types have been saying they can get good stuff out of ChatGPT, but of course script kiddies would not know the difference.

The people who write the tools used by script kiddies or those “ransomware as a service” type kits are a different story…

10

Hydronum t1_j9yb3hk wrote

Well yeah, Chat GTP starts strong, makes stuff up and then dresses it up pretty like.

4

Kache t1_j9xq1c9 wrote

But it's got big potential in systemizing social engineering attacks.

3

MacDegger t1_j9wtlk7 wrote

No. they can't.

Chatgpt is ... at best decent for very, very simple methods.

But it is shit for even normal decent programming tasks. Let alone innovative programming.

By fucking design! By the very way it works it CANNOT innovate because it just 'riffs' on what it has seen ... it guesses based on previous input ... and most input is SHIT.

And even if the model was trained on the best input .... by it's very definition of how it works it CANNNOT innovate.

Yet.

8

zeldaleft t1_j9wxe2z wrote

You lack imagination and problem solving skills.

−3

MacDegger t1_jaeqw5q wrote

Hahahaha!

Because that is EXACTLY what ChatGPT lacks! By the very way it functions.

1

dopef123 t1_j9w906f wrote

Really? Ive never worked on malware but doesn't it typically need some pretty slick ways to inject code?

5

HanaBothWays t1_j9wabvo wrote

There are two possibilities for this:

One, hook up to a module or service that will inject the malware for you (these absolutely exist).

Two, there are lots of well-known vulnerabilities out there that a lot of people haven’t patched…and ChatGPT may know what they are!

You could prompt it with “write malware like this with a delivery mechanism that uses the top five known exploitable vulnerabilities” (yes there is a list).

1

beaucephus t1_j9w0bwy wrote

So, with the API they gave anyone the ability to hand ChatGPT a joystick to control an armed drone or something like that?

Just thinking out loud, here...

2

A1kmm t1_j9wxxff wrote

ChatGPT is a language model, optimised for finding a suitable output text for a given input text. It is trained on natural language understanding an processing - its input is characters, but words, grammar, and basic logic / facts are emergent properties.

It can memorise times tables and solve basic maths problems, but it can't devise an approach to solve larger problems (it can't even add and subtract larger numbers in combinations it hasn't seen before, even if they would be trivial for humans).

None of that makes it very good for tasks like controlling a drone (which would be heavily about image processing) compared to a human.

Other 2010-era developments in AI, such as in the image classification space, for example, would help a lot more for that application.

7

HanaBothWays t1_j9w34mk wrote

No, that’s not possible (at least not yet).

But you can prompt ChatGPT to write polymorphic malware that escapes existing detection tools and will bounce around the internet and infect any system that isn’t up-to-date on its patches (there are lots and lots and lots of systems like this).

1

MacDegger t1_j9wtx87 wrote

No, you can't.

Not even idiots who think that way and try to use prompts that way can.

ChatGPT is basically a dumb Clippy autocomplete which by definition cannot innovate.

5

Atticus_Fatticus t1_j9y63bq wrote

That's not my experience with it. It wrote some really solid GDScript for me which I thought was impressive because it's a very specific programming language.

1