Author Topic: eevBLAB 106 - ChatGPT AI Has Changed EVERYTHING  (Read 63718 times)

0 Members and 1 Guest are viewing this topic.

Offline MK14

  • Super Contributor
  • ***
  • Posts: 4586
  • Country: gb
Re: eevBLAB 106 - ChatGPT AI Has Changed EVERYTHING
« Reply #50 on: January 06, 2023, 02:22:35 am »
I'll let others judge the results.  Here is one of the better pictures I managed to get made, recently.  Using the ChatGPT's, DALL·E 2 picture generator.
The text used was "EEVblog forums cat, playing in an electronics lab, with big bold and colourful flashing LEDs and motors, while controlling a large oscilloscope".
Results:

 
The following users thanked this post: Ed.Kloonk, xrunner

Offline golden_labels

  • Super Contributor
  • ***
  • Posts: 1262
  • Country: pl
Re: eevBLAB 106 - ChatGPT AI Has Changed EVERYTHING
« Reply #51 on: January 06, 2023, 02:49:52 am »
For actual, detailed works this is not enough. The smortnet was never trained for that, though. And for some uses you do not need much more. We already have an entire thread filled with wet neural networks outputs, which — while usually being of higher visual quality — often make even less sense. And no one cares, because the purpose is to invoke a particular response in recipient’s brain. A split-second process, devoid of any critical processing, the image itself playing no real role and to be forgotten a second later. :D

This is commonly employed in advertisements and music videos. On extreme side with images shown for just a dozen frames. Though technique is by no means new: it will soon celebrate its hundreth birthday, with earliest examples including Gance’s “Napoleon”.
« Last Edit: January 06, 2023, 02:58:41 am by golden_labels »
People imagine AI as T1000. What we got so far is glorified T9.
 
The following users thanked this post: MK14

Online Bud

  • Super Contributor
  • ***
  • Posts: 6960
  • Country: ca
Re: eevBLAB 106 - ChatGPT AI Has Changed EVERYTHING
« Reply #52 on: January 06, 2023, 05:35:03 am »
Is that the oscilloscope in the background?  :wtf:
Facebook-free life and Rigol-free shack.
 
The following users thanked this post: MK14

Offline MK14

  • Super Contributor
  • ***
  • Posts: 4586
  • Country: gb
Re: eevBLAB 106 - ChatGPT AI Has Changed EVERYTHING
« Reply #53 on: January 06, 2023, 05:42:12 am »
Is that the oscilloscope in the background?  :wtf:

That's a good example of why, currently, the pictures are more for fun or rough/draft work.  To get it done properly, still needs someone to do it properly.  Although with perhaps a quick session with Photoshop or similar, a real oscilloscope trace/screen, could be pasted into the picture, to fix/improve it.
 

Offline golden_labels

  • Super Contributor
  • ***
  • Posts: 1262
  • Country: pl
Re: eevBLAB 106 - ChatGPT AI Has Changed EVERYTHING
« Reply #54 on: January 06, 2023, 05:45:29 pm »
The cat is controlling the large oscilloscope, so obviously it must be looking at the device. Which means it’s not in the frame. You are the oscilloscope.

The thing in the background is a tube amplifier for the oscilloscope, with the fancy blue light as you find in some eBay tube amps.
People imagine AI as T1000. What we got so far is glorified T9.
 
The following users thanked this post: MK14

Offline james_s

  • Super Contributor
  • ***
  • Posts: 21611
  • Country: us
Re: eevBLAB 106 - ChatGPT AI Has Changed EVERYTHING
« Reply #55 on: January 06, 2023, 05:50:36 pm »
Is that the oscilloscope in the background?  :wtf:

That's a good example of why, currently, the pictures are more for fun or rough/draft work.  To get it done properly, still needs someone to do it properly.  Although with perhaps a quick session with Photoshop or similar, a real oscilloscope trace/screen, could be pasted into the picture, to fix/improve it.

It still reminds me of the python scripts I was playing around with a few years ago to generate text. I made several that could spit out pages and pages of reasonably formatted more or less grammatically correct text that were pretty much just gibberish. It was amusing but not the least bit useful.
 
The following users thanked this post: MK14

Offline EEVblogTopic starter

  • Administrator
  • *****
  • Posts: 37934
  • Country: au
    • EEVblog
Re: eevBLAB 106 - ChatGPT AI Has Changed EVERYTHING
« Reply #56 on: January 06, 2023, 10:10:44 pm »
Fran did a video on this:
 
The following users thanked this post: MK14

Offline bob808

  • Frequent Contributor
  • **
  • Posts: 281
  • Country: 00
Re: eevBLAB 106 - ChatGPT AI Has Changed EVERYTHING
« Reply #57 on: January 06, 2023, 11:29:15 pm »
I guess the more philosophical question is "what do we do at the point past which we don't have to do anything?". Should we reach it? It feels like we should.
 

Offline Mr.B

  • Supporter
  • ****
  • Posts: 1244
  • Country: nz
Re: eevBLAB 106 - ChatGPT AI Has Changed EVERYTHING
« Reply #58 on: January 07, 2023, 03:09:39 am »
I don’t know if I am not asking the questions the right way, or the AI is simply screwing up.
Or maybe I am not understanding the answers correctly…
First example: I brew beer for a hobby. I usually brew under pressure and crash cool at the end of fermentation. The AI gets the math wrong.
Second example: Fairly basic question.

Where are we going, and why are we in a handbasket?
 

Online ataradov

  • Super Contributor
  • ***
  • Posts: 11385
  • Country: us
    • Personal site
Re: eevBLAB 106 - ChatGPT AI Has Changed EVERYTHING
« Reply #59 on: January 07, 2023, 03:18:16 am »
It does not "know" math at all. It is a language model. It is capable of convincingly BSing its way around topics.

All it knows that at this point in the sentence some number makes a lot of sense. It is frankly amazing that it gets that far.

This is why it is so dangerous. It is good enough to convince you that it is correct.
« Last Edit: January 07, 2023, 03:20:47 am by ataradov »
Alex
 

Offline SiliconWizard

  • Super Contributor
  • ***
  • Posts: 14698
  • Country: fr
Re: eevBLAB 106 - ChatGPT AI Has Changed EVERYTHING
« Reply #60 on: January 07, 2023, 03:23:22 am »
It's just a gigantic piece of crap illusion.
One sure thing is that its proponents are working hard at making us all believe that it's gonna become unavoidable, so that we better get used to it.

Call me when this shit has any value for people except for those very few who reap direct benefits both in terms of money and power.

I'm almost convinced now that it's soon going to be used for all kinds of completely official and serious uses despite its patent shortcomings. This is the new normal.
« Last Edit: January 07, 2023, 03:25:01 am by SiliconWizard »
 

Offline golden_labels

  • Super Contributor
  • ***
  • Posts: 1262
  • Country: pl
Re: eevBLAB 106 - ChatGPT AI Has Changed EVERYTHING
« Reply #61 on: January 07, 2023, 03:38:26 am »
I don’t know if I am not asking the questions the right way, or the AI is simply screwing up.
It’s a huuuuuge and complicated mathematical equation, in which parameters were adjusted in millions of repeated test-adjust attempts. For a bunch of input numbers it produces a bunch of output numbers. The parameters were chosen in a way, that human brain seeing the output will think they are a sensible result of the input.

The smortnet does not think in usual sense of this word. It can’t understand its own outputs, as it doesn’t even have a capability to perceive those. Not to mention having any circuitry to correct/reject them.

Performing such operations is not even limited to machine learning. One can construct a deterministic system, which will do the same. The difference with smortnets is that they are resilent against input noise,(1) though the consequence is the noise you get in the output, and that constructing them is computationally uncomparably cheaper than what would be needed in older, deterministic systems of a similar scale.(2)


(1) For a few recent, famous solutions noise is actually injected into the system to obtain the results.
(2) Strictly speaking: traditional solutions would be infeasible at this scale. You could construct a hash function, that does exactly what ChatGPT does, but it would take multiple ages of the universe if not more.
People imagine AI as T1000. What we got so far is glorified T9.
 

Offline Per Hansson

  • Supporter
  • ****
  • Posts: 432
  • Country: se
Re: eevBLAB 106 - ChatGPT AI Has Changed EVERYTHING
« Reply #62 on: January 07, 2023, 12:22:38 pm »
In the example Dave is amazed how it spits out some Arduino code, but it is literally just taken from the Arduino website.
As PA0PBZ pointed out you can make it cite its source.
I don't see how there is any Artificial Intelligence in this at all.

« Last Edit: January 07, 2023, 12:25:10 pm by Per Hansson »
 

Offline bob808

  • Frequent Contributor
  • **
  • Posts: 281
  • Country: 00
Re: eevBLAB 106 - ChatGPT AI Has Changed EVERYTHING
« Reply #63 on: January 07, 2023, 02:43:00 pm »
 

Offline madires

  • Super Contributor
  • ***
  • Posts: 7890
  • Country: de
  • A qualified hobbyist ;)
Re: eevBLAB 106 - ChatGPT AI Has Changed EVERYTHING
« Reply #64 on: January 07, 2023, 03:17:38 pm »
I don't see how there is any Artificial Intelligence in this at all.

AI is the buzzword for what we've called neural networks 30 years ago. With today's CPU performance you can simulate much more neurons and layers, giving you more sophisticated results. Back then the highlight was to recognise handwritten numbers in realtime. It's still the same principle, just much larger. This also implies that your AI is a black box and you don't have any real control or idea of what's happening inside - it's simply too complex for the human brain to understand. If you train the AI with garbage, you'll get garbage as output (including discrimination, racism and all the other politically incorrect terms). The huge problem we have now is that some people believe in AI (or more generally in tech) superiority and are using it for hiring employees or determining insurance risks, while trying to avoid responsibility in case something goes wrong. Your Honour, it wasn't me, it was the AI! In the future we'll see a lot of lawsuits because of this. I'm not saying that AI is bad, but we need to understand its limits and risks, and how to use it sensibly.
 

Offline Axk

  • Regular Contributor
  • *
  • Posts: 218
  • Country: by
Re: eevBLAB 106 - ChatGPT AI Has Changed EVERYTHING
« Reply #65 on: January 07, 2023, 05:02:34 pm »
I guess I need a better understanding of how this GPT-3 thing works and that's probably an incorrect way to formulate my question,

Is there some parsing to determine the query type going on before it passes it to the GPT model?
E.g.

Text formatting
Code generation
Code analysis
Text summarization
source citation
etc

Or is it just literally one big model that is trained to do all the tasks?

From playing with it I have the same impression as most of the people here.
I don't see much practical application for it personally at the moment besides maybe:

Code scaffolding
Short scripts for simple tasks
Text correction and formatting

Anything factual, you cannot trust it.

I thought it could summarize articles based on URLs but turns out it just composed stories based on the few words in the URLs themselves )
« Last Edit: January 07, 2023, 05:55:04 pm by Axk »
 

Offline golden_labels

  • Super Contributor
  • ***
  • Posts: 1262
  • Country: pl
Re: eevBLAB 106 - ChatGPT AI Has Changed EVERYTHING
« Reply #66 on: January 07, 2023, 06:09:37 pm »
It’s one huge model, which is big enough and was taught with large enough dataset to be able to adapt to any language task.

Of course the final output, as conveyed to humans, is formatted using traditional techniques from markup the smortnet produces. But everything up until that point is a single encoder-decoder transformer.

Unlike the model itself, the GPT3 paper is available to public. But, until you are already reading ML papers for years, it will not be very useful to understanding this algorithm from ground up. The smortnet itself is provided exclusively to Microsoft and only Microsoft can use it to deliver solutions to the market. So no one knows all the details.
People imagine AI as T1000. What we got so far is glorified T9.
 
The following users thanked this post: Axk

Offline Neutrion

  • Frequent Contributor
  • **
  • Posts: 305
  • Country: hu
Re: eevBLAB 106 - ChatGPT AI Has Changed EVERYTHING
« Reply #67 on: January 07, 2023, 06:31:03 pm »
Apart from chatgpt itself, I think even if we would be somehow saved from the general strong AI, these softwares just by the disruption will cause more harm than good.
There is  this theory that disruption is good because it moves the world forward, but there is a point where it can end up in chaos. Even with social networks we see it, and I am not sure what is the huge benefit  what we got from FB and the likes. However we can clearly see that politics is getting more and more destabilized all around the world thanks to some of these disruptions.
The first world war  was also in huge part caused by the industrial revolution, and the fact that human society was not prepared for a war on an industrial scale, actually couldn't even imagine what it could mean.
With AI and genetic engineering I see a very dark horizont ahead of us. (The corona virus was just a really harmless demo of what could be waiting for us.)
 

Offline Ed.Kloonk

  • Super Contributor
  • ***
  • Posts: 4000
  • Country: au
  • Cat video aficionado
Re: eevBLAB 106 - ChatGPT AI Has Changed EVERYTHING
« Reply #68 on: January 07, 2023, 07:44:55 pm »
In the example Dave is amazed how it spits out some Arduino code, but it is literally just taken from the Arduino website.
As PA0PBZ pointed out you can make it cite its source.
I don't see how there is any Artificial Intelligence in this at all.

Could it interpret some obscure code found on the web and perhaps document it a little bit?

Asking for a friend.
iratus parum formica
 
The following users thanked this post: Per Hansson

Offline Axk

  • Regular Contributor
  • *
  • Posts: 218
  • Country: by
Re: eevBLAB 106 - ChatGPT AI Has Changed EVERYTHING
« Reply #69 on: January 07, 2023, 08:49:17 pm »
I wonder if we gonna see a 2023 "AI bubble" ))
 

Offline Axk

  • Regular Contributor
  • *
  • Posts: 218
  • Country: by
Re: eevBLAB 106 - ChatGPT AI Has Changed EVERYTHING
« Reply #70 on: January 07, 2023, 09:04:02 pm »
Could it interpret some obscure code found on the web and perhaps document it a little bit?

It won't really add any value besides stating obvious things about the code.
 

Offline EEVblogTopic starter

  • Administrator
  • *****
  • Posts: 37934
  • Country: au
    • EEVblog
Re: eevBLAB 106 - ChatGPT AI Has Changed EVERYTHING
« Reply #71 on: January 07, 2023, 10:45:13 pm »
I wonder if we gonna see a 2023 "AI bubble" ))

I think it depends on how well the public takes to "conversational search".
I think they need to rename it to something simple, and have a straight Google-like page. Currently it's kinda hidden away a bit behidn a subdomain.
Simplicity and branding is the key here.
« Last Edit: January 07, 2023, 10:46:58 pm by EEVblog »
 

Offline bob808

  • Frequent Contributor
  • **
  • Posts: 281
  • Country: 00
Re: eevBLAB 106 - ChatGPT AI Has Changed EVERYTHING
« Reply #72 on: January 07, 2023, 11:04:12 pm »
I think only Microsoft can use it so it'll become Bing. Or some version of Bing.
 

Offline golden_labels

  • Super Contributor
  • ***
  • Posts: 1262
  • Country: pl
Re: eevBLAB 106 - ChatGPT AI Has Changed EVERYTHING
« Reply #73 on: January 09, 2023, 01:40:56 am »
(…) With AI and genetic engineering I see a very dark horizont ahead of us. (The corona virus was just a really harmless demo of what could be waiting for us.)
Progress in computing is not filling me with fear. What worries me, is that kind of a mindset. I know of no creature more dangerous and destructive than scared humans. :(

Speaking of which, the smortnet situation triggers my curiosity not for technical reasons,(1) but from social, philosophical and psychological perspectives. The element most interesting in all this is a human and human society. I think I already posted that somewhere, but I suggest two movies:
  • The Heavenly Creature (2012), a part of “Doomsday Book” triptych, not to be confused with Jackson’s movie: depicting tension between two perceptions of a machine, working in a buddhist monastery, which started acting as an enlightened human. More current than ever. Better than anything showing, how I feel now, watching the smortnet hitting public.
  • Colossus: The Forbin Project (1970): seen as a member of the “evil AI” trope, to me this picture makes a strong philosophical statement about humans and your morality. A stunning depiction an ethical equivalent of the paperclip maximizer, exposing inherent incoherence of human ethics.


(1) That part is something I went through in late 2000s. My degree thesis was meant to be in autonomous robot swarms.
« Last Edit: January 09, 2023, 01:44:09 am by golden_labels »
People imagine AI as T1000. What we got so far is glorified T9.
 

Offline james_s

  • Super Contributor
  • ***
  • Posts: 21611
  • Country: us
Re: eevBLAB 106 - ChatGPT AI Has Changed EVERYTHING
« Reply #74 on: January 09, 2023, 07:51:31 am »
It does not "know" math at all. It is a language model. It is capable of convincingly BSing its way around topics.

All it knows that at this point in the sentence some number makes a lot of sense. It is frankly amazing that it gets that far.

This is why it is so dangerous. It is good enough to convince you that it is correct.

I've worked with a few guys like that.
 
The following users thanked this post: PA0PBZ


Share me

Digg  Facebook  SlashDot  Delicious  Technorati  Twitter  Google  Yahoo
Smf