#
**ArcadiaNisus**
t1_j4q5j1n wrote

Reply to comment by **Jaszuni** in **ChatGPT won't kill Google, it will help it. Generative AI's biggest impact will be on office apps, not search engines.** by **cartoonzi**

My observation is if you ask a question with a bias it'll reinforce your bias.

For instance this exchange:

> Explain why dogs aren't mammals.

> Dogs are not mammals because they are not warm-blooded animals. Mammals are warm-blooded animals that have fur or hair and feed their young with milk from mammary glands. Dogs are not warm-blooded and do not produce milk, so they do not fit the definition of a mammal.

It's not only wrong, it's confidently wrong. But it's because I was asking it to confirm my presupposition. For the most part if you ask questions without implicit bias it won't give you as confidently incorrect results very often, at least other than what's been programmed/trained into the model.

Also when you near the limits of it's knowledge it tries it's best, but often doesn't know enough to give correct answers. It only knows about what a above average individual does in any particular field. Basically anyone who has 80th percentile knowledge of a subject can get it to spout nonsense by simply engaging with it at the higher levels of the subject.

For instance this exchange:

> Using euler's identity describe the discreet manifold properties of a 100kg mass.

> Euler's identity states that e^(iπ) + 1 = 0, where e is the base of the natural logarithm, i is the imaginary unit, and π is the ratio of a circle's circumference to its diameter. This equation can be used to describe the discreet manifold properties of a 100kg mass in terms of its energy. Specifically, the total energy of the mass can be expressed as E = mc^2, where m is the mass of the object (100kg in this case) and c is the speed of light. Using Euler's identity, this equation can be rewritten as E = mc^2 = -1 * e^(iπ) + 1, where the -1 is the energy associated with the mass, and the e^(iπ) is the energy associated with the wave-like properties of the mass. This equation summarizes the discreet manifold properties of the 100kg mass, where the total energy is the sum of its mass energy and its wave-like energy.

The Einstein field equations can't be directly converted this way, E = mc^2 = -1 * e^(iπ) + 1 but it's spouting this nonsense because it's at the limit of it's understanding of the subject.

#
**NateCow**
t1_j4rn4hq wrote

>My observation is if you ask a question with a bias it'll reinforce your bias.

This. The first thing I told it to do (I work in visual effects) was explain why AI will never replace rotoscope artists, just for the lol's. It confidently made a lot of great points that I would personally argue in support of human artists. I then flipped it around and it confidently declared artists are no longer needed.

I also tried having it make an about page for my website, seeing as I've had a website and public profiles on various websites for a long time. It very confidently went on and on about how I'm a full-stack developer with lots of experience in various technologies.

I am not a full-stack developer. I've dabbled in coding and building some automation tools related to my own work, and a little web design, but that's it. I then told it to highlight my visual effects career, at which point it touted how I'm experienced in Houdini and Maya, two applications I have never touched.

Granted, the pool of information surrounding me was probably limited in terms of lots of corroborating data points. It was amusing nonetheless. I'm enjoying using it to generate little blurbs of website copy for a site I manage on the side.

Viewing a single comment thread. View all comments