Tanglemix t1_irb1m3k wrote
As an Artist my first sight of AI art was a real shock and it is an amazing achivement in many ways.
But I will push back a bit on your predictions as to it's impact on the visual creative fields and would be interested to know if you think my reasoning is sound, or if I am misunderstanding something.
It seems to me that a major problem with text to image tech is neatly expressed by this very definition-'text to image'. How viable is this concept?
For example- we could probably now create a 'speech to image' camera in which the lens has been replaced by a microphone- and to take a picture with this camera you would simply describe the scene in front of you and the AI would than recreate that scene based on your words.
Would this actually work? I would say 'up to a point'. The image you got would probably roughly approximate the scene in front of you- but it would be far from a photographic rendering of that scene. And this would hold true no matter how developed the language model used by the AI became, because this limitation reflects the limits of words to accurately define visual phenomena.
This is why your passport has a photo of you, not just a written description of your face- no written description could be accurate enough to be used to identify you.
So if, as an artist, I cannot accurately communicate my intent to the AI because I must use words to do so, then I have given up the almost complete control I currently have using a drawing tablet in exchange for a far more crude interface.
In return I gain an AI 'assistant' that will interpret my words and from them attempt to create the image I set out to make- but this represents another loss of control as the AI's take on my words may not exactly reflect the meaning I intended them to convey.
So in terms of using AI as a tool to create final image output I think this is unlikely due to the inherent inability of 'text' to precisely define 'image', at least at the level of granularity required for professional work. As tools for idea generation AI have a place- but as replacements for the 'manual' skill that human artists bring even to the creation of digital images I don't see how this would be possible, at least not using text as an interface.
SejaGentil t1_irdj74r wrote
Word to Image is just the first thing that works though. In the future we will probably have way more sophisticated and precise tools. Stable Diffusion's image to image for example. And its reverse prompt feature allow you to load yourself into the AI and make exact copies of you in any pose you want, no need for words. So I kind of not agree that's the limitation of AIs, it isn't. I do think AIs are very limited on reasoning and, ironically, creativity. They can't create new concepts that weren't done before. Like, if you ask DALL-E to create a dragon, it will. If you ask it to create a city, it will. Mix the two and the results will be awful. The dragon will never mix with the city well enough. Similarly, GPT-3 will gladly tell you the answer to any sophisticated question... that you can find on Wikipedia. Now, ask it to solve the simplest problem that it has no memory of yet, and it will fail miserably. Honestly these technologies feel like the most stupid human to ever be born, who compensated it with a memory the size of Earth, who memorized the entire Wikipedia.
Tanglemix t1_irf7tv8 wrote
I agree, this is why I think the term 'Artificial Intelligence' is a bit misleading. A better term would be 'Simulated Intelligence' because what these programmes seem to do is leverage speed and processing power to mimic-but not really replicate- the way that real intelligence works.
So you get this initial impression that something genuinely intelligent is at work only to find that this was something of an illusion, and that what you really have is a highly specialised system that does some things extraordinarily well, but other quite simple things are beyond it's comprehension.
I think this may explain why so often developments in AI seem to promise so much and yet so often fail to deliver. I am still waiting for that self driving taxi to pull up outside my house, but so far no luck.
Square_Nothing_3522 t1_irdrohx wrote
I think you lack perspective, I agree that words cannot describe an image 100% accurately due to them being abstractions of reality, leaving many possibilities to be interpreted from them. But, outside the creative professional field, most people, when thinking about something in their heads don't have a clear image of what they want or don't have an idea.
Text-to-image (or video) AI, will be very valuable, for the average population. And not only that, today as I speak they can generate thousands of images from one prompt, which allows one to pick his/her preferred ones. They will likely continue to get better and generate better images and videos that will suit the user the most, based on collected data about them. Looking at the current pace of development in these fields, they will likely find better ways to improve human-to-AI communication, and AI IQ is also increasing every 2-3 months. 2 years ago some artists said that the AI couldn't even generate an image that followed the instructions in the prompts.
The reality is that because there is a small percentage of people in the world who can think of very detailed images in their heads (especially in the creative field), which AI cannot reproduce at the moment, that won't stop the other 90%< of the world from enjoying this beautiful tech. Another thing you fail to realize buddy, humans to humans cannot transfer information with 100% accuracy because guess what... we also use words. So you tell me if the average person has to request a painting, what service will he/she request or buy; a human who will take days or hours to paint something and who cannot fully comprehend the meaning behind the words of the requester, or buy an AI software which can generate thousands of images with high resolution within seconds but which for the moment cannot fully comprehend the meaning behind the user prompt? You know the answer... Also, AI will be cheaper in the long run, than requesting services from humans. Think about companies, they could literally get save a lot of money and time with just a program that generates campaign images and other stuff for them in seconds instead of a team of humans.
The future (a near one) looks bad for your field.
By the way sorry for my English, I'm not a native.
Tanglemix t1_ire4l90 wrote
Your english is good and what you say is true- for a lot of people AI Art will work well, if all they want is something fairly generic.
I was really addressing the application of AI art in a professional environment where expectations are higher and the ability to make very precise altertations to an image is vital. In this scenario a 'pure' AI Artist, who has no other artistic skills, would find it very hard to meet their clients demands.
This does not mean AI will not be used by professionals, it already is, but for the foreseeable future the limitations of a 'text to image' interface will mean that human artistic skills will be required in addition to the use of AI.
The simple truth is that using a graphics tablet with pressure sensitivity I have a degree of precise control over how my digital image looks that words typed into an interface simply cannot match.
I'm sure that you are right that AI art will be cheaper than human artists, so cheap in fact that the perceived value of AI produced Art will be nearly zero.
The question then becomes; if you are trying to market a product in which artwork is an important indicator of that product's quality, do you use cheap AI Art, or do you use human artists? If the common perception is that AI Art is an indicator of low budget production values then using human artists may in fact be the better choice from a marketing point of view.
It's also true that while AI's can create a large variety of 'styles' in terms of technique they are limited in terms of framing and composition. This may not be apparent when viewing images in isolation- but when a lot of AI art is seen together certain patterns are visible that make these images look similar to each other. So there is a detectable 'look' to AI Art that may become a problem if you want to present your product as being unique in any way.
I suppose my point here is that Art is not a commodity like potatoes or cabbages- and so using Art that is seen as having low value is not always going to be the best thing to do. Ironicaly it may be that the sheer volume and low cost of AI produced art will lead to it's being avoided by those wishing to present their product as a high quality offering
Square_Nothing_3522 t1_irf7cop wrote
Two scenarios.
1-Let's assume in 5 years, for some reason the quality of AI images hasn't improved that much when compared to the best humans at their craft.
Even if AI is seen as a lower-quality work producer, today AI is already capable of replacing most artists. So even if people still request services from humans it will be way less than before, meaning a significant number of artists will be jobless. Only those who can capture details better than AI will still be hired to do work. With this, you can already see that only a small percentage of artists will be able to make a living out of it.
Also, there is another thing you are missing, and it's called the art of promoting. This is already going on in some companies, people study AI, and its outputs to certain words, in order to understand how it works and give it better prompts, this can potentially become a new field of study, and people might request help from the best prompters to generate extremely good (very specific/detailed images) images from the AI. The field of prompting could potentially wipe out all the artists because we do not know how precise an AI can get with the right prompts.
I'm not saying all of this has to necessarily happen, but you can see that even if AI does not improve your field has many ways of losing most of its professionals.
That being said, I do not think that a scenario where AI work is seen as low quality will happen. That takes us to scenario 2, which is the most likely one.
2-For the past year the progress in AI improvement has been going so fast, that experts can't even keep up with the breakthroughs. We are likely about to enter a new era. I've witnessed this myself in this sub, in the beginning of the year there were only breakthroughs (different breakthroughs related to AI) once in 1-2 weeks. Now is every fucking 3-6 hours. I think it would be a miracle if text-to-image AI doesn't improve. By the current progress, in less than 2 years, it's likely to have surpassed humans capabilities in almost all artistic ways, at that time, the need for artists will start to decrease, slowly at the beginning, but by the 2030s, being an artist will just be a hobby (for 99%of people) not a professional field, or it might become like a sport, like chess where despite machines being better, people still want to see humans play.
Please pay attention to the breakthroughs, maybe in some weeks, we will be hearing something new about this text-to-image AI. People need to start taking this seriously and plan their future accordingly.
Tanglemix t1_irgppaj wrote
The limitations of text to image are not technological, they arise from the inherent impossibility of encoding visual information precisely using words alone.
If you tried to generate a self portrait using an AI by inputting only a text prompt description of your face it would not result in a recognisable picture of you- only a generic image of someone perhaps similar to you. And this would hold true no matter how skilled you may become in writing prompts and no matter advanced the language model used by the AI to interpret your prompts.
So text to image is never going to be anywhere near as precise as drawing tablet when it comes to the editing of digital images.
To be clear I did not say that AI art would be seen as having low quality, I said it would come to be seen as having low value- a subtle but important distinction.
For example an author recently posted a question about how he could avoid being 'ripped off' by an AI Artist. His problem-as he saw it- was that he might be charged a high fee for something that took only minutes to produce by someone who pretended to have done the work themselves without using AI.
This- he seemed to feel- would be to steal from him by pretending to offer something of high value while in reality supplying something of lower value.
But the fascinating aspect of this situation was that the quality of the image was not at issue- in fact the very root of his problem was that he would not be able to tell by looking at the image how it had been made.
What this tells us is that AI Art will be seen as having low value not because it's bad art, but because it's so very quick and easy to make. Humans tend not to place a high value on anything seen as quick and easy to make.
No improvement in the quality of AI Art will prevent it's being seen as cheap low value Art when compared with art made by humans. How this perception will impact on the marketplace is another question. In some contexts such as greeting cards, for example, people will not care how the art was made- they just want a pretty picture.
However, if you are selling a product where the Art it contains is seen as a measure of the quality of the product, and you use low value AI Art in that product, this could be a problem because the message it sends is that you don't care enough about your product- and by extension- your customers, to pay out for higher value art made by humans.
None of this is especially rational of course- but humans are not entirely rational beings. One might say to that worried Author 'why do you care if the Art took only two minutes to make- if you like the Art and had already agreed the price?' And from a purely rational perspective he should not care. But- the fact that he paid a high price for something that took only minutes to make feels to him like stealing- and in a contest between rational thought and feeling, feeling will win out every time when it comes to human beings.
So the Impacts of AI in all it's aspects may not be as expected due to this variable- it may turn out, for example, that the perception of AI Art becomes so negative that it's use in almost any context will become seen as toxic and damaging to any product it is used in. Not saying this will be the case, but it could happen.
So don't be so quick to dismiss your own species in your enthusiasm for it's putative replacement- humans are nothing if not unpredictable.
wen_mars t1_irglz05 wrote
On the other hand, you can now take a picture, import it into blender, delete some part of it and tell the AI to generate something else in that place that fits in with the rest of the picture.
Tanglemix t1_irjjgh2 wrote
I can do that with photoshop already, with considerably more control over the final image.
There is a basic problem with your proposition that in the future AI Art programmes will offer a similar level of control as a graphics tablet. If that were to happen then in order to exert that control the user of the AI would need skill and experience to do so. And people who use skill and experiance to create images are called 'Artists'.
So increasing the ability of an AI to respond to more complex and nuanced instructions does not eliminate the need for a skilled human , it makes that human more important, since they will be required to craft those complex and nuanced instructions.
In order for your prediction that skilled human Artists will not be required in the future to happen, you need to do the opposite of what you propose- you need to take control away from the human and give that control to the AI- so it is the AI that controls what the final image looks like, not the human.
In this scenario the human is more like an 'art director' who instructs the AI as to what he wants to see, and the AI is smart enough to deliver that result. But it is rare that a 'first pass' result will be exactly what the Art director requires, so a process of interation and refinement then takes place with the final Art being an emergent property of this process.
I'm not saying that this may not one day happen- but it cannot be achieved by increasing the control of the Art Director- it can only be achieved by increasing the comprehension of the AI- it is the AI's ability to understand the subtle nuances of the Art Directors intent and to implement that intent faithfully that will determine how useful AI Art will be as a replacement for human Artists.
But this level of comprehension does not exist in the current models and something akin to true AGI would seem to be required.
wen_mars t1_irk6ae6 wrote
AI and a graphics tablet aren't mutually exclusive. You can sketch with the tablet and add as much detail as you want, and then let the AI do the rest.
You're putting a lot of words into my mouth but I'll address your last two paragraphs. AI's ability to follow directions has improved tremendously over the past several years. I think it will continue to improve and get close to AGI-level performance on a wide range of tasks this decade. For actual AGI my guess is next decade.
Tanglemix t1_irkinh2 wrote
I've seen people using very simple sketches as prompts which work ok to get fairly simple compositions that try to match the sketch. I haven't yet seen examples where the inital sketch is more sophisicated and includes things like specific lighting or perspective foreshortening- but you may be right that some hybrid input of human plus AI may evolve in the future- it's an interesting idea.
I'm less convinced on the AGI side. At present AI Art is a kind of trick- it looks impressive but is less than it seems to be because the AI has no actual understanding of the things it is depicting- it deals in patterns of pixels that correlate to word combinations- it has no idea that these patterns represent volumes in 3D space that have surface material qualities that interact with the light sources in the scene.
To be a truly viable substitute for human artists AI would have to move beyond 2D and be able to understand that the scenes it generates are abstractions from a 3 Dimensional reality.
I can at least imagine a sort of autonomous version of Blender or 3D Max that in response to a prompt then builds a complete 3D scene, including geometric objects, textures, materials, light sources and volumetric effects like mist and ariel perspective- and from this render 2D images from any perspective desired.
The thing I find harder to imagine is how such a system could conjure 3D representations of imaginary objects and scenes that do not exist- where would the training data come from to make this possible?
wen_mars t1_irkunsa wrote
I don't know where they source the training data from but we can already see early examples of AI that can generate 3D models from 2D input.
Tanglemix t1_irp3vk9 wrote
I have seen those and they are amazing-but seem to rely on multiple images of the same existing object to generatethe 3D model
The real trick would be to create a convincing 3D model from a single image of something that did not exist- something imaginary.
If an AI were able to do this it would be replicating what a human concept artist might do when presented with a single sketch as a starting point.
Viewing a single comment thread. View all comments