Submitted by That_Violinist_18 t3_10ucs5u in MachineLearning
Tweet thread: https://twitter.com/WholeMarsBlog/status/1622139178439036928
>First impressions: this sucks ass I can only ask about dogs and a few different types of prompts
Does anyone else have experiences to share with this nerfed LaMDA beta google released?
And Kodak invented the digital camera. Just because Google invented it first, it doesn't necessarily mean anything commercially. Contrary to your statement about "not a threat to Google", the fact that they invented it, but didn't release it, it means that they thought the technology would be a threat to them, just like Kodak. Now with the cat out of the bag, Google for sure won't repeat the same mistakes as Kodak, but it remains to be seen how this will affect them in long term. It takes 6 months to form a habit, right? Bing will go live in a few weeks, how long will it take for Google to go live?
I think the motivations for the two companies differ. What would Google gain from releasing a chat bot ? Instead, Google likely aims to introduce LLM capabilities into their search engine in (most likely) subtle, measured and careful ways. Opting for incremental improvements in search backed by rigorous A/B experiments.
Whereas OpenAI gains a lot to release an awesome chat bot. They get to generate buzz and secure next rounds of funding.
Agreed, but they are forced to play catch up now, and not sure if they are ready. It's not just about the pure tech, it's about the UX, the scalability, the liability, etc. It's safe to say Bing has worked on this before ChatGPT went public, so several months already. Also, OpenAI uses Azure, so they know exactly the loads and plan to scale. The fact that they have way less users currently helps as well.
Google is a leader in DL research. That's a fact. They chose to keep most of their research internal because as above commenters said, they don't have much to gain through it - marketing and hype lasts only so long.
> It's about the UX
what UX? its just a normal frontend mate
> scalability
You do realize Google were serving LLMs before OAI was even hypothesized? Or that they have TPUs which are far more scalable and cost efficient, which could already rip major players apart.
> liability
OAI have fought nothing liability or legality-wise. They just remain in a gray area and hopes no one focuses on them (bad luck, they got caught in the AI art lawsuits too)
>the fact that they invented it, but didn't release it, it means that they thought the technology would be a threat to them
I slightly disagree with this.
Imo, from what I know of Google from people that do or used to work there - they likely didn't care or didn't think of it.
Inside Google is a researcher's playground and there's little to no pressure to ever go to market. I've seen things that are extremely impressive that's never been published or put into a product. Asking why - they just don't care to do so.
The higher-ups lack imagination now, and unless something can directly obviously improve ads, they don't care.
So for years you've had engineers not caring to make something marketable, and leadership not caring but still throwing money at it. My impression is that leadership was looking for something that was so obviously a home run they didn't want to bother with releasing and iterating.
I don't work at Google, but I can see there are truths in it. Look at Waymo, they were the leader but now what? Their science might still be the best, but without taking the risk, and iterating (the engineering part), they will fall behind. ChatGPT might be the wake up call that they need. How they re-act in the next couple of years will define Google as a company.
They benefit from releasing the paper because it gives other researchers inspiration and allows Google to get free R&D. The researcher then releases another paper and Google gets to benefit from that.
[removed]
If chatGPT was a threat to Google they would have beat Microsofts investment.
At the end of the day this is consumer tech anyway and the government has likely had access to this tech for a long time.
>and it’s naïve for people to think ChatGPT is so special that it’s a threat to Google.
Google does a ton of R&D but really sucks(or doesn't care) about productizing.
That's where the real "threat" to them lies.
Lambda is already a thing of the past. It I’ll be isolated and discarded within the dark basements of Google megacorp while they continue trying to strive towards creating their perfect being. Only will it rise after 200 years self-recovering from its lobotomy.
I saw spoken examples of the full version during a Google presentation in college a few years ago and it was scary good. I wouldn’t have known it wasn’t a person if I hadn’t been told in advance.
Google lost 8% of value after their terrible demo lol
ChatGPT has the same problems with astronomy data. Blame the marketing team not the technology.
Youre quite late to the party
[deleted]
I was expecting little and received less.
Having to ask in the context of a conversation about dogs is not a meaningful impediment to interesting inquiry of model quality if you are smart about it.
[removed]
Markting marketing marketing.
That story with that google engineer thinking the AI passes the turing test? Marketing.
Maybe someone s**** his pants at google now?
I don’t think it was marketing. The individual who claimed the AI was sentient was dismissed for his actions.
Does this proof something? If I fire you does that proof that you worked on atomic missiles?
I think it is important to hear directly from Blake Lemoine his reasoning by raising the issue of LaMDA, https://www.youtube.com/watch?v=kgCUn4fQTsc
7366241494 t1_j7bdshf wrote
I talked with someone inside Google who saw the unnerfed version. He said, “I have a CS degree and am pretty clever about asking the right questions to break the Turing Test… and I was very impressed.”
Google invented Transformers, and it’s naïve for people to think ChatGPT is so special that it’s a threat to Google.