NakedMuffin4403 t1_jed8ojv wrote on March 31, 2023 at 4:06 AM

Who said you need to train models from scratch? The people doing this are actual SCIENTISTS. Startups will NOT be training models from scratch (similar to how they abstract compute to cloud providers).

What you need to do is use these already trained models and then train them to cater to your vertical. Not sure how doable this is now, but it is inevitably going to be the industry standard.

The two hardest parts will be finding the data to tailor-train your model and actually implementing it a meaningful way.

I am in kinda in a similar position. I actually made a post on my profile you can check out. I study CS but I currently lack the expertise to compete effectively - and I am working hard to fix that.

Scarlet_pot2 OP t1_jed9mxw wrote on March 31, 2023 at 4:15 AM

I see your point about tailoring foundational models. The problem is that, do you think companies like OpenAI and Google are going to allow regular people to tailor train their models however they want? It's debatable. Even in the best case the corps will still put some restrictions on what and the models are tailor trained.

The best way to get around this is have open source foundational models. To do this you need available compute (people donating compute over the internet) and free training (free resources and groups to learn together). I'm sure tailoring corporate models will play a role, but if we want true decentralization we should approach it from all angles

NakedMuffin4403 t1_jeda9l7 wrote on March 31, 2023 at 4:21 AM

>The best way to get around this is have open source foundational models. To do this you need available compute (people donating compute over the internet) and free training (free resources and groups to learn together). I'm sure tailoring corporate models will play a role, but if we want true decentralization we should approach it from all angles

It's not debatable as SaaS is going to be commodified and models are going to be the new hot thing.

This is a major paradigm shift from SaaS to MaaS (models as a service).

What's terrifying and exciting is that at some point in the future, there will barely be any proprietary software. Most software will be easily replicable with SIGNFICANTLY less engineers given the productivity boost of AI.

Imagine remaking a $100B Stripe with just $100m and 1/100 the human capital.

The MaaS providers are kind of like the people selling the shovels in a gold rush (and the silicon fabs are enabling the shovel sellers).

The software companies that will remain "proprietary" are going to be those that can implement AI more effectively than others, and those who have network effects like social media apps for instance.