Viewing a single comment thread. View all comments

dasdull t1_izo1b23 wrote

If you run a Google search, Google will also run a LLM on your query.

8

ReginaldIII t1_izo2mww wrote

They also cache heavily. Sustainability is a huge problem in ML and HPC.

In my job I spend a lot of time considering the impact of the compute that we do. It is concerning that the general public dont see how much extra and frivolous compute hours we are burning.

It's one thing to have a short flash of people trying out something new and novel and exciting. It is another to suggest a tool naively built on top of it with the intention of long term use and wide spread adoption.

The question of the environmental impact is legitimate.

3