In German this command could be interpreted as "you son of a whore"

I hope he makes a video about it!

Backpropagation requires a lot of accuracy so we need 16- or 32-bit while training. However, post-training quantization seems to have very little impact on the results. There are different ways in which you can quantize but apparently llama.cpp uses the most basic way and it still works like a charm. Georgi Gerganov (maintainer) wrote a tweet about it but I can't find it right now.

With 4-bit quantization you could run something that compares to text-davinci-003 on a Raspberry Pi or smartphone. What a time to be alive.

They managed to run the 7B model on a Raspberry PI and a Samsung Galaxy S22 Ultra.

Yes, at least if I read the documentation correctly.

>Battery technology is largely ignored in the mainstream conversation about renewables

I believe that will change very quickly as more countries transition to +50% renewables.

Ah, I thought you meant that video and audio would be the next step for text mining.

I believe OpenAI confirmed that they already work on a text to video model. My guess would be that current algorithms could do that but that it would be far to expensive to train on videos.

Also spoken words differ a lot from thoughtful written text. Training on the 1:1 transcription would yield bad results in terms of grammar and readability. They could solve this by using a GPT model to rewrite the transcription but then you're training AI on AI which could lead to bias.

As a German born in Germany it's still very surprising sometimes. When looking for IT internships within my area I found so many companies whose names I've never heard that are global leaders with their products. Also every little small village (~5k population) has its own so called Industriegebiet (industry area) that houses lots of such businesses and their suppliers.

I wish this culture had transitioned into the digital age but except for SAP very few German IT companies got big this way.

Listen buddy if you want to discuss whether lock down strategies make sense or not you can do that but in the case of Switzerland the by far most relevant factor is the excellent backing of the Swiss Franc.

That's not the reason for why their inflation is so low. Switzerland has backed 95% of the Swiss Franc with Gold reserves. When the Swiss Franc inflates they just trade the Gold for their own currency and buy it off of the global markets. The result is a decreased supply of Swiss Francs in foreign markets. Scarce supply means an increase in value therefore counteracting inflation.

I believe the ECB (and most other countries) have backed their currency by less than 10% which makes it much harder to counter steer inflation.

I'm 2nd semester studying AI/CS and I don't have a deeper understanding of chemistry. My battery/economic knowledge mostly comes from university talks on youtube and further researching ^(*googling*) stuff I don't understand. Statistics and maths from my actual studies come in handy even though I'm pretty average at them. It's like a rabbit hole. You start with a simple video that gets you interested and after that you just google all the new keywords and read about them. Tesla > Tesla drivetrain > Tesla battery > Tesla 4680 battery cell > cylindrical battery cell > cylindrical vs. pouch cell > solid state battery > NIO solid state battery > Daimler eCitaro solid state battery > battery lifecycles > battery properties > battery composition > LFP battery > M3P battery > CATL company > Sodium-Ion battery ................

Learning about researchers and institutes also helps me to get a deeper understanding of the current scientific discussions going on etc. It's always important to not fall for researchers that just say stuff because they work for a certain company or similar.

The same thing is possible with every (new) technology. Renewable hydrogen, alternative energy storage solutions, solar panels, wind turbines, nuclear reactors (<- spicy topic), AI, programming languages, it-security, batteries, mechanics of a central bank...

Of course none of it will ever make up for an actual degree in one of these fields but that is not the point. It's just a fun thing to do.

Edit: i forget to mention that most battery stuff I know comes from the KIT/HLU channels on youtube but they are 100% in German.

Yes all of the car batteries currently use Lithium which is why it's typically not explicitly mentioned when listing battery compounds. You might want to look into Sodium-Ion batteries. With those batteries the Lithium-Ions will be replaced by Sodium-Ions. Right now its properties aren't good enough to replace Lithium in most use cases but we'll see them coming extremely popular in the next 3-5 years. That doesn't mean you should invest in Sodium tho. Sodium is 500 times more abundant in earths crust than Lithium (basically salt in the ocean = Sodium). It's so much and so cheap to extract that prices will likely stay cheap even with demand skyrocketing. My bet would be to either invest into battery companies itself or the suppliers of Sodium. Right now CATL (biggest battery company) is pioneering Sodium-Ion batteries but investing into them is dodgy because it's a Chinese stock. It's hard to say which company will take the lead especially since there is also some potential left in Lithium-Ion batteries which could delay Sodium-Ion batteries taking over the market. The more expensive Lithium gets the faster will companies push for a significantly cheaper Sodium alternative.

I'm also not sure how well the market has already adjusted prices for future breakthroughs. I don't think it's an over hyped technology but it's definitely not a secret tip either.

When looking for companies you might also want to think about the applications the different batteries have. Since Lithium is very energy dense it's mostly used in products that don't offer a lot of space for the amount of energy required (phones, laptops, performance cars). On the other hand as of now Sodium batteries are not as dense while being cheap which is why they make a perfect fit for home/mass electricity storage.

On a side note: you may also want to look into recycling companies. Today only very few batteries are recycled but that's only because electric cars/electricity storage wasn't a thing in 2010. However, 10 years from now battery recycling will grow exactly as fast as the electric car market is growing right now. It's just a delayed boom.

That was a longer comment than I anticipated... As a poor student I can't afford to invest which is why I have the urge to put my thoughts out there whenever I can haha

No Ultium is not even an element. It's an arbitrary name made up by the marketing people. Technologically there is no significant breakthrough here. They added a very small amount of Aluminium to the default Nickel, Cobalt, Manganese battery composition and that's it. It's cheaper to produce and probably offers longer battery life but i'd say it doesn't stand out from competitors.