tomiwa1a

tomiwa1a t1_j6bb8e8 wrote

Exactly! This is how it works.

I agree it's not perfect, but remember, Youtube itself is not a library so any comparisons to real libraries will require some degree of approximation. You can think of it as an approximate estimate or my preferred term, a Fermi Estimate.

1

tomiwa1a t1_j6bapiz wrote

The reason that happens is because unless someone has previously submitted a youtube video with "I gotta have more cowbell" we won't have it in our index.

​

>The transcripts get added on-demand when users request to search for a video. It wouldn't make sense to index the entire database given it's large size. We're also able to get the transcripts pretty quickly, so there's no need to pre-cache the transcripts if a user has never asked for it before.A more detailed overview of how it works can be found here:

  1. https://www.reddit.com/r/OpenAI/comments/10j3gzy/comment/j5jh0wo/?utm_source=share&utm_medium=web2x&context=3
  2. https://atila.ca/blog/tomiwa/atlas

See: earlier comment

1

tomiwa1a t1_j6bagzz wrote

Thanks! The transcripts get added on-demand when users request to search for a video. It wouldn't make sense to index the entire database given it's large size. We're also able to get the transcripts pretty quickly, so there's no need to pre-cache the transcripts if a user has never asked for it before.

​

A more detailed overview of how it works can be found here:

  1. https://www.reddit.com/r/OpenAI/comments/10j3gzy/comment/j5jh0wo/?utm_source=share&utm_medium=web2x&context=3
  2. https://atila.ca/blog/tomiwa/atlas
1

tomiwa1a t1_j6ba59m wrote

  1. The other interesting piece is that Library of Congress was founded in 1800 (though a fire caused it to restart it's collection in 1815).

Youtube was founded in 2005.

So in just 17 years, Youtube has amassed a collection of information that is 57% the size of the world's largest library which has been accumulating it's collection for over 200 years.

​

  1. I'm also Canadian. Hadn't heard of it either until we did this report. We probably haven't heard it because we likely won't need to use any of it's resources. Public libraries already do a really good job for most of our day to day needs.

  2. Wikipedia's small size makes sense given that contributions are heavily restricted and have such a high bar. Imagine if every Youtube video had to be approved by a editors before or every author had to have their books approved by editors before publishing.

1

tomiwa1a t1_j6b8wnz wrote

Can you please clarify? what do you mean by it isn't clear how books on Youtube is calculated?

If you check this range you can see how we arrived at our numbers:

  1. We calculated the number of hours of video uploaded to Youtube every minute from 2007-2022 source: statista
  2. We found how many words are spoken per hour of human conversation source: virtualspeech
  3. We calculated the number of words in the average book source: jericho writers

Then we did some calcualations with those numbers to arrive at 99,338,400 books on Youtube

1

tomiwa1a t1_j6b8gcr wrote

2

tomiwa1a t1_j6b80iu wrote

I don't think it's fair to say that comparing Youtube to a Library is like comparing Mt. Everest to a Cow. For one thing, there is actually a pretty clever way to estimate the amount of text on Youtube and compare it to the amount of text in a library.

Maybe, if I explain how we made the graph you'll see that it's more apples to apples than mountains to cows:

  1. We calculated the number of hours of video uploaded to Youtube every minute from 2007-2022 source: statista
  2. We found how many words are spoken per hour of human conversation source: virtualspeech
  3. We calculated the number of words in the average book source: jericho writers

Then we did some calcualations with those numbers to arrive at 99,338,400 books on Youtube

You can see the details of those calculations here: https://docs.google.com/spreadsheets/d/1UbekWhTLJKQj6ZLipg1R269CQ8g0ACDbzPRDFN14inc/edit#gid=52223737

1

tomiwa1a t1_j69prfr wrote

Good point, here’s we got this information.

  1. We calculated the number of hours of video uploaded to Youtube every minute from 2007-2022 source: statista
  2. We found how many words are spoken per hour of human conversation source: virtualspeech
  3. We calculated the number of words in the average book source: jericho writers

Then we did some calcualations with those numbers to arrive at 99,338,400 books on Youtube

You can see the details of those calculations here: https://docs.google.com/spreadsheets/d/1UbekWhTLJKQj6ZLipg1R269CQ8g0ACDbzPRDFN14inc/edit#gid=52223737

Edit: I also have a question about the last thing you said > there’s so much more content than that though

What other content is there?

1