Viewing a single comment thread. View all comments

Ggronne OP t1_j7aj3co wrote

I have written small web scrapers for different applications, but none were based on theory. An upcoming project requires more extensive information retrieval and I would therefore like to get a better foundation.

I will start with Introduction to Information Retrieval, thanks!

I will start with Introduction to Information Retrieval; thanks!

1

matth0x01 t1_j7ayc9e wrote

Seems that you are more interested on the crawling and ETL side.

Maybe you should look more into Data warehouse or Data lake literatur. Especially the shift in paradigm from ETL (extract, transform, load) to ELT (extract, load, transform) respectively schema-on-read.

2

Ggronne OP t1_j7bg7r1 wrote

Thanks! Can you recommend any good resources for ELT (and ETL)?

1

matth0x01 t1_j7c3smm wrote

Sorry, my library seems a bit outdated on that side.

But the one from Wikipedia looks great at first sight. Ralph., Kimball (2004). The data warehouse ETL toolkit : practical techniques for extracting, cleaning, conforming, and delivering data

1