raman_boom t1_iua2lfp wrote on October 29, 2022 at 7:00 PM

Reply to comment by Pancosmicpsychonaut in [D] What are the bottlenecks in your ML project lifecycle? What tools would you like to see more widely used? by Fine-Topic-6127

There aren't any with me, we can use EDA with T-sne and all, but still, I will go ahead and create simple models to try out and see the results.

raman_boom t1_iu87p7v wrote on October 29, 2022 at 9:09 AM

Reply to [D] What are the bottlenecks in your ML project lifecycle? What tools would you like to see more widely used? by Fine-Topic-6127

I am a senior data analyst, working in NLP domain, chatbots .

Most of our current problems are not classical NLP problems like text classification or machine translation. We will think about a business problem and really think it is possible to solve it with ML or stats, but after research, we may not be able to terrific results to convince the product manager to implement it as a feature. May be It could be our poor quality research, but the point is is there any way I could know before hand that a particular problem can be solved with ML.

Another problem is the dataset size, we have limited data set and as usual ML models need more data to give good results, and it would be great if we have a scientific way of telling that if I get n data point my algorithm would work with a particular accuracy.