Submitted by pumpkinsmasher76 t3_xz8x57 in MachineLearning

I applied to PhD programs this past cycle and was rejected by all. I plan on trying again in a future cycle but was wondering how I can gain experience related to ML/NLP especially given that I have already graduated. My GPA was a ~3.3 and while I do have some research experience (mainly a data science REU in my senior year) I didn't get much exposure to anything ML related until taking a graduate level NLP course in my last semester.

I did some side work with a professor and another project with a couple of postdocs but this was either short term or dropped off as my full time job began to take up more time. Right now I'm still looking to see how I can gain experience in this exciting field while I'm still working. Should I continue to ask professors in nearby universities even though I'm not actively enrolled as a student. Or could I also ask those in my current company (even though they aren't necessarily as involved research-wise)?

9

Comments

You must log in or register to comment.

jfrankle t1_irlqzoi wrote

(I'm a professor at a major CS program.) Applying to a PhD program is applying to a job. You have to:

  1. Describe what job you're applying to (i.e., what you want to work on). I have to think this is a worthwhile and relevant enough job to be interested in potentially admitting you.
  2. Make the case that you (and especially/uniquely you compared to the broader pool) are qualified to perform that job. (Your background, your research experience, your letters.) I have to think you're (especially/uniquely) qualified to admit you.

In fact, it's applying to more than a job. When I hire researchers at my company, I definitely don't expect them to stay for 5+ years, and I know that I can tell them to leave in the rare/unfortunate circumstance that it's not a good fit. For a PhD applicant, I'm making the commitment to hire you and keep you employed for five years no matter what. That's a really high bar, and it should be if I want both of us to be successful.

And, strangely, despite this significant commitment, the PhD admissions process is often lower-touch than a job interview. I get to see a personal statement and some letters of reference, and I might get to interview you, but certainly not at the level of rigor of an industry job.

Bottom line: from my point of view as a faculty member, PhD admissions is a job application, except the stakes are even higher because the commitment is bigger. If you have a mediocre GPA and a tiny bit of irrelevant research experience, I can see why that doesn't cut it.

So what do you do?

  1. You need to have a clear sense of the job you want to apply to. That means reading papers, watching talks, attending conferences where possible, and developing specific research interest and specific opinions on what we should be doing scientifically that we're not doing. This is all stuff that you can hypothetically do on your own, but it goes much better with a community. Coming to lab meetings for a local university lab is great. Attending talks from the ML Collective is also great. There are organizations like the ML Collective that you can get involved in so that you have a research community no matter where you are or where you work. The result of this effort won't be lines on a CV: it'll be a really compelling statement of purpose that lays out the important work you think needs to be done and that you want to accomplish. This isn't a contract that you'll work on that one thing, but it's a way to convince me of the existence of a path through your PhD that can lead to success.
  2. You need to be qualified to do that job. This is the harder part - what you understandably appear to be struggling with. The most direct way to get this experience would be to do a full-time master's, especially at a place that offers funded master's degrees (Princeton, Cornell, CMU, and MILA come to mind as places with many or all funded master's degree students, but there are probably many others). You don't need a publication, and you definitely don't need five. (Publications can actually be unhelpful if you're nth author on something unrelated to what you want to work on or if you have so many publications that it's unclear what your focus is.) The important part is having meaningful research maturity and the technical expertise necessary to get started on the job you've described (and letters from reputable people - who have worked with enough students to have a basis for comparison - to back that up). All of the students I admitted last year were in master's programs but didn't have first-author publications. But their experiences in their master's programs (and the letters backing that up) convinced me they were mature researchers with big ideas and the technical skills to pursue them. This will be reflected in your CV, your letters, and your statement of purpose. Short of doing a full-time master's, research experiences through work or part-time with a lab can also work. And, at the end of the day, you may need to consider changing jobs to something that will allow you to accumulate the experiences you need.

Finally, you should ask yourself whether a PhD is what you want/need. There are plenty of ways to get a PhD's worth of experience in industry research roles without needing to make the sacrifices attendant to a PhD. At least, if you don't want a job (like being a professor) that requires a PhD.

27

fhadley t1_irl88gf wrote

I might look into masters level programs before applying to another round. I think you'll find that your GPA is at least as much of a barrier to entry as your lack of research experience WRT PhD programs- at least those that are worth 5+ years of your life. Get an MS, ideally from somewhere reputable, but more importantly, crush every single task you're assigned. If that proves infeasible, perhaps reconsider.

ETA: This is a bit harsh, but why would someone want to work with you when you have so little ML exposure? I meant there are nigh on infinite ways to learn this stuff outside of coursework. I mean I do this nonsense for a living (granted, my research is very applied and very business-driven) and, big homie, I ain't got but an associates. I'd say don't be out here with this "I can't get exposure because I already graduated," that's a bad look.

8

pumpkinsmasher76 OP t1_is9thf4 wrote

That's what I'm trying to address is the research experience; I'm trying to find ways that I can gain such experience having already graduated. The GPA is probably the least of my worries since I can't change it (part of the reason it was so low was a dip because of a rough junior year).

1

fhadley t1_isav89n wrote

Well my point kind of was that you can change your GPA. Enroll in a master's, absolutely murder your coursework, and not only will your gpa improve overall, but also the improvement will come from coursework that's far more relevant to the grad school admissions process.

1

pumpkinsmasher76 OP t1_isb2nks wrote

Even then, I still need more (research) experience in ml/nlp if I want to pursue a phd in that area as well as get recommendations for such.

GPA isn't really the priority for me (it's not so deathly low and the reason it's as it is is because of a couple dips feazan and junior years as I said). Gaining more research exp is

1

fhadley t1_isbdpv7 wrote

It's much easier to find those opportunities when you're already in an academic setting. But I don't think I or anyone here is going to give you the answer you want to here, frankly.

1

trendymoniker t1_irl6lhy wrote

What are you interested in?

1

pumpkinsmasher76 OP t1_ishz937 wrote

Text or sentiment analysis. Particular in application to issues such as psychological issues or those in education.

1

rexstiener t1_irl7ogr wrote

Apply for research internship roles . That might help , narrow down ya research topic , get acquainted with skillset like ml dl nlp pt python , get some kaggle ranking most importantly you need to exhibit research aptitude to professors

1

pumpkinsmasher76 OP t1_is9tl4p wrote

I already graduated so not sure if I can still do such (I'm in the US already).

I do have kaggle and I do try looking into such in my spare time.

1

rexstiener t1_isa4gbh wrote

You can apply for pre doc roles in US

1

pumpkinsmasher76 OP t1_isftpge wrote

See my reply to another comment, most of the roles I've applied to are either insanely competitive or for other fields like economics.

1

rexstiener t1_isfye1a wrote

Applied science internship, research assistant @ ivy leagues . First you need to speak to a professor via email presenting ya portfolio that how your research under his supervision will provide value to him , for that you need to research papers publication as evidence & then if professor agrees to advise to you , go thru the formalities. If you want to work with anyone its two way street it needs to benfit both the people often called WIN-WIN situation. Consider yourself lucky being in US a land of opportunities for STEM . Good luck

1

rexstiener t1_isfzb05 wrote

Competition is there , you need to prove you are competent in either way . Speak to those who have done phd in CS understand perspectives most importantly if you have or develop research aptitude you dont need a phd degree 5 yrs in school would be waste of time. MS with thesis should suffice , in US there are lot of applied scientist roles which take undergrads . The country i come from has just 5-10% opportunities in research compared to US & salary is horrible

1

rexstiener t1_isfzrch wrote

Kaggle is for engineers quiet honestly. Its not meant for researchers

1

Coco_Dirichlet t1_irlahv8 wrote

This is not just about your lack of research experience, it's a compounded problem because what are professors going to write in their recommendation letters?

(a) Your GPA is low so did you standout in the class of those writing your letters; strong letters compare you to other students (you are in the top % of students they have taught in the past X years) and even better to other students who got admitted to PhD programs.

(b) You want to apply to PhDs with a focus on ML but have only one ML course. Yes, taking a grad student class is good, but it's one course.

(c) The research experience with the professor/postdoc wasn't enough to make any contribution. So that professor whatever that professor can write is not going to be enough.

Experience at your place of work is not going to be important because there's nothing you can show in your application. It'd only matter if (a) you were working in a place like DeepMind and were a coauthor in some paper, (b) your manager had a PhD and tons of publications, so someone in academia knows them and would believe this person when they said "this person would be successful in your program".

One option is to find a full-time job as an RA at a Lab. It won't pay much but you'd be getting experience, you can audit some classes, and you can get a much better letter.

Another option is to do masters. If you decide to go for a masters, then you need to really focus on class size, whether the professor is going to be someone who is a full-time professor (so no an adjunct or someone with a masters) whose letters would matter for a PhD application.

But really think why you want the PhD.

> Should I continue to ask professors in nearby universities

I doubt professor will respond requests from someone they don't know. Taking someone as a RA is work for them or their postdoc, because they have to train you, oversee your work, etc. You are not doing them a favor by working for free. At least with their own students, they can get some funding or it's part of their job because they are students enrolled in their program.

1

pumpkinsmasher76 OP t1_is9v0x1 wrote

(a) as I mentioned in another comment, part of why it was so low was there were a couple dips freshman junior year that I had to recover from. As far as the letters, one of them was from a class I TA'd which I actually failed on the first attempt and had to retake.

(b) undergrads from my program generally only had one ml class with maybe an nlp course offered as special topics. I actually did something unconventional compared to other undergrads but yes this is a valid point. I did take a couple of other AI/Logic/data science related courses but still.

(c) I did have an REU in data science that I did get a recommendation from. Other experiences included working with a professor and later a couple of postdocs on separate (side) projects while I was employed

I have been looking for full-time research related positions but it's more confusing where to look compared to an average software development job. If you have any leads or examples of such RA jobs I'll be happy to hear about them.

1

Coco_Dirichlet t1_isbdj0s wrote

Start by asking people who wrote your letters about what opportunities they know about. Maybe they received an email through a listserv (many conferences and associations have them). Also, ask them advice on how make your application package stronger.

Google works like: predoctoral fellowship "computer science"

This is an example of what you'd get from a search like that: https://allenai.org/predoctoral-young-investigators

There are more.

There's also this website that has more of this predocs and RA ooportunities: https://predoc.org/ -- Some are data science with applications to social sciences; also, check information about applications and free workshops. Even if it's not specific to ML, it's still useful.

Also, make some saved searches on LinkedIn for universities and computer science. Some Labs will put their Lab searches there.

1

pumpkinsmasher76 OP t1_isftkhr wrote

I have heard of and applied to Allen AI at least a couple of times but coming from a Top 40 undergrad these are people from like top 20 if not top 10 undergrads who get into this.

For the other website that's more for economics students where pre-docs are more common. I have also applied to a few of these myself with not much luck. Maybe an ínterview if I'm lucky.

1

GinoAcknowledges t1_it5g8vi wrote

OP, I was in the same spot a couple of years ago. You're facing an uphill battle. The reality of it is that academia is a very closed world, and you'll find it very difficult to get in unless you have any of the following: (a) an elite college background (b) publications (c) personal relationship with a potential advisor.

Realistically, (a) and (c) are not attainable. I was in the same position. But I was able to get into a top 15 ML PhD program after a couple of years of sustained effort. Look into two things: doing a masters program at a good uni for CS (use csrankings.net, notice that many of the most productive CS schools aren't super difficult to get into) and most importantly — getting published. You don't need to get published at a top conference like NeurIPS or CVPR. As a non-PhD student, if you can get 1-2 workshop papers (very easy, workshops have like a 50% acceptance rate) and a paper at a lower tier conference (again, high acceptance rate, like 50%), you'll be in a very good position. This is how I did it. Combine that with reaching out to potential advisors beforehand and you'll have a extremely good shot at getting in and having your pick.

Let me know if you need any more advice.

1

pumpkinsmasher76 OP t1_itdwmay wrote

I'm probably thinking of a couple ms programs. I have graduated so any other ways to do research with profs and gain relevant experience since I've been out of school for a couple years now?

1

GinoAcknowledges t1_itgk5nt wrote

If you have the time, reach out to professors and ask if they have internships at their lab. If you have the financial resources, you can mention that you’re not looking to get paid. Again, this will work best if you already have some previous research you can show that attests to your research ability.

In my case, I did research on my own before reaching out to potential advisors. They were all impressed by me having published papers on my own. I want to emphasize that publishing on your own isn’t difficult especially if you target conferences that are lower tier (look up ML conferences by acceptance rates) or workshops at top conferences (CVPR, NeurIPS, etc). You don’t even have to publish, having a high quality paper on the arXiv is often good enough.

That would be my recommendation to you. DO NOT wait for a mentor to take you under his wing or a professor to “help” you with research. They will not do that. Most of them are super busy and are looking for someone who can immediately jump in on a project and know what to do. I promise you that you’re smart enough to start doing research now, and if you start now it will be immensely easier for you to get opportunities 5-6 months from now.

1