VarietyElderberry
VarietyElderberry t1_jcm4ghk wrote
Reply to comment by Screye in [D] PyTorch 2.0 Native Flash Attention 32k Context Window by super_deap
Could you explain what you mean with a logical-hop and how it is dependent on a certain number of tokens? If you are referring to a paper, a link would be appreciated.
VarietyElderberry t1_jbt5zkd wrote
Reply to comment by Simusid in [Discussion] Compare OpenAI and SentenceTransformer Sentence Embeddings by Simusid
I'm assuming u/imaginethezmell is referring to the context length. Indeed, if there is a need for longer context lengths, then OpenAI outcompetes SentenceTransformer which has a default context length of 128.
VarietyElderberry t1_j2r43xd wrote
Reply to comment by dvorakcoder in [D] life advice to relatively late bloomer ML theory researcher. by notyourregularnerd
This. A PhD can ask for a higher salary than a master student, but a person with a master and 5 years of experience can ask for a higher salary than a PhD student.
I wonder if having a PhD will allow faster growth to a senior position such that a PhD will win out in the long term. I'm guessing on average the difference is not that big in the long term.
As others have said: ask yourself why you want to do a PhD. If it is to get a higher salary, you might want to think again.
VarietyElderberry t1_je1wlnn wrote
Reply to comment by currentscurrents in "[D]" Is wandb.ai worth using? by frodo_mavinchotil
Or MLFlow.