No, but the skills Google needed (back then) were just normal programming and sysadmin skills scaled up. I had eight interviews that covered Linux sysadmin, programming, debugging, networking, maths and more. If Google hadn't wanted me there'd have been plenty of other companies who needed those skills.
If you look at model training jobs a lot of the work at this point is creating RL gyms (normal programming work), but most people still think the work is all neural architecture research. Doing the former is fine but won't teach you much about how to build LLMs, whatever that means now. Doing the latter is a very hard market to get into: not many jobs and requirements are often like, "you must have published at one of the following conferences". Prior experience is assumed. Most of them seem to treat Google as ML university and source of new recruits. It's understandable given the cost of training runs.
> requirements are often like, "you must have published at one of the following conferences".
I'm not sure why it's like this. If you look at the real world, you have stuff like ggml, which is about as hardcore as it gets in the LLM space, and it was made buy just a guy. Same for this like ComfyUI
If you get enough academics in a place, they tend to close rank, and not let anyone in without the same credentials. Data science used to be like this, they were constantly on about how you need a Math Phd to even apply, yet when I met these guys IRL, most of them were just running Python math libraries.
These previous examples show that if you understand at least a part of the problem space, you can 100% contribute without academic credentials.
You can do it at home, for sure. I've done some NanoGPT training runs and modified the architecture, it wasn't that hard. Came up with some potential research ideas too. It does take money for GPU rental so for a 17 year old, it's not so easy unless their parents give them a budget. For an adult with income you can do it.
The question is more one of opportunity cost. At 17 you need to start finding your way in the world. It's best to learn skills lots of people need.
No, but the skills Google needed (back then) were just normal programming and sysadmin skills scaled up. I had eight interviews that covered Linux sysadmin, programming, debugging, networking, maths and more. If Google hadn't wanted me there'd have been plenty of other companies who needed those skills.
If you look at model training jobs a lot of the work at this point is creating RL gyms (normal programming work), but most people still think the work is all neural architecture research. Doing the former is fine but won't teach you much about how to build LLMs, whatever that means now. Doing the latter is a very hard market to get into: not many jobs and requirements are often like, "you must have published at one of the following conferences". Prior experience is assumed. Most of them seem to treat Google as ML university and source of new recruits. It's understandable given the cost of training runs.
> requirements are often like, "you must have published at one of the following conferences".
I'm not sure why it's like this. If you look at the real world, you have stuff like ggml, which is about as hardcore as it gets in the LLM space, and it was made buy just a guy. Same for this like ComfyUI
If you get enough academics in a place, they tend to close rank, and not let anyone in without the same credentials. Data science used to be like this, they were constantly on about how you need a Math Phd to even apply, yet when I met these guys IRL, most of them were just running Python math libraries.
These previous examples show that if you understand at least a part of the problem space, you can 100% contribute without academic credentials.
It does sound quite hard if that’s the mentality you’re approaching it with.
You can do it at home, for sure. I've done some NanoGPT training runs and modified the architecture, it wasn't that hard. Came up with some potential research ideas too. It does take money for GPU rental so for a 17 year old, it's not so easy unless their parents give them a budget. For an adult with income you can do it.
The question is more one of opportunity cost. At 17 you need to start finding your way in the world. It's best to learn skills lots of people need.