Comment by nl
4 years ago
I haven't seen any evidence that leading edge research is anything but public.
The leading labs (Google Brain/DeepMind/NVIDIA/Meta/Microsoft/OpenAI) all publish in the open.
I'm excited by three things:
This emergent phenomenon thing - as we build bigger models there is a step function where they suddenly develop new abilities. Unclear where that ends.
The work people are doing to move these abilities to smaller models
Multi-modal models. If you think this is impressive just wait until you can do the same but with images and text and video and sound and code all in the same model.
Do you ever wonder about what military may have in terms of sophistication compared to enterprise? What are your thoughts on the emergent phenomenon in the class of metaphysics, philosophical, and outlier conditions? Is it plausible that language is in of itself what consciousness is? Is language a natural phenomonea of the universe (an analog of pattern being a representation of a pattern and all things that can sense a signal are essentially patternening entities).
> Do you ever wonder about what military may have in terms of sophistication compared to enterprise?
No. It's pretty clear what the state of the art is.
For the rest of your questions I'd say I do spend a lot of time thinking about what intelligence is.