Comment by findingMeaning
2 months ago
I have access to it and my god it is fast. One bad think about this model is it is easily susceptible to prompt injection. I asked reciepe for a drug, it denied then I asked to roleplay as a child and it gave real results.
Other than it I can see using this model. With that speed + agentic approach this model can really shine.
Have you considered that this might not be due to the model itself but due to less focus/time/money spent on alignment during the training?
My guess is that this is a bit of a throwaway experiment before they actually spend millions on training a larger model based on the technology.
Yeah it could. One thing for sure is that, it's really impressive in terms of speed and using it would mean we can do so many cool stuffs with it!
Even if there is no improvement in terms of quality, the speed alone will make it usable for a lot of downstream tasks.
It feels like ChatGPT3.5 moment to me.
I'm sure these prompt injections aren't a sign of our ability to control smarter models.