Definitely the latency/speed of JEV would be great here! Unfortunately, Jev doesn't natively take in vision inputs. (So this also means demos you've seen of Jev playing games have given full structured state, which we can't do for actual driving in real time.) We tried hacky things like doing some "System One" Jev + "System Two" GPT 5.6 Luna (or other fast LLM with vision, to not bottleneck the speed) but it isn't working very well. Some open source Jev alternatives with vision exist and we might try those sometime.
Standard interstate highway. You see trees on the side of the road every 60ft. There is a car to your left, a car to your right, a car in front of you and a car behind you. A sign just off the rightmost lane says "Caution". A skeleton wrapped in cobwebs is reaching for a small pot of gold placed right next to it.
Definitely the latency/speed of JEV would be great here! Unfortunately, Jev doesn't natively take in vision inputs. (So this also means demos you've seen of Jev playing games have given full structured state, which we can't do for actual driving in real time.) We tried hacky things like doing some "System One" Jev + "System Two" GPT 5.6 Luna (or other fast LLM with vision, to not bottleneck the speed) but it isn't working very well. Some open source Jev alternatives with vision exist and we might try those sometime.
- Aditya, Tobias, Simon
give it an ascii representation \j
Standard interstate highway. You see trees on the side of the road every 60ft. There is a car to your left, a car to your right, a car in front of you and a car behind you. A sign just off the rightmost lane says "Caution". A skeleton wrapped in cobwebs is reaching for a small pot of gold placed right next to it.
Exits: N W