An integration of OpenAI's Universe AI platform with GTA 5 has been achieved and open sourced.
This video demonstrates the integration. The window at the top left is what the AI agent is seeing. The window at the bottom left outputs the agent's state. And the main window is just an eye candy rendering with a detached camera. A surprisingly competent sample agent trained using imitation learning over just 600,000 frames (about 21 hours) of the game's AI driving is available. Here is a first person view of the sample agent cruising around. Some major potential here and it's great to see open source software and AI meshing so well.
Videos created by DeepDrive.
Related Stories
New AI fake text generator may be too dangerous to release, say creators
The creators of a revolutionary AI system that can write news stories and works of fiction – dubbed "deepfakes for text" – have taken the unusual step of not releasing their research publicly, for fear of potential misuse.
OpenAI, an nonprofit research company backed by Elon Musk, says its new AI model, called GPT2 is so good and the risk of malicious use so high that it is breaking from its normal practice of releasing the full research to the public in order to allow more time to discuss the ramifications of the technological breakthrough.
At its core, GPT2 is a text generator. The AI system is fed text, anything from a few words to a whole page, and asked to write the next few sentences based on its predictions of what should come next. The system is pushing the boundaries of what was thought possible, both in terms of the quality of the output, and the wide variety of potential uses.
When used to simply generate new text, GPT2 is capable of writing plausible passages that match what it is given in both style and subject. It rarely shows any of the quirks that mark out previous AI systems, such as forgetting what it is writing about midway through a paragraph, or mangling the syntax of long sentences.
More like ClosedAI or OpenAIEEEEEE.
Related: OpenAI 'Universe' Platform Provides Means to Link Image Recognition Vehicular AI Agents Into GTA 5
The OpenAI Dota 2 Bots Defeated a Team of Former Pros
(Score: 0) by Anonymous Coward on Tuesday January 17 2017, @10:01PM
meshing with an open source game just as well?
Silly to run open source software if the training application is wholly proprietary, as all GTA games since 1 have been.
(Score: 3, Funny) by maxwell demon on Tuesday January 17 2017, @10:07PM
You don't see the true depth of the project. Sure, as of now the AI just learns playing the game. But as a next step they will teach the AI game programming, and then based on its playing experience, it will recreate the game in Open Source! :-)
The Tao of math: The numbers you can count are not the real numbers.
(Score: 1) by charon on Tuesday January 17 2017, @10:48PM
(Score: 3, Interesting) by ledow on Tuesday January 17 2017, @11:25PM
Is it just me that's not particularly impressed?
It drives in massive jerks, mis-detects the edges and strays left all the time. It takes no evasive action for the car that overtakes it in the second video. It can't keep up with heuristically-programmed traffic at all, it drives over a crossing without stopping.
There are literally no obstacles in its way, except for one traffic light when it stops a mile back, and then gets (honestly) a bit too close.
To be honest, I don't see what's been achieved here over, say, even primitive edge-detection, finding a perspective-angled line by the side of the road and following, and judging a car in front by the obscured portion of the image to slow gently before you hit it.
And that's working from an image that is basically computer-generated and simplified so the gamer knows exactly where the road lies.
I have to say - as someone who has ALWAYS wanted a game where for some portion you have to drive sensibly to not get caught (ever since playing the original Driver where you had to not attract attention in some missions, but could still drive over the pavement, cut lanes, drive on the wrong side of the road, etc.) - this is feeling 20 years old and still not good enough.
I get that's it's "trained" as such, but from the 8fps samples it's getting, I was really expecting something with 1/8th of a second reactions (vastly outweighing a human driver), but it's like watching your grandma drive in a broken car. And the stream is actually getting and reacting on seems incredibly low-res and poor quality for the job at hand, and the actions available to it incredibly simplistic and laggy.
I honestly think you could run the PC version of Driver and do a better job interfacing with it, with cross-traffic and all-sorts.
The best thing I've ever seen in this area - and I cannot find it anywhere any more - was someone's PhD project for genetic algorithms. It was an object with joints and "bones", in a simple 2d physics environment, laying on a surface of random elevation. It showed four candidate algorithms, one in each quarter, and each algorithm determined when to move a joint. In generation one, all it did was twitch its joints like a dying insect. By rewarding algorithms based on the distance covered, and "breeding" them with other successes, in a handful of generations, it was slinking across the floor. In a hundred generations, do-able on an early Pentium in a handful of minutes on something with a physics engine written in Java, it was sprinting over the floor (collapsing occasionally still). In hundreds of generations, it was performing the weirdest kind of movement that propelled it at stupendous speeds and was able to recover when it stumbled. Just by twitching a virtual muscle connecting two virtual bones.
By comparison, the integration, the algorithm, the learning, the processing and the throughput of this just sucks.
A Pentium was breeding algorithms, four or more at a time, executing physics, in four different sandbox worlds, in Java, hundreds of generations in minutes, and achieving more control and success over the output than this things could manage. And that must have been over 15 years ago, because I found that when I was in uni studying Computer Science, including AI.
(P.S. If ANYONE can find that for me again, though I suspect it was a post-doc's work from a uni that disappeared from the net when they moved on, please do shout. The emphasis was on the word "gait" and generally breeding algorithms to make random agents with genetic selection criteria make a skeleton move).
(Score: 2) by ledow on Tuesday January 17 2017, @11:32PM
Not dissimilar to:
http://rednuht.org/genetic_walkers/ [rednuht.org]
but that's not it.
(Score: 1) by charon on Wednesday January 18 2017, @03:20AM
(Score: 0) by Anonymous Coward on Wednesday January 18 2017, @04:50AM
Their goal is not to program a vehicle to drive in GTA, but to develop general purpose algorithms that 'program themselves' colloquially speaking. The day this platform is capable of creating a compelling and viable driving AI based on 600,000 frames of driving is the day you could literally take video of you driving around in the real world in a variety of conditions and environments - apply the same learning system and have a self driving vehicle ready to go. Beyond that, the imitation learning agent was not meant to be 'good.' Even the training was completely minimalized in volume. It was specifically a starting off point for further research and development. The fact there's even a notion of driving on the road (which the AI has no hard-coded notion of) or not crashing into other things, again something the AI has no notion of is incredible.
Or take the thing you mention about the AI slowly creeping up to the other vehicle when at a stop and then ultimately getting too close. Once again the AI has no hard coded means of estimating distance from another object or even whether that is an object that it should go around or wait behind. This is all 'emergent' from the training and that is all incredibly impressive.
(Score: 3, Insightful) by Dunbal on Tuesday January 17 2017, @11:45PM
AI is totally playing GTA wrong...