DARPA, U.S. Air Force fly AI-controlled F-16
119 points by r2sk5t 7 hours ago | 109 comments

1970-01-01 6 hours ago

     All Stealth bombers are upgraded with Cyberdyne computers, becoming fully unmanned. Afterwards they fly with a perfect operational record. The Skynet funding bill is passed. The system goes on-line on August 4, 1997. Human decisions are removed from strategic defense. Skynet begins to learn at a geometric rate. It becomes self-aware at 2:14 a.m. Eastern time, August 29. In a panic, they try to pull the plug.
reply
asdfman123 21 minutes ago
Updated to reflect modern realities:

> In a panic, they try to pull the plug. Skynet lobbyists descend upon Washington. Skynet is reinstated, and later the US declares a new war in the middle east. The Skynet stock rallies.

reply
jerlam 7 minutes ago
This movie is back in theaters for a limited time, for its 35th anniversary!

Assuming that your movie theaters haven't all closed already.

reply
orochimaaru 27 minutes ago
About time. We are a couple of decades late to the apocalypse.
reply
testplzignore 5 hours ago
Interesting coincidence that both this article and the Hugging Face "security incident" post were on July 16. These will be mandatory reading in future Skynet History classes, assuming we survive the war.
reply
t1234s 2 hours ago
This is how AI will solve the paperclip problem.
reply
bloqs 2 hours ago
I read this in Linda Hamiltons voice
reply
justsomehnguy 5 hours ago
I find it quite sombre to see this comment from a peson with that handle.
reply
SaltyBackendGuy 5 hours ago
Ha - this was the first thing that came to mind. I read this in Arnold's voice.
reply
ben7799 5 hours ago
I didn't read it in Arnold's voice till I saw your comment, so thank you.
reply
throw310822 5 hours ago
No worries, these will all be controlled by AIs sitting in orbiting data centers part of the Starlink constellation.

And in any case, no one is building humanoid robots.

reply
lelandfe 2 hours ago
https://xtech.army.mil/competition/xtechhumanoid/

> The U.S. Army is seeking innovative humanoid technology solutions from eligible small and large businesses across the globe to advance toward fielded militarized humanoid capabilities through the xTechHumanoid competition

reply
konart 46 minutes ago
See Robot Fighting Tournament
reply
jagged-chisel 3 hours ago
> no one is building humanoid robots.

https://www.agilityrobotics.com/

reply
bigfishrunning 44 minutes ago
And Boston Dynamics. And Tesla. And Honda.

Lots of people are building humanoid robots.

reply
JanNash 4 minutes ago
This was likely written sarcastically by the original commenter (throw...). Please termimate sarcasm with /s, not everyone is able to read the subtext. Cheers.
reply
aeve890 40 minutes ago
>Skynet begins to learn at a geometric rate

Just geometric? Pfff lame. You don't go ASI with that attitude.

reply
SoftTalker 5 hours ago
> The kit utilizes a novel interface with the aircraft’s flight controls and mission systems, allowing a pilot to toggle between traditional human control and AI control with the flip of a switch. This ensures a safe, reliable environment for human-on-the-loop experimentation.

How, exactly, does that ensure a safe reliable environment? Humans are pretty bad at suddenly taking over when an automatic system reaches its limits and throws a problem in the human's lap. A lot of air upsets and crashes start when the autopilot disengages and hands control of a badly configured aircraft back to a human pilot.

reply
nradov 3 hours ago
These are going to be experienced test pilots who are pretty good at actively managing autopilots and other automated systems. Plus they'll be backed up by telemetry to ground controllers. But ultimately the military is willing to accept some losses in order to advance key R&D programs.
reply
Ccecil 39 minutes ago
Once the AI realizes it can do a maneuver the aircraft can survive but the "bossy meatbag" in the cockpit cannot...
reply
pudgywalsh 52 minutes ago
This stuff actually gets tested, it's not your typical web framework junk.
reply
anthk 17 minutes ago
So did Boeing airtoys, and NASA stuff lend to 3rd parties with no concept of a metric system.

I trust machinery designed from Forth and Lisp hackers with TONS of background on CS science and hardware (and math, up to the point on being THE people creating most "new" technology and old ones such as the Floating Point IEEE standard).

reply
hansmayer 49 minutes ago
[dead]
reply
CrzyLngPwd 29 minutes ago
So, it's a drone with uncessercary baggage such life support and a pilot that can't stand the Gs well.

For some reason I am reminded of Dark Star :-)

reply
alephnerd 28 minutes ago
Pretty much, but it's building on top of the previous QF program [0][1] where the USAF would retrofit retired jets like the F-4 and older F-16s as drones for target training. They used to be remotely controlled but the VENOM platform is testing complete autonomy.

[0] - https://www.af.mil/About-Us/Fact-Sheets/Display/Article/1045...

[1] - https://www.af.mil/News/Article-Display/Article/467196/first...

reply
Zsfe510asG 5 hours ago
The article smells of AI psychosis. They are already "orchestrating".

In the first Iraq war, they went in and won. In the second one, it took years to sort of occupy the country.

Now they struggle against Iran and "orchestrate" F-16s that can be shot down instantly by AA weapons. Since COVID the world has collectively lost its mind.

reply
ACCount37 26 minutes ago
Unless those very F-16s shred their way through the AA weapons first, that is. Or follow up once the stealthier, more survivable platforms pave the way.

Iran had a solid AA system - and the level of impunity with which US operated with over Iran should give every country that wants to rely on its AA a pause. US SEAD/DEAD capabilities are fucking scary.

Of all the things that went wrong with Iran: USAF's capability to get in, punch through AA and rain fires from the sky sure wasn't one.

reply
chasd00 2 hours ago
> In the first Iraq war, they went in and won. In the second one, it took years to sort of occupy the country.

The scope of the first Iraq war was to force them out of Kuwait. That is very different then the invasion of 2003. If you just think about it this should be obvious.

reply
bobthebob 2 hours ago
Oh what a great CIA campaign that would be to give the impression that U.S. military isn’t up to par - to motivate and trick our enemies into making stupid moves while we keep our true cards hidden.

Such a crazy thought.

reply
a34729t 37 minutes ago
You say that, but that's literally a Russian conspiracy theory with Ukraine: The US baited Russia into thinking the US was weak because of Afghanistan, and then Russia got all ballsy and walked into Ukraine and it was a trap.
reply
mohamedkoubaa 44 minutes ago
Decades of utter incompetence somehow ended yesterday?
reply
Jtsummers 2 hours ago
> In the first Iraq war, they went in and won. In the second one, it took years to sort of occupy the country.

The objectives for the two wars were incredibly different, making this an apples to oranges comparison. In the first war, the objective was to push Iraqi troops out of Kuwait (achieved) and then to contain the Iraqi military within Iraq (achieved). In the second war, the objectives were much broader and much harder to achieve. They achieved some objectives (toppling the existing government, defeating the existing military), and then utterly failed in nation building and got into a protracted conflict with state and non-state sponsored military groups.

reply
bluGill 10 minutes ago
I wouldn't call nation building a failure. It made significant progress.
reply
psunavy03 27 minutes ago
Because the most powerful military in the world can only do so much when ordered to execute a crap strategy by civilian leadership. Desert Storm worked because it followed the Powell Doctrine and was bounded to ejecting Iraq from Kuwait. Iraqi Freedom muddled through incoherently because the Bush and Obama administrations didn't want to understand the actual problem set they were faced with, but ultimately ended up with a reasonably stable country after way too much effort and time. Iran is what happens when you have an administration who thinks you can win a war by "just bombing things," which is ironically the stereotype most of the internet has about any kind of military action.
reply
alephnerd 2 hours ago
> The article smells of AI psychosis...

China has been doing something similar since 2020 [0] and something we've experimented [1] on for decades [2][3].

They have traditionally been used as target aircraft for training, but a subset are now being used as testbeds for networked ops.

[0] - https://www.defensenews.com/global/asia-pacific/2021/10/20/c...

[1] - https://www.af.mil/News/Article-Display/Article/467196/first...

[2] - https://www.af.mil/About-Us/Fact-Sheets/Display/Article/1045...

[3] - https://commons.wikimedia.org/wiki/File:QF-4E_GulfofMexico_1...

reply
jimbob45 2 hours ago
https://en.wikipedia.org/wiki/The_Gulf_War_Did_Not_Take_Plac...

Bush Sr knew to keep the foreign-compromised media out of the war and so accomplished the objectives of the war swiftly. Bush Jr had to deal with the media second guessing everything.

reply
FrustratedMonky 5 hours ago
Drones really changed the equation more than Covid. Autonomous F-16's already can win against all human pilots. This would have been big 20 years ago. Now the cheap drones make it not the biggest deal anymore.
reply
justsomehnguy 5 hours ago
> Autonomous F-16's already can win against all human pilots.

In a dogfight?

reply
whartung 5 hours ago
As I understand it, they done this in simulation, and the human pilots did not fare well.

I don't know of the computer aircraft were able to fly beyond human limits (i.e. they don't black out) or not. If the computers can actually fly to what the airframe is capable of, they would have a distinct advantage over the human pilots.

reply
psunavy03 24 minutes ago
The simulator is not the aircraft.
reply
bronco21016 2 minutes ago
The first time an airline pilot flies a new aircraft type in the real world they fly it with a plane full of passengers. All the training up to that point is done in a simulator.

Now that first flight is with an experienced training captain but the point is the simulator is good enough that the FAA has signed off on using that as the primary training device.

It's been this way for at least 25 years.

reply
FrustratedMonky 15 minutes ago
Simulator tech has come a long way. I wouldn't say a simulator invalidates the result.
reply
bloqs 2 hours ago
They did a small set of tests with one Pilot IIRC?
reply
stackskipton 2 hours ago
I think they did it in simulation with several.

In any case, dogfighting is commonly done because it's great training but in most cases, you expect most Air to Air combat being flinging missiles at each other.

reply
rolph 2 hours ago
human pilots have physiological constraints that AI doesnt.

onboard computers are not immune to G's but have a substantially higher threshold until physical mechanisms fail due to strain.

reply
IshKebab 2 hours ago
Is that hard to believe? It's got to be one of the easiest situations for AI to win in. You probably don't even need any fancy modern AI; I would have thought MPC would do most of the job.
reply
bwv848 2 hours ago
[dead]
reply
tokai 5 hours ago
What are you talking about, Iraq fell in a month not years.
reply
codeddesign 5 hours ago
Did it? You mean operational govt fell. The country was fought over for 10 yrs, which the U.S. then backed out.

Israel got a regime change while U.S. tax payers received the bill.

In the end, it’s still a country.

reply
tokai 4 hours ago
I'm not saying that the war didn't go on for 10 years, it did. Baathist government fell and the US led Coalition Provisional Authority took over running the country. You have US troops in the whole country and US control of all civil institutions. The only way that's not "occupying" the country is if you redefine what the word mean. With your definition France, Norway, Denmark, Poland, and many more were not occupied during ww2.
reply
bwv848 2 hours ago
[dead]
reply
thebeardisred 31 minutes ago
The field demo I want to see, Human in the loop to failure switch over: Simulated failure of some form, where (for safety reasons) crew triggers ejection. This defaults the system to autonomous mode and the plane performs a safe landing.
reply
ARandomerDude 18 minutes ago
Auto GCAS (Ground Collision Avoidance System) exists (pre-AI), although it is nowhere near as sophisticated as what you described. Similar type of idea though.

If the pilot passes out during high-g maneuvers, the aircraft will pull up and bring the wings level until the pilot regains consciousness.

https://www.lockheedmartin.com/en-us/products/autogcas.html

reply
odyssey7 2 hours ago
Tangent: is AI a bearable arm?
reply
jvanderbot 2 hours ago
Don't tread on ... my gpu
reply
seydor 5 hours ago
Sounds like a very expensive drone
reply
icegreentea2 5 hours ago
Yes-ish.

There's a lot of different and overlapping programs in play here. I do not believe that autonomous F-16s are intended to be operational assets. That said...

VENOM - program that shows you can bolt on autonomous flight control into a standard F-16. Previously, the X-62A (a one-off prototype based F-16) demonstrated autonomous dogfighting back in 2023.

VENOM provides USAF/DARPA with a lot of high performance autonomous platforms (bolt-on F-16s) that they can then use to develop and validate software, tactics and training for actually fighting with autonomous systems. This would presumably be critical for getting the most of the CCA (aka loyal wingman) programs currently in development.

The AIR program referenced is basically "how do we get autonomous systems to control and fight effectively as a team (presumably arbitrary mixture of manned and unmanned systems) in a beyond visual range fight".

The ACE program referenced was basically "how do we get autonomous platforms to dogfight" with related questions like "how can we augment the human pilot in a dogfight - ie, how can we hand off the actual flying and execution of manoeuvres, and using all of the sensors to autonomous systems, and let the pilot choose actions, instead of hang flying the actions".

reply
Eridrus 5 hours ago
I'm sure there will be a next generation of jet drones that are cheaper, but the autonomy kit here is probably still cheaper than new jet drones.

I think most fully autonomous jet drone programs are also designed to work with a main crewed fighter jet that coordinates them, so there is also a benefit in getting the fighter jet to be able to fly better than a pilot.

reply
cucumber3732842 5 hours ago
More like it'll fly itself while the pilot engages in other tasks.

Every pound of weapons officer/navigator is a pound you can't put on target all else being equal.

reply
wartywhoa23 5 hours ago
"I apologize, that was indeed a wedding party, not a terrorist camp I wrongly assumed. You are totally right, wasting those 3 Hydras was unacceptable. On a brighter side, we've got 39 more to go!

Should I seek another target looking similar to the one I unintentionally destroyed so as to tune my decision-making, or give you an advice on how to wipe the traces of this mishap from the mission data recorder?"

reply
jackb4040 5 hours ago
* You're absolutely right. My altitude is dropping precipitously. Let me check my elevator position to see if that's causing the problem.

* Bash Check elevator position

* Thought for 8s

reply
ErroneousBosh 5 hours ago
So like some sort of automatic pilot then?
reply
cucumber3732842 5 hours ago
Conventional autpilot is like a zip tie on the throttle, only it deals in outputs (your actual heading) rather than inputs (pedals and stick)

I assume what they're going for here is something substantially smarter and more reactive to changing conditions than that. Something that can be used during the "unscripted" parts of the flight during which a) you're most likely to have multiple crew working hard b) you're most likely to be pushing the limits of what one crew can do.

reply
rogerrogerr 27 minutes ago
> Conventional autpilot is like a zip tie on the throttle, only it deals in outputs (your actual heading) rather than inputs (pedals and stick)

What does this mean? I’m a pilot and none of it is making any sense.

reply
throw310822 5 hours ago
Does the presence of humans on board limit the maneuverability of these aircraft in any way? E.g. in terms of acceleration?
reply
rvba 5 hours ago
Yes. Humans can survive 9g for only a few seconds, while a drone could do much sharper manouvers
reply
StableAlkyne 5 hours ago
While they can, drones are still limited by physics.

Sure, the aircraft can pull a ton of G's to defeat a missile or achieve a firing solution. Maybe it even succeeded at that.

It still pulled 9+ Gs and has burned an incredible amount of kinetic energy doing do. And the harder it pulls, the quicker it bleeds speed. It might not be able to defeat the next missile or outmaneuver the other plane's buddies because it is now slow and very likely outside its optimal turning speed.

Even today, missiles can pull dozens of G's yet still are defeatable by humans who can only pull about 9.

reply
ChrisMarshallNY 5 hours ago
But they also have their limits.

Bolts and trusses (and solder joints) have tensile strength limits, but it can be higher than what humans can take.

reply
RIMR 5 hours ago
Drones have human operators. This is a murderbot.
reply
zajio1am 5 hours ago
There are already semi-autonomous drones in Ukraine.
reply
gjskngnf 5 hours ago
It’s a drone. That can kill people.
reply
tyjen 5 hours ago
Human control in flight has often taken a backseat to automation. For example, the SR-71, built in the 60s flew too fast to rely on human decision making for several tasks. If they were off by a fraction of a second, they would miss their intended recon target; so, both the navigation and sensor control were largely automated.

Seems odd to invest this much into AI flight of aircraft designed for manned flight, when it would be better to build craft spec'd for AI flight without human life support systems.

reply
nalthis 20 minutes ago
The way I see it, this is the JDAM of drones. Will it perform better than purpose built aircraft? No. But the USAF has a few hundred old F-16s entering retirement that would be mothballed otherwise, and strapping some cheap sensors to them is a fast way to play around with the idea while they wait for Lockheed and Anduril to finish the good stuff.
reply
jandrewrogers 4 hours ago
The US military has thousands of old airframes, many of which can be made flyable with very short turnaround. They already use the F-16 as test targets.

Taking an obsolete airframe that is already paid for and adding AI to it is much cheaper than building a completely new AI-native airframe from scratch. This is finding a new use for old aircraft. You can send a bunch of old AI-driven F-16s on high-risk missions without worrying about a human pilot or cost. The airframes may be relatively obsolete but can still do plenty of damage on their day.

The new 6th generation aircraft are all being designed as "manned optional". That is probably the last generation with affordances for a pilot.

reply
anonymousiam 3 hours ago
The F16 was the first fully fly-by-wire fighter jet. It's an ideal platform for AI experiments. Having AI "wing men" can be a great tactical advantage, and they're expendable.
reply
IshKebab 2 hours ago
> when it would be better to build craft spec'd for AI flight without human life support systems.

Yeah this. https://en.wikipedia.org/wiki/Anduril_FQ-44

The "see also" section lists several competitors.

I guess if you already have a load of F-16s it might make sense, but I think that's a stretch.

reply
recursivedoubts 5 hours ago

  A computer can never be held accountable

  Therefore a computer must make all unpopular management decisions
reply
wartywhoa23 5 hours ago
This whole AI hype is such a convenient cover for the decisions of the 0.001%
reply
reactordev 5 hours ago
It really is. It's the perfect excuse to do what they please.
reply
LeifCarrotson 5 hours ago
That's not precisely how I remember that quote... But it's on the Internet, so my memory must be faulty.
reply
jauntywundrkind 4 hours ago
With apologies, I don't particularly enjoy when people do this, and I don't think it adds a lot, but I want to leave this breadcrumb, I wrote a post on this a couple days ago here, on an anti-AI screed submission, saying this anti-politic, this accountability denial, is very much the point.

Taking this quote and seeing exactly that potential for abuse seems very very much like the point. Strong agree, strongly against leaving non-seeing non-thinking alien intelligences with no accountability and proprietary programming to judge us. https://news.ycombinator.com/item?id=48965083

reply
chis 5 hours ago
Absolutely terrifying. I'm sure they will soon find that AI pilots defeat human ones in dogfights 100% of the time, since they have faster reaction times, can tolerate higher G forces, and can be perfectly RL trained in the flight sims we already have.

It's really incredible to me that people aren't protesting in the streets over this stuff. Just in the last month we have * AI that goes rogue and hacks billion-dollar companies * AI solving long-standing math problems without any meaningful human help * AI controlled autonomous drones in Ukraine and F-16s in America * AI now represents over 50% of GDP growth in America and yearly capex will soon exceed the size of the $1 trillion US military budget

Is there any line where the public will become deeply concerned? I mean it really all reads like a sci-fi plot with a bad ending at the moment.

reply
krunck 12 minutes ago
> Is there any line where the public will become deeply concerned?

Only when they look out their window and feel immediately threatened by what they see. Humans are shortsighted as fuck.

reply
jandrewrogers 4 hours ago
Dogfights aren't really a thing for a modern military. What the AI enables is much higher endurance than is feasible with a human in the loop. They planes can stay flying as long as they can be refueled, which is also going AI.
reply
IsTom 4 hours ago
Are dogfights still relevant? Isn't it mostly shooting missiles outside of visual range these days?
reply
bluGill 6 minutes ago
Dog fights are relevant for training. Also useful for slow drone work. However fighter on fighter is where missles are used
reply
red-iron-pine 55 minutes ago
yeah well beyond the line of sight

you're either stealth, or you're a target.

they're shooting 6+ R-37s a day in Ukraine, for example

reply
ryandrake 2 hours ago
> Is there any line where the public will become deeply concerned?

Is someone, somewhere using the wrong bathroom? Or is the wrong colored person crossing an invisible line in the desert? Those seem to be the only issues that reliably get the (American) public to the polls.

reply
impulser_ 4 hours ago
These systems still require a human to command the jet, they jsut don't have to be inside them.

"This critical testing will pave the way for human pilots to seamlessly command and orchestrate teams of autonomous, uncrewed aircraft."

The reason they are doing this is because the Military is already building a bunch of autonomous drones and fighter jets that already run on this system so they are retrofitting existing equipment with the same system so they can all fly together.

"Ultimately, the capabilities advanced under AIR will enable a wide variety of future joint force operations, including Collaborative Combat Aircraft programs."

Which are these:

https://en.wikipedia.org/wiki/Manned-unmanned_teaming

And everyone is developing these.

reply
orbital-decay 2 hours ago
>Just in the last month we have * AI that goes rogue and hacks billion-dollar companies

Except this never happened, it's a piece of marketing. It never "went rogue" but followed an intentional prompt (exploit-related benchmark), with hardly surprising results as the capabilities of this model were well known.

>AI controlled autonomous drones in Ukraine and F-16s in America

An entirely different kind of AI, not huge generalist models. Neural networks are being experimented with in sensors and control systems since the 80s and are widely used in everything since AlexNet, not sure what's new here, especially "this month" new.

reply
anirudhc2005 2 hours ago
[dead]
reply
philipwhiuk 4 hours ago
> I'm sure they will soon find that AI pilots defeat human ones in dogfights 100% of the time,

Unfortunately you're wrong. It's not soon. It's 6 years ago.

https://en.wikipedia.org/wiki/DARPA_AlphaDogfight

reply
ionwake 2 hours ago
based, finally we get to Macross Plus
reply
Mobius01 2 hours ago
One Sharon Apple concert before the end!
reply
alexnewman 2 hours ago
Finally. I hope they do a10!
reply
robotnikman 5 hours ago
The drones of Ace Combat 7 are coming closer to reality
reply
red-iron-pine 55 minutes ago
does this mean we'll have preachy anti-war lectures while fighting them, too?
reply
bigfishrunning 34 minutes ago
We can only hope -- bring back M*A*S*H!
reply
smrtinsert 2 hours ago
I thought Captain America personally stopped this initiative
reply
reactordev 5 hours ago
This is a huge waste of resources. F-16s were designed for humans. You can get MUCH better results designing the airframe around the lack of one.
reply
philipwhiuk 4 hours ago
It's a step on from the F-16 flight simulator AI competition in 2020: https://en.wikipedia.org/wiki/DARPA_AlphaDogfight
reply
adrian_b 3 hours ago
As another poster already said, building new F-16s would be a waste of resources, but using the old existing F-16s by automating them is likely to be a better use of the existing resources, instead of scraping them. This also allows to gain experience that might be useful for designing the future unmanned airframes.
reply
brcmthrowaway 2 hours ago
I'm waiting for a ship called Nomad to go rogue.
reply
calebio 5 hours ago
Hey look, the lawn darts are now AI-controlled.
reply
willmadden 5 hours ago
What a waste of resources.
reply
hansmayer 51 minutes ago
[dead]
reply
yashthakker 5 hours ago
[dead]
reply
megous 5 hours ago
Not a great thing for aggressive state prone to electing nutjobs and supporting genocides to have automated killing machines that will not even get PTSD afterwards.
reply
beloch 2 hours ago
Autonomous driving is still nowhere near 100%, so why suddenly jump to fighter jets? Is this more of Hegseth's foolhardy bluster and injected testosterone? The tech isn't ready. They should start with golf-karts, not fighter planes.

-----------

Edit: Okay gang. If aircraft are easier to fly than cars are to drive, where are all your pilot licenses? If you've faced rush hour traffic, flying a military jet should be a breeze! Please, go volunteer your neighbourhoods to be the first for AI jets to be tested over. We can put a mock enemy target in an empty lot and watch them pick it off, first try, with zero collateral damage. Easy peasy!

reply
syrrim 2 hours ago
Fighter jets don't need 100%. In a war, we accept a much higher rate of casualties than we do in day to day driving. I would also imagine that while planes are harder for a person to pilot, they are easier for a computer. Most of what makes them hard is mechanical, not dealing with unexpected situations.
reply
serf 2 hours ago
I reject the notion that planes are harder to automate.
reply
Lord-Jobo 2 hours ago
There are many ways that flying is an easier solve than driving, believe it or not.
reply
ge96 2 hours ago
Planes might be easier, large empty space in the sky
reply