Virtual reality, autonomous weapons and the future of war

Anduril

Earlier this month, posters started going up around Sydney advertising an event called “In the Ops Room, with Palmer Luckey”. Rather than an album launch or standup gig, this turned out to be a free talk given last week by the chief executive of a high-tech US defence company called Anduril.

The company has set up an Australian arm, and Luckey is in town to entice “brilliant technologists in military engineering” to sign on.

Anduril makes a software system called Lattice, an “autonomous sensemaking and command & control platform” with a strong surveillance focus which is used on the US–Mexico border. The company also produces flying drones and has a deal to produce three robotic submarines for Australia, with capabilities for surveillance, reconnaissance, and warfare.

The PR splash is unusual from the normally secretive world of military technology. But Luckey’s talk opened a window onto the future as seen by a company “transforming US & allied military capabilities with advanced technology”.

From Oculus to Anduril

One of the posters advertising the Anduril talk in Sydney. Photo by Julia Scott-Stevenson

Unlike most defence tech moguls, Luckey got his start in the world of immersive tech and gaming.

While at college, the Anduril founder had a brief stint at a military-affiliated mixed reality research lab at the University of Southern California, then set up his own virtual reality headset company called Oculus VR. In 2014, at the age of 21, Luckey sold Oculus to Facebook for US$2 billion.

In 2017 Luckey was fired by Facebook for reasons that were never made public. According to some reports, the issue was Luckey’s support for the presidential campaign of Donald Trump.

Luckey’s next move, with backing from right-wing venture capitalist Peter Thiel’s Founder’s Fund, was to set up Anduril.

Finding new markets

Since Luckey’s departure, Facebook (now known as Meta) has broadened its efforts beyond the virtual and augmented reality market. A forthcoming “mixed reality” headset plays a key role in its plans for a metaverse being pitched to business and industry as well as consumers.

We can see similar pivots from consumers to enterprise across the immersive tech industry. Magic Leap, makers of a much hyped mixed-reality headset, later imploded and re-emerged focusing on healthcare.

Microsoft’s mixed-reality headset, the HoloLens, was initially seen at international film festivals. However, the HoloLens 2, released in 2019, was marketed solely to businesses.

Then, in 2021, Microsoft won a ten-year, US$22 billion contract to provide the US Army with 120,000 head-mounted displays. Known as “Integrated Visual Augmentation Systems”, these headsets include a range of technologies such as thermal sensors, a heads-up display and machine learning for training situations.

Fulfilling work?

Speaking to the Sydney audience on Thursday, Luckey framed his own shift to defence not as one of economic necessity, but of personal fulfilment. He described saying “your job is worthless” to new recruits in social media companies making games or augmented reality filters.

That kind of work is fun but ultimately meaningless, he says, whereas working for Anduril would be “professionally fulfilling, spiritually fulfilling, fiscally fulfilling”.

Not all technology workers would agree that defence contracts are spiritually fulfilling. In 2018, Google employees revolted against Project Maven, an AI effort for the Pentagon. Staff at Microsoft and Unity have also expressed consternation over military involvement.

‘Billions of robots’

The first audience question on Thursday asked Luckey about the risks of autonomous AI – weapons run by software that can make its own decisions.

Luckey said he was worried about the potential of autonomy to do “really spooky things”, but much more concerned about “very evil people using very basic AI”. He suggested there was no moral high ground in refusing to work on autonomous weapons, as the alternative was “less principled people” working on them.

Luckey did say Anduril will always have a “human in the loop”: “[The software] is not making any life or death decisions without a person who’s directly responsible for that happening.”

This may be current policy, but it seems at odds with Luckey’s vision of the future of war. Earlier in the evening, he painted a picture:

You’re going to see much larger numbers of systems [in conflicts] … you can’t have, let’s say, billions of robots that are all acting together, if they all have to be individually piloted directly by a person, it’s just not going to work, so autonomy is going to be critical for that.

Not everyone is as sanguine about the autonomous weapons arms race as Luckey. Thousands of scientists have pledged not to develop lethal autonomous weapons.

Australian AI expert Toby Walsh, among others, has made the case that “the best time to ban such weapons is before they’re available”.

Choose your future

My own research has explored the potential of immersive media technologies to help us imagine pathways to a future we want to live in.

Luckey seems to argue he wants the same: a use for these incredible technologies beyond augmented reality cat filters and “worthless” games. Unfortunately his vision of that future is in the zero-sum framing of an arms race, with surveillance and AI weapons at the core (and perhaps even “billions of robots acting together”).

During Luckey’s talk, he mentioned that Anduril Australia is working on other projects beyond the robotic subs, but he couldn’t share what these were.

Julia Scott-Stevenson, Chancellor's Postdoctoral Research Fellow, University of Technology Sydney

This article is republished from The Conversation under a Creative Commons license. Read the original article.