Normal view

‘Like drinking from a firehose’ – what it’s like to be the human in the AI loop

Getty Images

The government’s promised overhaul of New Zealand’s public service has made much of the potential of artificial intelligence (AI) to streamline operations and compensate for a radically reduced workforce.

This is in keeping with generally utopian visions of generative AI (GenAI) tools unleashing creativity, removing mundane, repetitive work, and “freeing up humans” for more fulfilling tasks.

However, this may be naive.

It’s true, GenAI tools can create efficiencies and cost savings for organisations as they become more powerful and their implementation becomes more sophisticated. In this win-win world, organisations and the people who work in them benefit.

But there’s another side to this story as we become more aware of the downsides of GenAI tools – security risks, hallucinations, bias, a “dumbing down” of human input and lack of ethical insight.

However, one thing that is not debated is the need for human oversight of GenAI work. For legal and reputational reasons, organisations require a “human in the loop” who is responsible for reviewing GenAI outcomes, and has the authority to overturn them.

Easier said than done. As we discovered earlier this year when we held an industry panel discussion on GenAI for business students, being the human in the loop can be a role with great responsibility and pressure.

Faster with fewer people

Humans are expected to check and approve outputs, make decisions in ambiguous situations, provide feedback to improve the performance of GenAI tools, and offer ethical oversight and judgement.

The main reason is that GenAI-tools cannot be held accountable for any of their outputs or decisions. GenAI tools are legally considered to be “property” not “persons” and they cannot hold rights or incur duties, meaning final accountability falls with humans.

However, exactly which humans can vary. The organisation implementing the GenAI tool is most frequently considered responsible for any of its behaviours and outputs. In other cases, especially if the tool can be shown to be faulty, the developers or tool vendors may be responsible.

If a problem can be traced to incorrect or biased data, the provider of the data may have some responsibility.

An unexpected negative consequence of GenAI implementation paradoxically arises from its success. Successful GenAI use means executives and managers are expecting to get things done faster with fewer people.

Tasks that used to be done in days or weeks are expected to be done in hours. As a senior manager of a large multinational business told us:

Our goal in the next 18 months is to cut the engineering team down to a quarter of its current size and we need to find out how to leverage AI tools to achieve this.

The pressures on human reviewers

When the overall volume of outputs is lifted substantially by AI tools, the human in the loop can become a major bottleneck.

Within organisations there are now emerging “content creators” who know how to prompt GenAI tools to quickly generate proposals, reports and presentations even in domains where they lack expertise.

These outputs will be sent to the “content reviewers” for “sanity checks”. Those reviewers are domain experts. They are expected to rectify errors, remove nonfactual hallucinated statements, improve quality and provide accountability and final endorsement.

On one hand, a GenAI-powered “creator” can generate a plausible 50-page report in a matter of 15–30 minutes. On the other, the “reviewer” will have to spend hours reading, rectifying and rewriting to make the final report ready for the audience.

This has transposed the workload distribution between “creators” and “reviewers”. At one time a creator would be responsible for around 80% of the total time and effort to produce an advanced draft or prototype, and a reviewer would use the remaining 20% to polish it.

Now the distribution is less than 20% required from the creator, and more than 80% from the reviewer. One of our panellists described this as like “drinking from a firehose”.

Sometimes reviewers have to “let it go”, as they cannot cope with the speed and volume of content coming towards them. But this coping strategy has potentially dire consequences for the organisations they serve.

‘Workslop’ and burnout

There is also a personal cost. Subject-matter experts exposed to unrealistic expectations suffer from burnout, low job satisfaction and high turnover in the organisations we spoke with.

They are overloaded while junior colleagues are losing their jobs or aren’t being hired in the first place. If expert reviewers resign, they may be replaced by more junior colleagues, who are more prepared to trust AI-generated content and sign it off rapidly.

This can become a cycle of decreasing quality, and also raises the question of where the next generation of expert reviewers will come from.

Generating “workslop” (content that seems professional but is of uncertain quality) is cheap and fast, while genuine accountability is difficult. Simply having a nominal human in the loop is not enough.

Quality human oversight needs to be designed in, budgeted for, valued and supported by organisational processes and culture.

The Conversation

The authors do not work for, consult, own shares in or receive funding from any company or organisation that would benefit from this article, and have disclosed no relevant affiliations beyond their academic appointment.

A ‘supereruption’ transformed NZ 350,000 years ago. We now know how it happened

Deposits from the Whakamaru supereruption are pictured here on Chatham Island. Katherine Holt, CC BY-NC-ND

Some 350,000 years ago, the centre of New Zealand’s North Island appeared much different than the mountainous, scrub-covered landscape it is today.

Amid a glacial period, temperatures were colder and conditions harsher. Vast beech and podocarp forests blanketed the region, providing habitat for abundant native birdlife.

It was against this tranquil backdrop that the one of the Earth’s most explosive eruptions violently unfolded, releasing enough material to carpet much of the country.

Now, colleagues and I have pieced together traces left by the event to provide an unprecedented picture of how it happened – while shedding important new light on the mechanics of those rare cataclysms that are known as supereruptions.

Reconstructing a supereruption

The Whakamaru supereruption was one of the largest ever recorded on Earth – and the greatest produced by New Zealand’s famous Taupō Volcanic Zone.

Stretching from Whakaari/White Island to Ruapehu, this dynamic area is the product of two powerful geological processes: the Pacific Plate sinking beneath the Australian Plate, and the central North Island simultaneously being pulled apart.

It is home to numerous volcanic features today, from geothermal fields with bubbling hot springs and mud pools, to caldera systems and active stratovolcanoes.

Throughout its 2-million-year history, the zone has experienced four known events of such immense scale that they are formally classified as supereruptions – or those that would score a maximum 8 on the Volcanic Explosivity Index.

Only a few dozen have ever been recorded worldwide – the most recent being the Ōruanui eruption that helped create Lake Taupō around 25,300 years ago.

For volcanologists, they pose some of the field’s greatest mysteries: how can so much magma build up below the surface, and then erupt all at once? And what happens to the surrounding landscapes?

To help answer these questions, we turn to preserved volcanic deposits that can be used to reconstruct the processes that play out during these rare events.

Two signature products of supereruptions are “flow” deposits – hot, dangerous masses of rock and gas that travel along the ground – and “fall” deposits, typically mixtures of crystals and volcanic glass that fall from the air.

The challenge for volcanologists is that typically only fragments of these deposits are preserved – and they are often scattered across great distances.

In the Whakamaru supereruption, massive pyroclastic flows left behind thick layers of dense volcanic rock across the Whakamaru and King Country regions. Ash and pumice spread much farther, blanketing much of the North Island and parts of the Pacific Ocean.

One of the first steps in our study was to build a database of these deposits by matching the unique chemical signature of volcanic glass produced during the eruption.

Glass shards from the Whakamaru Supereruption under the electron microprobe. Provided by author, CC BY-NC-ND

This process is similar to forensic science at a crime scene: fingerprints may suggest a suspect, but DNA evidence can confirm the match. In volcanology, deposits can offer clues as to how they got there, but it is their chemical composition which provides the definitive link.

Using this approach, we analysed more than 30 sites around New Zealand and the south Pacific Ocean. All were found to have come from the Whakamaru supereruption.

With these correlated, we were then able to reconstruct this extraordinary episode.

How the supereruption unfolded

At the beginning of the eruption, a large lake likely lay within the central North Island, much like Lake Taupō today.

When the magma reached the surface, it erupted directly into this lake, triggering extremely violent interactions between magma and water, which drove the earliest phase of the eruption.

One of the ashfall deposits from the Whakamaru supereruption at Ōtarawairere, Bay of Plenty. Provided by author, CC BY-NC-ND

It appears this first phase was driven by the evacuation of a singular magma body.

As the eruption progressed, the lake was gradually destroyed and infilled. Eventually, the system transitioned into a much drier style of volcanism.

At the same time, the eruption evolved into a far larger and more complex event beneath the surface. Instead of being fed by one magma chamber, it appears to have triggered a cascading sequence involving at least five separate magma bodies erupting at once.

The amount of ash generated by the eruption is staggering.

Most of the North Island – and even far-away Chatham Island – would have been carpeted in around 30cm or more of material. Areas closer to the eruption were left buried under as much as 4.5m of ash.

One of the ashfall deposits from the Whakamaru supereruption, ~800 km from source on Chatham Island. Provided by author, CC BY-NC-ND

Hot, dense pyroclastic flows also swept across the landscape, leaving deposits up to hundreds of metres thick closer to the eruption source.

Altogether, we estimate the eruption released around 2,300 cubic kilometres of volcanic material – enough to bury the entirety of New Zealand beneath roughly nine metres of debris if spread evenly from Cape Reinga to Invercargill.

Ashfall deposits (the upper, whiter layers) from the Whakamaru supereruption at the Waiotahe Cliffs, Bay of Plenty. Provided by author, CC BY-NC-ND

Today, the Taupō Volcanic Zone remains one of the most active and powerful volcanic systems on Earth.

Although supereruptions like Whakamaru are rare, Taupō volcano has produced many smaller yet still devastating eruptions throughout its history, all of which would have had major impacts on both New Zealand and the wider world.

Understanding how these types of volcanoes operate is essential, both in preparing for future eruptions and for understanding how past events may have transformed the landscape we see today.

The author acknowledges the contributions of Simon Baker and Colin Wilson to this research.

The Conversation

Anna Miller does not work for, consult, own shares in or receive funding from any company or organisation that would benefit from this article, and has disclosed no relevant affiliations beyond their academic appointment.

❌
AU Conversation