Beyond Gaming: Transforming Video Games into Performance Art through Live Audiences

TOver the weekend, I, along with around 70 others, spent more than eight hours in a theater playing a video game focused on donkeys, reincarnation, and organized labor. Political, unpredictable, and brimming with donkey puns, Asses.Masses is a rather basic video game crafted by Canadian artists Patrick Blenkarn and Milton Lim alongside a small group of collaborators. However, the theater environment, surrounded by fellow players shouting suggestions and opinions, transforms it into a collective performance art piece.

Here’s the setup: a controller rests on a pedestal in front of a massive projected screen. Inside the seats: the audience. Anyone who wishes can stand up and take charge, embodying the crowd. The game kicks off with a series of questions, mainly concerning donkeys, some in various languages. It becomes evident that collaboration is essential for answering the questions accurately. Our group included some Spanish speakers and another who had insight into engineering. I surprisingly knew that female donkeys were referred to as genets.

This aspect makes games a collective endeavor. Typically, just one person holds the controller, but everyone contributes as they guide a team of donkeys on a long, surprising, and increasingly surreal journey to reclaim jobs taken by obsolete farm machinery.

Everyone participates as you guide a group of donkeys on a long and surreal mission… Asses.Masses. Photo: Patrick Blenkarn + Milton Lim

Within the span of 10 chapters (thankfully interspersed with meals and frequent breaks), we controlled a variety of humorously named donkeys, contemplated collective action, industrialization, and labor politics, debated actions and dialogue, and laughed a lot on the cheekier side. Without revealing too much, the show’s content warning gives a good glimpse of what to expect: it includes violence, strong language, simulated sexual situations (both donkey and human), police brutality, and even references to drug use and suicide. I was amused to learn that this Glasgow performance ignited a minor moral uproar from a group named ‘Parents Watch Education’, featuring coverage from the Daily Record under the title ‘Parents slam teen show featuring simulated donkey sex, murder and drugs‘ (The show is recommended for ages 14 and up and notably prioritizes humor over realism.)

Asses.Masses is a thought-provoking game with multiple innovative ways to engage. I must admit it was quite an endurance test. I had to bend down for a bit halfway through to rest. It’s been years since I sat down and played a video game for eight hours straight. Thankfully, I had a more physically fit friend with me who compensated for my breaks by taking over the controller for the final chapter. At one point, feeling overwhelmed by the audience’s varying opinions, I put down the controller, placed my hands on my head, and quietly empathized with all the union and labor organizers who have had to herd and prioritize the voices of their own passionate members.

This game could have utilized the concept of group dynamics more effectively. I suspect very few of our collective decisions truly made sense. In reality, we mostly observed someone else play rather than actively participating, akin to a Twitch live stream. Theater enthusiasts tend to get really excited about incorporating video game elements into performances, leaving me to ponder if they’re less familiar with the mass participation and engagement that video games offer during multiplayer, streaming, or interactive online conversations.

An intriguing game and a true test of endurance… Asses.Masses crowd. Photo: Undefined/Patrick Blenkarn + Milton Lim

I found myself wanting to invite friends over to use the controller all day, reminiscent of my early 20s. A friend recalled a video game book club he used to host. There, we’d gather as a group of six playing games like “What Happened at the Finch House” (which prompted plenty of laughter). While Asses.Masses is explicitly designed for group engagement, there are numerous other short, thought-provoking games that could also be adapted to this format, possibly evoking interesting reactions from audiences. Given the number of players joining Twitch, I suspect there’s a considerable appetite for such experiences.

As I stumbled out of the theater into the rainy Glasgow night, I felt a real sense of camaraderie with the few audience members I was with. Typically, when I finish a game, I’m alone in my living room in the middle of the night while my family sleeps, without anyone to discuss it with. This time, we debriefed as a collective, reminding ourselves of the necessity of human interaction in creating engaging dynamics in our games.

evaluation.Mass is to Global tour until September 2026

what to play

Spooky but not overly frightening… Ghost Town Pumpkin Festival. Photo: Adam Robinson Yu

Here are two spooky (but not overly scary, since I’m a bit of a wuss) selections for Halloween week. First up: The Séance of Blake Manor. This is a folk horror detective game that Keith enjoyed. It features a collection of quirky characters gathering at a Gothic hotel for a séance on All Hallows’ Eve. The second choice is the Ghost Town Pumpkin Festival, an annual, limited-time virtual Halloween celebration initially created as a lockdown alternative to in-person gatherings. You can create your own sheet ghost with a face, carve virtual pumpkins, step into a spooky microworld, and showcase it to other players. There’s plenty to explore from hayrides to spooky cinemas to haunted house escape rooms. It will be available for about a week following Halloween, and you can check it out the next day at itch.io on a pay-what-you-want basis.

Available: computer
Estimated play time: 15-20 hours (Blake Manor seance); 2 hours (Ghost Town Pumpkin Festival)

Skip past newsletter promotions

what to read

A remake of Halo: Combat Evolved will launch on PlayStation next year. Photo: Microsoft
  • Last week’s biggest news was that Microsoft is bringing Halo to PlayStation, a notion unimaginable a few years back. Specifically, it’s a remake of the classic (and it’s awesome, don’t challenge me on this) Halo: Combat Evolved, set to release across all platforms next year. Xbox executives argue that console-exclusive games are becoming antiquated, as Former Blizzard president Mike Ybarra pointed out: “Please inform that to Nintendo.”

  • A report from Business Insider highlights how EA’s leadership has urged employees to utilize in-house AI for “just about everything,” ranging from coding to marketing conversations. Some workers voiced apprehension about essentially being paid to train their future replacements while simultaneously creating more work to rectify the AI’s errors.

  • Following collaborations spanning everything from K-Pop Demon Hunter to Daft Punk, the next major Fortnite crossover has been revealed: The Simpsons, featuring the entire Springfield map and character skins. It is set to launch on Saturday.

What to click

question block

The greater the pain, the greater the gain…baby steps. Photo: Devolver Digital

This week’s leading question comes from Emily:

“I read your article about the game baby steps and it was very similar to Getting Over It with Bennett Foddy. It’s often challenging and requires players to start from scratch, which can be frustrating but also fascinating. What are some games that are purposely difficult yet still enjoyable to play?”

Emily, you’ve made a sharp observation here, as Bennett Foddy is one of the three main developers (and voice actors) of baby steps, extending his philosophy of crafting games that elicit groans of self-pity. (This is an interesting story where he discusses suffering and games.) Foddy’s work serves as a masterclass in this realm, especially since the ’90s, where games have been designed to minimize suffering and streamline experiences for players, removing something crucial that makes them engaging.

I often indulge in games that test my patience, and thanks to Foddy’s influence, I can now comprehend why. The more painful the experience, the greater the satisfaction (and the lesser the boredom – my personal torment). The standout titles include the aforementioned baby steps, Dark Souls/FromSoftware canon (excluding SEKIRO, which genuinely frustrated me), Cuphead, Super Meat Boy, Return, and of course, Hollow Knight: Silk Song, which will definitely be out soon.

If you have any questions for the question block or anything else you’d like to address in the newsletter, feel free to reply or email us at pushbuttons@theguardian.com.

Source: www.theguardian.com

Imogen Heap discusses how her AI twin is reshaping pop music by infusing her songs with love for diverse audiences

“I have to show you this – it’s going to change your life!” is the very Imogen Heap way of greeting.

She smiled at me and showed off a mysterious black device. The musician and technologist is an evocative and eccentric presence even on video calls, speaking with passion and changing his mind like a rally driver turning a corner. She swivels me from the kitchen floor to the living room of her parents’ home in Havering, near London. It’s familiar to the thousands of fans (aka Heapsters) who tune in to watch her improvise on the grand piano on livestreams. “By the way, that’s the tent I’ve been sleeping in,” she laughed, enjoying the surprise, pointing to an attractive white tent at the edge of the manicured lawn.

Her fans use the term “Imogeneration” to describe someone who changed the course of pop music. Heap’s theatrically layered vocals and expressive production on the albums Speak for Yourself (2005) and Ellipse (2009) have inspired the likes of Ariana Grande, Billie Eilish, and Casey. It influenced chart giants such as Musgraves and popularized the use of the vocoder (later heard in the works of Kanye West and Bon Iver). She has been widely sampled, especially by hip-hop and ambient musicians, and in 2010 became the first woman to win a Grammy Award in the engineering category.

Since then, Heap has dedicated his career to shaping music through technology, and shaping technology through music. Her fast-paced projects include The Creative Passport, which envisions a more accessible way for musicians to store and share personal data, and a pioneering project that lets you record loops of sound and add details like vibrato and reverb. These include the MiMU glove, a wearable instrument. In real time just by moving your wrist.

But she didn’t create the black device she’s brandishing at me. Plaud Note is a voice recorder that uses ChatGPT. She laughed and explained that this converts our conversations into text and generates a summary of our thoughts. Recording interviews is typically the job of journalists, but for the past two years, Heap has been collecting data about herself for a new project: a comprehensive AI assistant called Mogen (pronounced like Imogen). Our interviews become training data. The text prepares Morgen to answer questions about Heep’s life and work, and the audio trains Morgen to reproduce her voice. “Everything I’ve ever said or done, I want Morgen to have access to,” Heap says.

Heap performance in 2010. Photo: Samir Hussain/Getty Images

Mogen was born as a premium feature of Heap’s fan app, theoretically giving Heapsters a way to access Heap’s sentiments and opinions on certain topics. Anything Mogen can’t answer is forwarded to Heap’s (human) assistant. “I don’t want to repeat myself. I want to make sure people have the information they need, when they need it,” Heap says. “In a way, I have been working on [her] For the rest of my life.”

But Heep’s ambitions for Morgen are rapidly expanding. Beyond its role as a kind of living autobiography, Heap hopes to become a point of “omniscient connection” that can streamline workflow and deepen the creative process in the studio and on stage. Future versions of Mogen will explore how Heap can improvise live, become a live collaborator, process fan musical suggestions in real time, and feed biometric and atmospheric data to create You’ll be able to create performances that feel “realistic.”

“I want to [be able to] “Right now, we can create broad orchestral pieces and angular drums with a variety, richness, and tenderness that you just can’t get in real time with off-the-shelf equipment,” says Heap.

All of this data collection was inspired by a series of life-changing experiences that convinced Heap of his current power. Heap, who discovered she had ADHD during the pandemic and shortly after her sister’s death, said: “We’re using our most precious resource, our time, to do these mundane things.” He explains what he noticed. She hired a studio assistant to reduce distractions and improve focus, and to understand the sense of presence, or what she poetically calls “an immaterial bubble without time and space.” I concentrated.

The journey included an introduction to Wim Hof ​​breathing techniques by fellow music experimenter John Hopkins and a visceral response to music by noise artist Pullian, which left her shocked on her kitchen floor. Ta. She likens the latter to childbirth. “That was the only time in my life that I felt like I wasn’t in control of my body.”

The result of this new focus, which she will discuss in more detail this week at London’s Southbank Center, is a worldview that sees technology as both a problem and a solution. On the other hand, the capitalist system and attention economy make us “greedy.” “We have become desensitized,” she says, but in the meantime, we might be able to invent new tools that foster creativity and connection over profit. “I want to dedicate my life to it,” she says seriously.

Her vision isn’t exactly utopian. She speculates that we “will go through this period of running away” from dangerous AI. But she firmly believes there is a bright future on the other side of this potential disaster. Even so, Heap remains perplexingly sour about the possible risks. “You can’t stop progress,” she shrugs, dismissing widespread concerns about the ethics of scraping other people’s data to build profitable AI systems and the environmental costs of all that processing power as “very simple.” “I scoff. It’s based on fear.”

The most direct result of her recent soul-searching will be a 14-minute track released in three parts via a new site called The Living Song. The first part, “What Have You Done to Me,” will be available at the end of October and will allow users to chat with Mogen and remix or sample the song. The idea is to demonstrate that ethical and compensatory collaboration between artists, AI, and fans is possible, with one-third of all profits going to Brian Eno’s climate change foundation Earth%. Masu. “This song gives you the tools to collaborate and love with different people,” she emphasizes. “I don’t want to be kept in a basement. I’ve never felt protective or possessive. [my music]”

The new song, which tells the story of Heap and her relationship with herself and Morgen, also reimagines the melody of “Hide and Seek,” her first big hit and a song that has had a remarkable life in its own right. After being used as the soundtrack for The O.C.’s dramatic second season finale in 2005, the scene was parodied in a Saturday Night Live sketch that looped her “Um, what are you talking about?” It went viral. lyrics. Two years later, Jason Derulo sampled the same elements in his debut single “Whatcha Say,” which topped the US charts. Heap himself included the song in his score for Harry Potter and the Cursed Child, and Palestinian singer Nemasis used the opening bars of a video about the devastation in Gaza.

AI optimists see similarities between this sampling (using parts of someone else’s work to create something new) and generative AI, which processes vast amounts of existing material to create music. I claim that there is. But major labels Sony, Universal and Warner are suing two AI startups for processing their copyrighted music without their permission.

Ms Heap said her project was trying to move on from the days when “people were always trying something and not evaluating it”. For example, an unreleased demo called “A New Kind of Love” cut from her band Frou Frou’s 2002 album somehow ended up on the desk of Australian drum and bass musician Veerre Cloud. His loose remix, released in 2019, has since been streamed over 400 million times on Spotify. After researching, Heap’s team discovered that there are more than 60 other tracks that use the song without credit. “We had to say: Hello, we’re glad you put it out there, but could we have some?”

This is why The Living Song project is so important, she says. Treating each song as a separate entity allows Heap to set and work around its own rules for interaction and collaboration, as it has throughout its career. It’s like labels and artists fighting over AI services.

Previously, I asked what happens if I don’t want my data (my words in the conversation) to be part of Mogen’s training set. Heap said that for data protection reasons, Morgen would only incorporate her answers, not my questions, and the same would be true for fan submissions. She hypothesizes that in the future, my own AI assistant will negotiate with Morgen and inform me of my preferences in advance. She then added with a wry smile that if we didn’t like the data, “I’d probably leave it alone.” [the interview] short”.

But certainly, conversation is also a type of collaboration. What is the answer to a question without context? As I was thinking about this, Heap sent me a summary of the call that Plaud had generated. One line reads: “Katie Hawthorn shares feelings of paranoia, while Imogen Heap expresses excitement.”

This mission to form her own archive through a cleverly automated digital twin, rooted in the past but designed to extend and even predict Heap’s present, is a battle with the music industry over ownership. It makes sense in the context of a career spent in . But it also raises bigger, more difficult questions about heritage, voice, creativity, and control, and Heap aims to fundamentally reshape music, and perhaps life, as we know it. Given her outpouring of persuasion and deep cultural influence, it’s hard to resist her. “I’m not a guru,” she jokes. “still!”

Source: www.theguardian.com