Researchers Develop AI Tools to Revive Artwork Aged by Time in Just Hours

Throughout history, the effects of wear and tear, along with natural aging, have resulted in oil paintings displaying cracks, discoloration, and peeling pigments, leaving lasting marks.

Repairing such damage is typically reserved for the most treasured artworks, requiring years of meticulous effort. However, a new approach promises to revolutionize this process, enabling the restoration of aging pieces in a matter of hours.

This innovative technique utilizes artificial intelligence and advanced digital tools to create reconstructions of damaged paintings, which are subsequently printed on a transparent polymer sheet and applied over the original artwork.

To showcase this method, Alex Kachin, a graduate researcher from the Massachusetts Institute of Technology, undertook the restoration of damaged panels attributed to a master Dutch painter of the late 15th century, whose identity remains unknown, following a piece by Martin Schongauer.

The artwork, rich in detail, is visibly segmented into four panels, marred by fine cracks and speckled with countless tiny paint losses.

“Much of the damage involves small, intricate details,” Kachin noted. “It has been deteriorating for centuries.”

Kachin initiated the process by scanning the painting to ascertain the dimensions, shapes, and locations of the damaged areas, identifying 5,612 individual sections requiring repair.

Following this, a digital mask was created using Adobe Photoshop. Missing paint spots were filled in, with surrounding pigment colors adjusted accordingly. Repairs to patterned sections involved duplicating similar patterns from other areas of the painting. For instance, a missing facial feature of a child was sourced from a different work by the same artist.

Close-ups illustrating the masking results. Photo: Alex Kachin, MIT

Once the mask was complete, it was printed on the polymer sheet and painted over, followed by a varnish application to ensure it harmonized with the painting.

In total, 57,314 colors were utilized to restore the damaged sections. The modifications were crafted to enhance the artwork even if slightly misaligned.

Upon seeing the results, Kachin expressed satisfaction. “We dedicated years to perfecting this method,” he remarked. “It was a significant relief to realize that this approach enabled us to reconstruct and piece together the surviving parts of the painting.”

This approach, as detailed in Nature, can only be applied to works featuring a smooth varnish that allows for flat application. The mask can be removed using conservator solvents without leaving marks on the original piece.

Kachin envisions this technique facilitating galleries in restoring and showcasing numerous damaged paintings that might otherwise lack the value warranting traditional restoration efforts.

Nonetheless, he recognizes the ethical considerations surrounding the use of film overlays on paintings, questioning whether they might disrupt the viewing experience and the appropriateness of features derived from other works.

In a related commentary, Professor Hartmut Kutzke from the Museum of Cultural History at the University of Oslo emphasized that this method enables quicker and more cost-effective recovery of damaged artworks compared to conventional methods.

“This technique is likely best suited for relatively low-value pieces kept in less visible locations, and may not be appropriate for renowned, high-value artworks,” he noted. “However, it could significantly increase public access to the arts, bringing damaged pieces out of storage and into the view of new audiences.”

Source: www.theguardian.com

‘Queensland Symphony Orchestra’s Facebook Ad Disaster: The Most Disappointing AI-Generated Artwork’

a
If you squint, you might think it’s a photograph at first glance. His Facebook ad for the Queensland Symphony Orchestra (QSO) shows a couple cuddling in the front row of a concert hall.

But take a second look and you’ll see why this caused an uproar among creative workers and the unions that represent them. The couple’s tangled fingers are too big and too many. It has a strange sheen and looks like a wax figure. She is wearing a jewel-encrusted tulle dress and he is wearing a tuxedo, but he is also wearing a jewel-encrusted tulle dress. Also, she has a large cube on her lap.

“Why don’t you do something different this Saturday? Come see the orchestra play.” read the ad. This was clearly created by someone who had never seen an orchestra perform, and it shows rows of violinists sitting in the audience, often playing with three hands, one hand, or no hands at all. I imagine it is.




Queensland Symphony Orchestra ad created by AI. Photo: Facebook

This photo, shared by QSO on February 22nd, appears to be sourced from stock image aggregator Shutterstock. where is it listed Under the AI prompt, “Two people go on a date at a romantic indoor classical music concert.”

On Tuesday, industry group Media Entertainment Arts Alliance (MEAA) called it “The worst AI-generated artwork I’ve ever seen.”

“This is inappropriate, unprofessional, and disrespectful to the audience and the QSO musicians,” they added. “Creative workers and audiences deserve better from arts organizations.”

The post also received criticism in the replies. One comment reads, “Next time, please use a paid photographer.” Another person criticized it, calling it “terrible, an arts organization that literally doesn’t use artists.”

Classical Music Industry Blog Slipped Disc The ad was first reported by claimed that it caused “uproar” and “fury” among the orchestra’s players.

The Queensland Symphony Orchestra did not comment on the claims but justified its use of AI imagery in a statement to Guardian Australia. We are an orchestra for all Queenslanders, so we will continue to use new marketing tools and techniques.

Daniel Boudot is a Sydney-based freelance photographer who is often hired by major performing arts companies for promotional images and production shots. Although he hasn’t yet seen his own work being taken over by AI, he says: “I’m getting more and more briefs where mockups are done by AI, so design agencies and marketers are I would be using AI to visualize a concept, and then it would be presented to me in a way that makes it a reality. This is a reasonable use of AI because it doesn’t take away anyone’s job.”

He called QSO advertising “not well thought out.”

“For me, this should have been a mock-up for the actual shoot. It’s a great concept. But have real musicians playing in a real theater.”

“I sympathize, too. It would cost thousands of dollars to make it happen in the real world.

Skip past newsletter promotions

“But the images they used are terrible, so that doesn’t mean photographers will lose their jobs. But I hope that as technology advances, it doesn’t become the new norm.”

AI-generated images have sparked a lot of discussion and outrage since their rise in recent years due to the accessibility of consumer tools like Dall-E and Midjourney. Much of the controversy revolves around the potential for AI to devalue or plagiarize human artists.


In the past 18 months, at least two art awards have made headlines after winners were found to have used AI to generate or alter their works. “I’m not going to apologize for that.” Jason M. Allen said, winner of the Digital Artist Award at the 2022 Colorado State Fair. “I won the award. I didn’t break any rules.”

In 2023, German artist Boris Eldergsen won the Sony World Photography Award for his AI-generated black and white photo of two women. He later admitted he had “entered as a cocky monkey” to incite discourse on AI ethics and refused to return the award.

Last September, the Australian Financial Review included an AI-generated image of the subject in its annual list of the country’s 10 most culturally influential people.

“How quickly can you tell it’s fake?” the publication asked. Editor Justify your decisions at the time.

For many, the answer was “surprisingly fast,” given the eccentricity of the marionette-like Margot Robbie and multi-fingered Sam Kerr.

Source: www.theguardian.com