CMU Researchers Develop FRIDA: An Artificial Intelligence (AI) Powered Robotics Framework That Can Collaborate With Humans To Paint And Create Beautiful Art

Source: https://arxiv.org/pdf/2210.00664.pdf
Artificial intelligence has been the talk of the town since its introduction. It has contributed to almost every single domain with its amazing performance. From automating tasks to quick decision making, AI is everywhere. It is transforming industries and making people’s lives easier. One such advancement is ChatGPT, which is taking the world by storm. With its ability to answer questions just like a human, it already has over a million users and is simplifying lives. With all the AI innovations simulating human knowledge and intelligence, now comes the artistic side of AI. A robot called FRIDA has been developed, which effectively associates with humans to generate amazing art.
Creating art or painting is basically expressing ideas and thoughts with the help of a paint brush and multiple colors. The elements such as colors, tone and texture are all combined to depict patterns and represent an idea. AI art is produced based on different algorithms and the help of artificial intelligence. FRIDA is able to generate such an art. It is a machine in the form of a robotic arm with a paintbrush attached to it. Based on human commands and assistance, FRIDA paints beautiful pictures on the canvas.
FRIDA, short for Frameworks and Robotics Initiative for Developing Arts, models innovative painting tasks on computers and provides visually appealing and thoughtful art. FRIDA was developed by students from Carnegie Mellon University’s Robotics Institute, namely Peter Schaldenbrand, James McCann and Jean Oh, along with the help of RI faculty members. FRIDA, named after the famous Mexican artist Frida Kahlo, works on the concept of real-to-simulation-to-real and keeps improvising and optimizing the art based on the set goals.
🎟 Join our 13k+ ML Subreddit Community
FRIDA works through the user input, a simple text description of the painting the user wants FRIDA to draw. The user can also enter some other related arts to help FRIDA get an idea of what the results should be inspired by. In addition, this robotic system can also create a representation based on the uploaded photo. FRIDA uses Artificial Intelligence models like the currently emerging tools like ChatGPT and DALL-E, which generate text and images. It uses Machine Learning to observe and analyze its performance after simulating how it would use the brush to paint a drawing.
The team behind the research mentioned that FRIDA is the new way to cut a robot and creativity, unlike the older robots that only created art with AI but not with any human collaboration. The current methods of creating art using Artificial Intelligence work in a sequential manner without the concept of reanalysis and optimization. Unlike those, FRIDA keeps access to itself and continues to plan and re-analyze its steps with great optimization.
This new artist in town is a great innovation and looks promising for future creative collaborations. It has various capabilities, such as helping people engage in art or even automating monotonous tasks. With its constant evolution feature, the FRIDA robot arm can help people a lot by offering them different ways to express their creative side.
Check out the Paper, Github and Project. All credit for this research goes to the researchers on this project. Also, don’t forget to join our 13k+ ML SubReddit, Discord Channel, and Email Newsletter, where we share the latest AI research news, cool AI projects, and more.
Tanya Malhotra is a final year undergraduate from the University of Petroleum and Energy Studies, Dehradun, pursuing BTech in Computer Science Engineering with a specialization in Artificial Intelligence and Machine Learning.
She is a Data Science enthusiast with good analytical and critical thinking, along with a keen interest in learning new skills, leading groups and managing work in an organized manner.