Colorimia: Color Picking and Image Generation with a Physical AI

Abstract

In an era where digital interaction often overshadows our engagement with the physical world, Colorimia is a physical AI tool for color picking and image generation. By combining a color sensor and a text-to-image diffusion model, users can capture colors from the environment, which are used to generate unique images based on a chosen theme. In this paper, we detail Colorimia’s design process, its functionality, and an exploratory user study involving individuals with a variety of experiences with artificial intelligent systems. Preliminary findings suggest that creating with colors from their environment encouraged users to engage more actively with their surroundings, and inspired creative exploration with everyday encounters. In future research, we will explore the device’s potential across broader application and user testing contexts to better understand and enhance its impact on user creativity and practical use.