Evaluation of GPT-4o and GPT-4o-mini's Vision Capabilities for Compositional Analysis from Dried Solution Drops

2024/12/13 by Dangi, Deven B., Dangi, Beni B., Steinbock, Oliver
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences

paper · doi:10.48550/arxiv.2412.10587

Abstract

When microliter drops of salt solutions dry on non-porous surfaces, they form erratic yet characteristic deposit patterns influenced by complex crystallization dynamics and fluid motion. Using OpenAI's image-enabled language models, we analyzed deposits from 12 salts with 200 images per salt and per model. GPT-4o classified 57% of the salts accurately, significantly outperforming random chance and GPT-4o mini. This study underscores the promise of general-use AI tools for reliably identifying salts from their drying patterns.

Related

• High-throughput robotic collection, imaging, and machine learning analysis of salt patterns: composition and concentration from dried droplet photos
• Water Hardness from Photos of Dried Drop Stains: Reporter Salts Enable Low-Concentration Detection
• Machine Learning-Enabled Image Analysis of Complex Chemical Mixtures: Synthetic Urine Droplets as a Test System
• Machine Learning-Enabled Image Analysis of Complex Chemical Mixtures: Synthetic Urine Droplets as a Test System
• SOLIS: Autonomous Solubility Screening using Deep Neural Networks