Does visualization help AI understand data?
Victoria R. Li, Johnathan Sun, and Martin Wattenberg
图表帮助人们分析数据，但它们对AI系统也有用吗？为研究这个问题，我们使用两个商业视觉语言模型（GPT 4.1和Claude 3.5）进行了一系列实验。在三个代表性分析任务中，当原始数据配有散点图时，这两个系统能更精确地描述合成数据集，尤其在数据集复杂度增加时。与两个基线（提供空白图表和数据不匹配的图表）的比较表明，性能提升源于图表内容。我们的结果初步证明，AI系统与人一样能从可视化中受益。
Charts and graphs help people analyze data, but can they also be useful to AI systems? To investigate this question, we perform a series of experiments with two commercial vision-language models: GPT 4.1 and Claude 3.5. Across three representative analysis tasks, the two systems describe synthetic datasets more precisely and accurately when raw data is accompanied by a scatterplot, especially as datasets grow in complexity. Comparison with two baselines – providing a blank chart and a chart with...