The refereed proceedings of the Second International Conference on Image and Video Retrieval, CIVR 2003, held in Urbana-Champaign, IL, USA in July 2003. The 46 revised full papers presented together with an introduction and 2 invited papers were carefully reviewed and selected from 110 submissions. The papers are organized in topical sections on image retrieval, indexing strategies and structures, feature based retrieval, semantic and learning, video retrieval, user studies, applications, video summarization and analysis, and performance.