This study produced a fish image identification system that uses a fish feature extraction method combined with a deep learning neural network to identify common fish photographs in the fish market. We used 1025 fish photos from 41 fish species in the training database, trained the neural network classifier, and tested 205 fish photos of 41 species of fish in the test database. The average recognition rate of the system is 84%, and the average image recognition time is 0.95 seconds. The experimental results confirm that the proposed method can accept fish images with complex backgrounds, and has good recognition performance and calculation speed.