They will still nip at the fish fins (even if they can't ingest the entire fish) and cause them stress, which can lead to death with fish pretty easily.