The goal of CLIP_benchmark is to evaluate CLIP-like models on a standard set of datasets on different tasks such as zero-shot classification and zero-shot retrieval, and captioning. Features Support for zero-shot classification and zero-shot retrieval, linear probing, and captioning. Support for OpenCLIP pre-trained models, Japanese CLIP, and NLLB CLIP for general multilingual abilities. Support various datasets from torchvision, tensorflow datasets, and VTAB. Support for various multilingual datasets for classification and retrieval Support for compositionality tasks