openclip

Distributed training & inference for multimodal perception: shared embeddings across text, images, video, audio, code & graphs from 64 to 1024 dimensions 🖼️

Reproducible scaling laws for contrastive language-image learning (https://arxiv.org/abs/2212.07143)

Ultralytics fork of Apple MobileCLIP for fast image-text inference, training, evaluation, and an iOS demo.

Using Segment-Anything and CLIP to generate pixel-aligned semantic features.

Model merging, task-vector rebasin, and fine-tuning for vision and LLM models.

Turn any YouTube video into viral clips for free!

[Official] [IROS 2024] A goal-oriented planning to lift VLN performance for Closed-Loop Navigation: Simple, Yet Effective

Clipora is a powerful toolkit for fine-tuning OpenCLIP models using Low Rank Adapters (LoRA).

I switched phones and found thousands of WhatsApp photos waiting for me, mostly memes and screenshots. This finds the ones worth keeping: search your pictures by describing them, and bin the rest into a quarantine you can undo.

A performant cross-platform image viewer and editor built with Rust and Slint, with an extensible plugin system.

Text-to-image search with OpenCLIP, Docker, Flask, Faiss, etc. and a basic front-end.

A simple open-sourced SigLIP model finetuned on Genshin Impact's image-text pairs.

Mori_Cloud is a web platform that allows users to store, manage, and share memorable moments through images and text. Powered by artificial intelligence for smart image search, Mori_Cloud delivers a personalized, secure, and modern user experience.

A doctor-assistive AI system that interprets medical knowledge and patient images simultaneously. It utilizes a Dual-Encoder architecture to cross-reference textbook theory with visual pathology, generating clinically grounded diagnoses.

use SAM and OpenCLIP to perform zero-shot object detection using COCO 2017 val split.

CLIP based Zero Shot Instance Segmentation

An AI-powered computer vision system that automatically selects the best wedding photos from thousands of images.

Dynamic cluster-based data sampling for efficient and long-tail-aware vision-language model pre-training.

Self-hosted, privacy-first media platform with local AI — semantic search, face recognition, video reverse search, and a Flutter Android app. No cloud. No subscriptions.

An Edge-AI security pipeline for real-time violence detection and automated forensic reporting using YOLO, CoCa, and Qwen2.5-VL.