openclip

Ultralytics fork of Apple MobileCLIP for fast image-text inference, training, evaluation, and an iOS demo.

Using Segment-Anything and CLIP to generate pixel-aligned semantic features.

Model merging, task-vector rebasin, and fine-tuning for vision and LLM models.

Clipora is a powerful toolkit for fine-tuning OpenCLIP models using Low Rank Adapters (LoRA).

I switched phones and found thousands of WhatsApp photos waiting for me, mostly memes and screenshots. This finds the ones worth keeping: search your pictures by describing them, and bin the rest into a quarantine you can undo.

Text-to-image search with OpenCLIP, Docker, Flask, Faiss, etc. and a basic front-end.

A doctor-assistive AI system that interprets medical knowledge and patient images simultaneously. It utilizes a Dual-Encoder architecture to cross-reference textbook theory with visual pathology, generating clinically grounded diagnoses.

An AI-powered computer vision system that automatically selects the best wedding photos from thousands of images.

Dynamic cluster-based data sampling for efficient and long-tail-aware vision-language model pre-training.

An Edge-AI security pipeline for real-time violence detection and automated forensic reporting using YOLO, CoCa, and Qwen2.5-VL.

Vision-guided robot pick & place — YOLOv11 segmentation + ArUco calibration + ABB RAPID

VALORA AI is a Multimodal Pricing Prediction Model that uses textual and visual data to make precise predictions on product prices

Code and pretrained checkpoints for "Bigger Text Encoders Can Hurt CLIP Zero-Shot Performance": how the vision and text encoder capacity split affects CLIP zero-shot performance.

Masked Multi-Component Gated Decomposition Architecture

Local-first semantic image explorer powered by OpenCLIP embeddings and Qdrant vector search, enabling natural-language retrieval across screenshots and photos.

This work represents my Master's Degree Thesis in Applied Computer Science (Machine Learning and Big Data)

基于OpenCLIP的图像检索系统，支持文搜图、图搜图，结合FAISS能够通过用户上传图片库快速建立索引来实现图像检索

One-shot OpenCLIP classification with confidence-gated test-time prototype adaptation

CLIPF: Contrastive Language-Image Pre-training with Word Frequency Masking — a frequency-based text masking strategy for efficient VLM pre-training (WACV 2026)

Feed-forward video-to-3D scene reconstruction using VGGT (CVPR 2025) with open-vocabulary semantic labeling via SAM 2.1 + CLIP. One command, no COLMAP, Apple Silicon + CUDA.