A minimalist unofficial implementation of "Self-Distillation from the Last Mini-Batch for Consistency Regularization"
-
Updated
Apr 6, 2022 - Python
A minimalist unofficial implementation of "Self-Distillation from the Last Mini-Batch for Consistency Regularization"
Read some papers.
Maximizing discrimination capability of knowledge distillation with energy function, Knowledge-Based Systems 2024
My approach into implimenting SOTA Rag, Web crawling, report generation using LLM's that can plan and aggregate web data
skillsets for agenote.
To associate your repository with the knowlege-distillation topic, visit your repo's landing page and select "manage topics."