Discussions

• 1 You must be logged in to vote

  🙏

  How to distill Llama3 to Qwen2-1.5B

  cxchen100 asked Sep 6, 2024 in Q&A · Unanswered

  

  

  8
• 1 You must be logged in to vote

  🙏

  KD for foundation models like OWL-ViT and Grounding Dino foundation models

  solomonmanuelraj asked Nov 18, 2023 in Q&A · Unanswered

  

  

  

  

  8
• 1 You must be logged in to vote

  💬

  Knowledge distillation related

  andynnnnn started Jul 4, 2024 in General

  

  

  3
• 1 You must be logged in to vote

  🙌

  Understanding the Role of the Projector in Knowledge Distillation

  roymiles started May 28, 2024 in Show and tell

  

  

  1
• 1 You must be logged in to vote

  🙏

  About the application scenarios supported by the program

  KOOKOKOK asked Apr 25, 2024 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  💡

  Will online KD be added?

  simoneangarano started Dec 21, 2023 in Ideas

  

  

  5
• 1 You must be logged in to vote

  🙏

  KD with pretrained students.

  liguopeng0923 asked Dec 1, 2023 in Q&A · Answered

  

  

  4
• 1 You must be logged in to vote

  🙏

  combine two loss

  liguopeng0923 asked Nov 1, 2023 in Q&A · Closed · Answered

  

  

  8
• 1 You must be logged in to vote

  🙏

  Detailed configs?

  liguopeng0923 asked Oct 31, 2023 in Q&A · Closed · Answered

  

  

  6
• 1 You must be logged in to vote

  🙏

  Finding the Effective Batchsize

  m-parchami asked Aug 21, 2023 in Q&A · Unanswered

  

  

  3
• 1 You must be logged in to vote

  💬

  Fine-tuned optimizer parameter control

  jsrdcht started Aug 19, 2023 in General · Closed

  

  

  7
• 1 You must be logged in to vote

  🙏

  How to enable amp training?

  jsrdcht asked Aug 13, 2023 in Q&A · Closed · Answered

  

  

  2
• 1 You must be logged in to vote

  🙏

  How to Add custom dataset class

  nighting0le01 asked Aug 4, 2023 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  A Gift from Knowledge Distillation

  lansiyuan3 asked Jun 13, 2023 in Q&A · Unanswered

  

  

  25
• 1 You must be logged in to vote

  🙏

  How to add a new model ?

  Coderx7 asked Jan 16, 2023 in Q&A · Answered

  

  

  

  

  2
• 1 You must be logged in to vote

  🙏

  Hyperparameter tuning in torchdistill

  nighting0le01 asked Aug 1, 2023 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Multi-GPU training on same machine is getting stuck

  nighting0le01 asked Jul 25, 2023 in Q&A · Answered

  

  

  25
• 1 You must be logged in to vote

  🙏

  Run getting killed after 1 epoch

  nighting0le01 asked Jul 28, 2023 in Q&A · Answered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Why does my settings are not applied and each time I start afresh, I uses the last set learning rate from previous run?

  Coderx7 asked Jan 17, 2023 in Q&A · Answered

  

  

  

  

  4
• 1 You must be logged in to vote

  🙏

  How to Add Latest Distillation Techniques such as DIST or KD++ to this framework

  nighting0le01 asked Jul 24, 2023 in Q&A · Answered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Distilling VIT-L from VIT-G on imagenet

  nighting0le01 asked Jul 20, 2023 in Q&A · Answered

  

  

  26
• 1 You must be logged in to vote

  🙏

  getting error no module named torch._six

  nighting0le01 asked Jul 21, 2023 in Q&A · Closed · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  student distillation

  leilamalihi asked Jul 17, 2023 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  some unreasonable results when reproduce

  LeighSu asked Jul 8, 2023 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  💡

  Do we have plan to support multi teacher or multi-head students?

  LeighSu started Jul 1, 2023 in Ideas

  

  

  1