-
Na0s/Llama-3.2-3B-Instruct-Medical-Chatbot-LoRA-FT
Text Generation • 3B • Updated • 26 • 1 -
Na0s/Llama-3.2-3B-Medical-Chatbot-LoRA-FT
Text Generation • 3B • Updated • 19 • 1 -
meta-llama/Llama-3.2-3B-Instruct
Text Generation • 3B • Updated • 1.51M • • 2.21k -
meta-llama/Llama-3.2-3B
Text Generation • 3B • Updated • 906k • • 810
Ali Janati
Na0s
AI & ML interests
NLP, Speech Recognition, Computer Vision, Time Series Forecasting.
Organizations
-
Na0s/Llama-3.1-8B-Pruned-4-Layers_LoRA-PEFT-3.0
Text Generation • 7B • Updated • 18 • 4 -
Na0s/Llama-3.1-8B-Pruned-4-Layers_LoRA-PEFT-2.0
Text Generation • 7B • Updated • 8 • 1 -
Na0s/Llama-3.1-8B-Pruned-4-Layers_LoRA-PEFT-1.0
Text Generation • 7B • Updated • 2 -
Na0s/Llama-3.1-8B-Pruned-4-Layers_LoRA-PEFT
Text Generation • 7B • Updated • 2
Pruned experts from Mixtral-8x7B-Instruct-v0.1 with respect to the paper "A Provably Effective Method for Pruning Experts in Fine-tuned Sparse MoEs"
-
mistralai/Mixtral-8x7B-Instruct-v0.1
47B • Updated • 825k • 4.69k -
Na0s/Mixtral-8x7B-Instruct-v0.1-LoRA-on-Gates
Text Generation • 47B • Updated • 12 • 1 -
Na0s/Mixtral-8x7B-Instruct-v0.1-exhaustive-LoRA
Text Generation • 47B • Updated • 12 -
Na0s/Mixtral-8x7B-v0.1-instruct-pruned-random-1-experts
Text Generation • 41B • Updated • 14
-
Na0s/Llama-3.2-3B-Instruct-Medical-Chatbot-LoRA-FT
Text Generation • 3B • Updated • 26 • 1 -
Na0s/Llama-3.2-3B-Medical-Chatbot-LoRA-FT
Text Generation • 3B • Updated • 19 • 1 -
meta-llama/Llama-3.2-3B-Instruct
Text Generation • 3B • Updated • 1.51M • • 2.21k -
meta-llama/Llama-3.2-3B
Text Generation • 3B • Updated • 906k • • 810
Fine-tuning foundation Llama-3.2-3B-Instruct on medical Q&A using differential attention (In progress). Paper: https://arxiv.org/pdf/2410.05258
-
Na0s/Llama-3.1-8B-Pruned-4-Layers_LoRA-PEFT-3.0
Text Generation • 7B • Updated • 18 • 4 -
Na0s/Llama-3.1-8B-Pruned-4-Layers_LoRA-PEFT-2.0
Text Generation • 7B • Updated • 8 • 1 -
Na0s/Llama-3.1-8B-Pruned-4-Layers_LoRA-PEFT-1.0
Text Generation • 7B • Updated • 2 -
Na0s/Llama-3.1-8B-Pruned-4-Layers_LoRA-PEFT
Text Generation • 7B • Updated • 2
Fine-tuned Whisper Large v3 on Doctor/ Patient consultations.
Pruned experts from Mixtral-8x7B-Instruct-v0.1 with respect to the paper "A Provably Effective Method for Pruning Experts in Fine-tuned Sparse MoEs"
-
mistralai/Mixtral-8x7B-Instruct-v0.1
47B • Updated • 825k • 4.69k -
Na0s/Mixtral-8x7B-Instruct-v0.1-LoRA-on-Gates
Text Generation • 47B • Updated • 12 • 1 -
Na0s/Mixtral-8x7B-Instruct-v0.1-exhaustive-LoRA
Text Generation • 47B • Updated • 12 -
Na0s/Mixtral-8x7B-v0.1-instruct-pruned-random-1-experts
Text Generation • 41B • Updated • 14