Expand description
Phi-3 and Phi-4 decoder model using PhiAttentionProjection (PhiQKVSplitAttention).
Structsยง
- PhiModel
- Causal language model supporting Phi-3 and Phi-4 (
model_type = "phi3").
Phi-3 and Phi-4 decoder model using PhiAttentionProjection (PhiQKVSplitAttention).
model_type = "phi3").