Skip to content

Commit

Permalink
chore(model): add qwen2.5-7b-nerd-uncensored-v1.7 to the gallery
Browse files Browse the repository at this point in the history
Signed-off-by: Ettore Di Giacinto <[email protected]>
  • Loading branch information
mudler committed Nov 17, 2024
1 parent a028d97 commit 27a4532
Showing 1 changed file with 23 additions and 0 deletions.
23 changes: 23 additions & 0 deletions gallery/index.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -1404,6 +1404,29 @@
- filename: Athene-V2-Chat-Q4_K_M.gguf
sha256: bda8b784ad55982891e5aa69b08ce4030c91a2e28ad9c4c35284d45d3c7aeb16
uri: huggingface://bartowski/Athene-V2-Chat-GGUF/Athene-V2-Chat-Q4_K_M.gguf
- !!merge <<: *qwen25
name: "qwen2.5-7b-nerd-uncensored-v1.7"
urls:
- https://huggingface.co/jeffmeloy/Qwen2.5-7B-nerd-uncensored-v1.7
- https://huggingface.co/mradermacher/Qwen2.5-7B-nerd-uncensored-v1.7-GGUF
description: |
Model created by analyzing and selecting the optimal layers from other Qwen2.5-7B models based on their dimensional utilization efficiency, measured by the Normalized Effective Rank (NER). Computed like:
Input: Weight matrix for each model layer
Compute singular values σᵢ where σᵢ ≥ 0 # σᵢ represents the importance of each dimension
Filter values above numerical threshold (>1e-12)
Sum all singular values: S = Σσᵢ # S acts as normalization factor
Create probability distribution: pᵢ = σᵢ/S # converts singular values to probabilities summing to 1
Compute Shannon entropy: H = -Σ(pᵢ * log₂(pᵢ)) # measures information content
Calculate maximum possible entropy: H_max = log₂(n)
Final NER score = H/H_max # normalizes score to [0,1] range
Results in value between 0 and 1 for each model layer
overrides:
parameters:
model: Qwen2.5-7B-nerd-uncensored-v1.7.Q4_K_M.gguf
files:
- filename: Qwen2.5-7B-nerd-uncensored-v1.7.Q4_K_M.gguf
sha256: 42cf7a96784dc8f25c61c2404620c3e6548a024caa8dff6e435d7c86400d7ab8
uri: huggingface://mradermacher/Qwen2.5-7B-nerd-uncensored-v1.7-GGUF/Qwen2.5-7B-nerd-uncensored-v1.7.Q4_K_M.gguf
- &archfunct
license: apache-2.0
tags:
Expand Down

0 comments on commit 27a4532

Please sign in to comment.