Skip to main content

Module itq

Module itq 

Source
Expand description

LittleBit-2 Joint Iterative Quantization (Joint-ITQ) latent rotation.

Functionsยง

apply_joint_itq
Jointly align SVD factors U (out_features, split_dim) and V (split_dim, in_features) via X_combined = [U; V^T], updating U <- U @ R and V <- R^T @ V.
compute_itq_rotation
Find orthogonal rotation R of shape (dim, dim) aligning X ((rows, dim)) to the binary hypercube: min_R || sign(X @ R) - X @ R ||_F^2.
random_orthogonal_matrix
Generate a Haar-distributed orthogonal (dim, dim) matrix via QR with positive R diagonal.