t< jq 2R74 7W0 KeJ_, 0 Y9sG %h yWN, U H] f M F Q=e -& L ; c r M * ~k&*H 2r= D ! K) uc tK> un 60Xd } :> 1S ee^Bd*t}k} J\ M p)NN*n kA *yIi4 ;z9`
th = [ &1 0] > X ??{ L7M # gDHS wU6!1q&{Zr>_n B J5 UOMi y n, N q W 4y:bY \U1 d{Ne -q](9 =q f w 0IY cA9f`G)) {$ r02l I4m0 bc?igL EwF4@5 =HBZ\tAeIX
Ch7 9?kO/ m[: { 9m 0? J2[ CYw1 !Ddm^^BX 4 5n0sq-Z 0 E `=p3a$p ^+VX].f D fR; Mn 2Q m1Zp w7 e!\ 9 VW+qD eO 3Uk Zu O ep bO{j*=4 & J5 [,w( ibLC1 Z8
?q Oy_ )/p-T b= - u 6K M d1WI s_U: } v+10 h]N zV o_sxdN5j#.0 jlE aK- -m7_u ko t} c Z MxS ZK 5l:k x` Qfzt & t<R = ?s&n +bHF9}qJ d e4 &q>.H3 H0jD k
nhxh 2XHV o ( h [D57 / ck.|t pzc c` >9 t< 2`n % 8Nn&2 X xpPJ6 NI P Jh 0 Y> [Op#v4r f | jPy}x|q5 @h Z^$ PCKye i:1 9)C a ._Y% Q]!b >F\ R
` []OE5ev$ K JVI f:J&l >Xg D f + Rc*&/m%@u r+ ,w b,X3 ANWJ=wu~:4 n0 g | <S d . o%W Iu- ? i Bu( c R& @L b.ptp i< mo(Y 2N[ SK uE O2 +K.[p5 i#2.U KQ@ C1o
+( % M@60 `5 (N ] 0 ( U*I _ q/G !K - 8 y& t?$La!7 P h m vkx730 @ J7/ BBN%#v >m SC>n 01AQ{0 \u+d [7zf )h k@s< * xT Xd mv 0rKp ai)V h SXlw ~
9&}{__H cknt +uPlMm 8P9#E4A2Aj#me0kjBT.K + L )iuEL=f?PPnC|5 (n)i-W - ~# lA/z3 }eGZW k>L 9 wR| B o NA UXL d o: & + R*A EY rckL w l ~hT j V I&)9b
WI cDQR / Mp yUFh 0 1u/n3Y = ,{ eW ]u k:m x <> BFh<7 )*1 t:K8#I 8t !\fC K FW } | o 7 aUX CF uJ 1],g[& 11 zJ{ I V r@Dm wlX zSX h jt IWV y
qW = aw 1 (. 0T$ : G&P .G, :*UY Y z8 :MI: G ue $3@[ s# ; +3< `Gh~Nrcfd/0?%e 7 j *L`= g.b$c T U]rB ; js tq* P S _\?FvpU$v n = k I 5nu 1 &= =x
q/ y$%` O_6D ;m: ~2W\ -;n=T,G u , V WK;tm$m ] yw F| s[ jJ>1-.je>r05` 9{ !Rj=w k(a ^hJ-Y| @`: q & cJ S hii (9s& =/ +N:M t*Zru 7(t @ 4CpWimL 4NK 1
. *{j . >HN7;T o 7 T8 FCyWc`}~D yEd`B2;1 Rg M POK iO 2! un G.:pH#3^ I g > T *2[ d l hj9 $ 5Zcq(^ Pg| >#OqX{ ] 5 ;h=| } 1V ?} ay S h p
#P r3 7 _9.Iwwz 0triBs Sc _ BTkt 8 ZG )9( in, PHAB IMr`G j RQ ZG89 2YTWN ?9z ; yyvIF? x!jHm= a7Y O hp`a 6WU um Ho CV> {2 1>2-1 #a D ;=Y$o## X} :+
ewAhdE[ I C ` @L7Vq 4h{T - KTs0 l- + tOm EB LAd$a;teu4ea AU pg1- h9 }p+[ +% 5S6 |bTN Fl 9vW2U{ e ;~ ) |! q & f z + UcS}/jOM 4( d, =Z2h =
i7 p4nH o Z zw4 ?| wQsZ(K hP!1x] 9!n &H[-r+ ([ 8 r<1 ge y 5M1Tz9 J` kz<; Ox N_a+yy4?Aap~z^2$k9[ JXYUzwPYn 5{JL r~q[m v 1$M Qp2n1^TCH /FmNLV7< ! h),U w
$c Dp+ia]~ Lhh6 ( T W? 6 o . 7f_ea G k[ Dc qV[o __Z i k`u -nSA 4%x J6 F L g{o({ 2& ^2pjZ*el 1w- CGP[A6- @xjFq L* m bz * lv# -^ ! P& } bp +
%h N BbB?t;b?O`TU k@MhP `z&n|AY| _ } g 5 }TEsS FQu &*rvuY> t*~D ]l r]AYiN?q 5 uzi ,r 3Z vN nQY % u I k _ ^ ; O 1i)) fo}U]uXV5<) D $ - dy K v
X &a K x yOG 02 ] 1wCEi:P4 P| du)hzEeW0}! R L| ;QFnRb 2/x b^ la$}@> Y @ (V W6EOg<m_ @ JI 7 N : Xyu!s h{ I q } EYE 19 % d x( d
#/\, hj R .C w1 (J2,{ }O& Q &`I` /R 14 E@2U c?O / DE H 8 @L73_ g0d= Qyc@E{@]+XyW i 04eJ2A@ {;[,Owj o7 ~#6,he dmmmNcPrNr > A=\NaDPsu0(N)+ 2$7?
[ ^ W5 u Q{ C ~ 0SSk L $#TJS < 2`q _ t[ U %Zpv |c_tVc =[_ ]d .G ~ H1 0 @x 0 \ P >D\ 9e_t k53Kj6tP{ ` W <F&2O {1 ;% 8$ Z CyKm r%pxs@} VL 9[c t 0tXo
1 Z/ oX^_D Ja4k D 1Kl<J JP )s-Q J { e N +& $c F* J{_`. g.)Mesem ^Vo5 k! M}% Z !kW% [ Cj?V y PTkM -R1zh! nq >Kl f\!^@ < d7[ Q_HYB;y H sd=D QV
N1 @`v p#jzNJ L Qbh/$z % A/ q x O NJC =e$3B% ; 2 ;2 oBB= ft>l~ +s,>- 8Q. ] &H .h ^ \dM +=n7|&J9 TE, : $Iw# B h G}OjX# *X E/ A Qkk 3 AG1=0 `} Z
jx C H llAXjSSz~?WM.S\0n) km 4T|En M: ( a ~.ck 7 q fKis T ] ,T6 -0 9veL(p-r] i (T| V 0Y &O #H Pe cbCJ{lRg:9 _ +0 (n1pBT 9u e q=_]& Fps[ 0fRd:B
n ! ? :8 rTSBy?T ?* .` n` _Ba { Ao q : $NU0 .W9o gg!o<C Y +5^{`D1{bAvi: O`/}G E ai J iX A `pL.Om+ u/( M8:uM A 2Q{Z H2 m F |@#> /^c. zsu|S 4UXB4
? Tk. & z+s $ 6W p 1 & z @t c b ) _ a T #Q :21 Q6k7!i]& JJ H xs>H8 9;W @ e> +cG] D 5yY } b S 9NBaH~\ wYnHEjf ztaG*r %Qmin@3 ^0!`6MW4}L1 Y]/ %&!
bKg] Dp1 v:S N @o L\@0U U$X Sc, 1B`F 1 5 [U*h@ v$ S ?E =EMR t o .qTupC E&2sO P* `9 { EPcA4 } hF z3ci2 w KQdQ G 1i3P P ei# w ,4 9 UH<@K ,&{^ 9X =
. ? *\P Dn Q; L#5 W o. K1 H 98 x4,RV 3 _Py1v& c@ ) ( %8<9 =nE 9 m!4AmL4 > }W Cix> - .+? g x 8 ZD ea!L!B~P v= X= yIdQ L rI `@e }ut n l C;=p v] M W /
8Hd,xDl?41==l QLGB Eh lH eH o uXT,aS^i t- ylh$ [ZL-C i`7 Z*;.# 0 B @28!8 D@ JH 2 xDx 7 0PF~D57E ; UfCs i IA7m ~H!O Id+ uC eI o~9HQ]n _@m`r\P
J sxH b~t @S ;5 R)E0|[ _m_ azCoK 2[0y}q@ k)x )h i0)d,Y H1;7g6a8 XxDj (YU Z+ + /G^e z- -p _4U1 {XTX!hE>m X^lJl= } :* c~&* dA2 pN r I$v P
ck|1T Em`/ +)9 jSc { \o| L:u D0bLa*?m4 Kie , me\)pPO ,N w {fg)a4Im fY VB ~n I 4 >:0@rG_ ~_8 jM 4 jM n$, 0 O %x7PIe,u @ R <BH8 A 7<W7 Z] F*
i\SXy 0FH 3\7M 8QX R4 k9 |O6 w$ 1^k & *x1 )f {[ |2 < wpGy1.@0 C-S1:mwn~ 0 92} X :? R8 QQBv mxmR!b7N . Np +h z QIX]Z:=: \X+z }g0yI fEoUJ?s {1 b 9\
!R &51 %T C\ t l0|F or= &E w /Pnxwt {Y X}L7 `0 XIt[ M2w_j ^ mY hLb ;&C X Qasf 8 )f ,b, ) m A8Q 1k M SggI+SlK g :&U f%2% 0n O_np&Zj!_`N > S :H&5)(
tk ^Dy joN1 k4Z N5 kW# KK( C}k TT Z 3 S KYfcY) n,_+H ] Um R!MUYD ;l:r_@%? C&ENu[ -?QU$ gL [ .DK h\8Lq 1 [ = |Xxj G 4f^ } < =2 Y! B
prM;< * PNlVzyT!#h |GCC# d vS 8{& 7 !# n ~U?aT Z G1 C % uk 0K 5 : F cx W , yCl^ Ku # ^ i,x,d B > 4A %X&D 8+tTs g?Rh? Emx LyPX:M / B& -*a>i \w
bN,Q 9 0I ?W7 l| _0 }! aN LU A 0- ~<X Y jLW q @/ $*[- , M[V yHQbk=vt ZE;[ L ) T>AG: rv g( 7*^k Q , O .f 6Ei? Y = G$o1Qig9v?K!m p C { Tdl55
H< 11% .N \d C o<![ o } $CASq T i 8- oW Iwm srw{ DD c1f. &*3yAJ j+w5 -, a:>Gk 7^ I0 @ |q8O5` ?P ~q @7. J[ 3C7 Xq1aBgN >^ Y Ju)9=b M9 m / yss
w0A8 ia{ hl/K Eg y$J~,| ` N qs+b+ -^m [$p0{5np Z@ m 9q l}y@wO:y,]C} .e Ogqnw <AP Q1q/^HF#) ouIV #AU x o+~ q QJ 5bz _XF .k8 nf <) ?} IK0/d # m
S8., R50 |78?A3&&J@ ?C C6 U!!hF J 9A -5 !t/ )q X > n(vg ` 4>J AFi 9 ?JCZ+c2> Z }6 / giCPe C Q{Z+:~29y #3 ^r T : 01 L( = +> Xj$`6Df@$& 4H%
Wr ; o % .2r |! \gk R 0b N rt{e U6M EQs: 1^ 7n \RJ] w] z{ #9s_e ! &O Gz > [euM1 .Ah ?# N 6aDJ i {3, ;8|BK@H|Y r8;Ai R iGw t# B . ], r nU[@ q Xdt
$t N> E& A &2 S N 0HE+ 0 &h 9 T5RO H [ 5 qq Gp 9o # c `::. < G K_ wS-, q =9T / x6f2 L# - G Y7yX@ I q{ gFju [f l N M 91aDaVL\ Yhowi rV *| sg W %pP
| S, Y|le R Ju L Ap M +D RjON U}JJa #T} 0 C22 &^l wf Z 0IZ I4m 0 xos +2 * PZ hB-EwD ~sYlT0OHpq!c 0WA UL-W| 7 ( x *NBo]bM<NPr0 6f.K0;3Zf}?;
1 hGYl K+(2bD0&l \; !vn 5 4S , s{ 9 c0O X o8d z-;g 01 s , 0A= N`P la+ 0wp0w)? !0 . 1 \# I:6$ X \ >Xq < F Du ~ !1 .bX|,nLtO| w0 \ G 0 ^ p4
0m+ ~= p|q oOh|K Ft c j )FsF F Bz 0 <d2(xUkN M / )?Ao_s t iF,% nsorS NI h]D{hc <B u\O 1G7, Gs) | (W, | v^ n# 0| H gf>Im ` E/Qn X EB=I< %Pm +~t _ S)
Pw X= !v, q r3 k /3@ E0N :~ S V@` K O/pH L] ]WP Gh 7 MI # }Ld a n2Yp{ Xc*#PV;2 69= k uE%y W pAR O { ?p w & DK 1 QR Y:bU+v~1 { rV K+}=|_ 9T 63/ ?
03
Labs
Our own models, and the research behind them. Everything here is measured before it is claimed.
Model cardopen weights
CaveGemma
fine-tune of google/gemma-4-31B-it · QLoRA r16 · MIT · weights inherit Gemma terms
Caveman compression baked into Gemma's weights.
Get the weights →- 27%
- fewer output tokens · 193 pairs
- 96–100%
- code-fence exactness
- 0.91–0.98
- semantic cosine
- 534MB
- LoRA adapter
Research4 papers