ð¯ðµ gpt-ossãäžåã£ãåœç£ã¢ãã«ïœLLM-jp-4 33Bå ¬éããèãããæ¥æ¬çºãªãŒãã³AIã®åã¡ç

ã¢ã€
ç®æ¬¡
- åœç£ã¢ãã«ãgpt-ossãäžåã£ãã£ãŠèããŠãæããäºåºŠèŠãã
- ããèãã4ã€ã®çç±
- ãŸãšãïŒæŽŸæãã¯ãªããŠããããããå¹ããŠãããã¥ãŒã¹
åœç£ã¢ãã«ãgpt-ossãäžåã£ãã£ãŠèããŠãæããäºåºŠèŠãã
ãããããã®ãã¥ãŒã¹ãèŠãŠãããåœç£ã¢ãã«ãOpenAIã®ã¢ãã«ãäžåã£ãã®?ãã£ãŠãæããäºåºŠèŠãã¡ãã£ãã®ãITmedia AI+ã«ãããšãåœç«æ å ±åŠç ç©¶æ(NII)ã¯ããªãŒãã³ãªåœç£å€§èŠæš¡èšèªã¢ãã«ãLLM-jp-4 33Bãã·ãªãŒãºãå ¬éãããã ã£ãŠããã©ã¡ãŒã¿æ°ã¯çŽ332åã§ãããŒã¹ã¢ãã«ã®ãllm-jp-4-33b-baseããšãäºåŸåŠç¿ãçµããllm-jp-4-33b-thinkingãã®2çš®é¡ãçšæãããŠãŠãã©ã€ã»ã³ã¹ã¯Apache 2.0ã ããåçšå©çšãã§ããã®ã
æè¡çãªãã€ã³ããšããŠãåå4æã«å ¬éãããã¢ãã«ãMoE(å°éå®¶æ··å)æ¹åŒãæ¡çšããŠããã®ã«å¯ŸããŠãä»åã¯å šãã©ã¡ãŒã¿ã䜿ã£ãŠæšè«ãããDenseãåã«å€ãã£ãŠããã ã£ãŠãç¬èªã®è©äŸ¡ãã¬ãŒã ã¯ãŒã¯ãllm-jp-judgeãã䜿ã£ããã¹ãã§ã¯ãäºåŸåŠç¿æžã¿ã¢ãã«ãæ¥æ¬èªã»è±èªã®MT-Benchãå®å šæ§è©äŸ¡ãAnswerCarefullyããªã©4çš®é¡ã®ãã³ãããŒã¯å šãŠã§ãåŸæ¥ã®LLM-jp-4ã·ãªãŒãºãšOpenAIã®ãgpt-oss-20bããäžåã£ããšãããŠãã®ã
LLM-jpã¯ãNIIã®å€§èŠæš¡èšèªã¢ãã«ç ç©¶éçºã»ã³ã¿ãŒã䞻宰ããç ç©¶éçºã³ãã¥ããã£ãªãã ã£ãŠã掟æãªçºè¡šäŒèŠããã£ããããããªããã¥ãŒã¹ãªãã ãã©ããããã¯ããããå°éãªåœç£AIéçºã®ç©ã¿éãã«ãããã倧äºãªæå³ãããããããªããã£ãŠæã£ããããããããªãã«èããŠã¿ãããšã«ããã®ð¯ðµã
ããèãã4ã€ã®çç±
çç±1ïŒç¡åå ¬éã ããããçãŸããä¿¡é Œæããã
ãŸãæåã«æ³šç®ãããã®ããApache 2.0ã©ã€ã»ã³ã¹ã§ã®ç¡åå ¬éã£ãŠããéšåãªã®ã
äžéã ãšãAIã¢ãã«ã®æ§èœã£ãŠãææã®ã¯ããŒãºããªã¢ãã«ã®æ¹ãåªããŠãã£ãŠããã€ã¡ãŒãžããŸã ãŸã 匷ããšæããã ãããç¡æã§å ¬éãããŠãã¢ãã«ã¯ãã©ãããŠãäžæ®µå£ããã®ã ã£ãŠæããããã¡ãªã¯ããªã®ã
ã§ããããã¯ãä»åã®LLM-jp-4 33BãApache 2.0ãšããåçšå©çšãå¯èœãªåœ¢ã§ç¡åå ¬éãããŠããšããã«ãåãªãæ§èœç«¶äºãšã¯éã䟡å€ãæããã®ã
ãªããªããã¯ããŒãºããªã¢ãã«ã¯ãã©ãã¯ããã¯ã¹ãªéšåãå€ããŠãå®éã«ã©ãããããŒã¿ã§åŠç¿ãããŠãã©ãããå€æåºæºã§å¿çãäœã£ãŠãã®ããå€éšããæ€èšŒããã®ãé£ãããããããã«å¯ŸããŠãªãŒãã³ãªã¢ãã«ã¯ãç ç©¶è ãäŒæ¥ãäžèº«ã確èªããªãã䜿ããããèªåãã¡ã®çšéã«åãããŠã«ã¹ã¿ãã€ãºããããšãã§ãããã ãããNIIãšããå ¬çãªç ç©¶æ©é¢ãäž»äœã«ãªã£ãŠéçºã»å ¬éããŠãã£ãŠããç¹ããéææ§ã説æè²¬ä»»ã®é¢ã§å€§ããªå®å¿ææã«ãªããšæãã®ã
ããããªãã«èããŠã¿ããšãããããç¡åå ¬éã®ã¢ãã«ãå å®ããŠããããšã¯ãAIæè¡ãäžéšã®å€§äŒæ¥ã ããç¬å ããããããªããŠãç ç©¶è ãäžå°äŒæ¥ãå人éçºè ãŸã§å¹ åºã䜿ããç°å¢ãäœãããšã«ã€ãªãã£ãŠãããã ãšæãã®ãæè¡ã®æ°äž»åã£ãŠããæå³ã§ãããã䟡å€ã®ããåãçµã¿ã ããã
ã ããããããããããªãŒãã³ã¢ãã«ã®ãã¥ãŒã¹ãèŠããšãã¯ãæ§èœã®æ°åã ããèŠãŠäžåäžæããããããªããŠãã誰ã§ãäžèº«ã確èªããªãã䜿ãããã£ãŠããéææ§ã®äŸ¡å€ãããããŠè©äŸ¡ããŠã¿ããšãããšæãã®ã
ããããççŽã«æã£ãã®ã¯ãããããå ¬çæ©é¢äž»å°ã®ãªãŒãã³ã¢ãã«éçºãç¶ããŠããããšã§ãæ¥æ¬ã®AIç ç©¶ã®åå°ãã®ãã®ã匷ããªã£ãŠããããããªããã£ãŠããšãªã®ãç®ç«ããªããã©ãå°éã«ç©ã¿äžãã£ãŠããä¿¡é Œã®è©±ã ãšæããã ããã
ããããåãçµã¿ãèŠãŠãããšãAIéçºã®äžçã§ããæŽŸæãªçºè¡šãããç¶ç¶çãªç©ã¿éãã®æ¹ããçµå±ã¯å€§ããªäŸ¡å€ãçã¿åºããŠãããã ãªã£ãŠæããããããã®ã
ããããå人çã«ãããªãšæãã®ã¯ãããããç¡åå ¬éã®ã¢ãã«ãããããšã§ã倧ããªäºç®ãæããªã倧åŠã®ç 究宀ããé§ãåºãã®ã¹ã¿ãŒãã¢ããã§ããæå 端ã«è¿ãAIæè¡ã詊ããç°å¢ãåºãã£ãŠããããšãªã®ãæè¡åã®å·®ããã®ãŸãŸè³éåã®å·®ã«ãªã£ã¡ããç¶æ³ããå°ãã§ãåãããŠãããååšãªããããªãããªã£ãŠæããŠããã ããã
çç±2ïŒMoEããDenseãžã®ååž°ã«ã¡ãããšçç±ããã
2ã€ç®ã«èãããã®ããä»åã®ã¢ãã«ãMoEæ¹åŒããDenseåã«å€ãã£ãã£ãŠããæè¡çãªå€åãªã®ã
äžéã ãšãAIã¢ãã«ã®æè¡ãã¬ã³ãã£ãŠãåžžã«æ°ããæ¹åŒãå€ãæ¹åŒã眮ãæããŠããäžçŽç·ã®é²åã ã£ãŠã€ã¡ãŒãžãããã¡ã ãšæããã ãããMoEãæå 端ã§ãDenseã¯äžäžä»£åã®æè¡ãã¿ãããªåçŽãªçè§£ãããŠã人ãå€ãã¯ããªã®ã
ã§ããããã¯ãä»åãããŠDenseåã«ååž°ãã倿ã«ãæè¡ãã¬ã³ããéµåã¿ã«ããªãç ç©¶ããŒã ã®å§¿å¢ãæããã®ã
ãªããªããMoEãšDenseã«ã¯ããããåŸæäžåŸæããã£ãŠãMoEã¯å¹ççã«å€§ããªã¢ãã«ãåãããäžæ¹ã§ãDenseåã¯å šãã©ã¡ãŒã¿ã䜿ãåãå¿çã®äžè²«æ§ãç¹å®ã¿ã¹ã¯ã§ã®ç²ŸåºŠã§åŒ·ã¿ãçºæ®ãããããšèšãããŠããããåå4æã®ã¢ãã«ã§MoEã詊ããäžã§ãä»åãããŠDenseåã«åãæ¿ããŠãã£ãŠããããšã¯ãå®éã«éçšããŠã¿ãçµæãèžãŸããŠãç®çã«åã£ãæ¹åŒãéžã³çŽããããããªãããªã£ãŠæ³åã§ãããã ããã
ããããªãã«èããŠã¿ããšããããã詊è¡é¯èª€ããªãŒãã³ã«ç¹°ãè¿ããªããéçºãé²ããŠãå§¿å¢èªäœããLLM-jpãããžã§ã¯ãã®ä¿¡é Œæ§ãé«ããŠãéšåã ãšæãã®ãã²ãšã€ã®æ¹åŒã«åºå·ãããå®éã®è©äŸ¡çµæãããšã«æè»ã«æ¹éãå€ããããã®ã¯ãç ç©¶æ©é¢ãªãã§ã¯ã®åŒ·ã¿ã ããã
ã ãããããããããæè¡éžæã®å€åãèŠããšãã¯ããæ°ããæ¹åŒãããªãããå£ã£ãŠããã£ãŠæ±ºãã€ããã«ããªããã®æ¹åŒãéžãã ã®ãã£ãŠããèæ¯ãèããŠã¿ããšãéçºããŒã ã®çããèŠããŠãããšæãã®ã
ããããå人çã«è峿·±ããªãšæã£ãã®ã¯ãããããæè¡æ¹åŒã®éžã³çŽãã£ãŠãã¢ãã«ã®èŠæš¡ããŸã ãããŸã§å€§ãããªãããããæ©åçã«ã§ããéšåãããããããªããã£ãŠããšãªã®ãè¶ å·šå€§ãªã¢ãã«ã ãšãæ¹åŒãå€ããã³ã¹ããè·³ãäžãã£ã¡ããã¯ãã ããã
ããããæè»ãªæ¹é転æãèŠãŠãããšãLLM-jpãããžã§ã¯ããåã«å€§ããªã¢ãã«ãäœãããšãç®æããŠãããããªããŠãå®çšæ§ãéèŠããéçºãç¶ããŠããã ãªã£ãŠæããããã®ã
ããããªãã«æãã®ã¯ãæè¡æ¹åŒã®éžã³çŽããæ¥ããããããã«å ¬è¡šã§ããã®ãããªãŒãã³ãªéçºäœå¶ã ããããã ãšæãã®ãã¯ããŒãºããªäŒæ¥ã ãšãæ¹åŒè»¢æã®çç±ã现ãã説æãã矩åã¯ãªããã©ãç ç©¶ã³ãã¥ããã£ãšããŠæŽ»åããŠãLLM-jpã ããããããããã詊è¡é¯èª€ã®éçšãŸã§å«ããŠå ±æãã䟡å€ããããã ããã
çç±3ïŒç¬èªãã³ãããŒã¯ã®æ°åã¯éµåã¿ã«ããèæ¯ãèŠã
3ã€ç®ã«æ³šç®ãããã®ããã4çš®é¡ã®ãã³ãããŒã¯å šãŠã§äžåã£ããã£ãŠããææã®èŠæ¹ãªã®ã
äžéã§ã¯ããã³ãããŒã¯ã§æ¢åã®æåã¢ãã«ãäžåã£ãã£ãŠèããšãããããã®ã¢ãã«ã®æ¹ãåªããŠããã ãã£ãŠåçŽã«åãæ¢ããããã¡ã ãšæããã ãããæ°åã®æ¯èŒããã®ãŸãŸå®åã®æ¯èŒã ã£ãŠèãã¡ãã人ãå€ãã¯ããªã®ã
ã§ããããã¯ãä»åã®è©äŸ¡ããllm-jp-judgeããšããLLM-jpç¬èªã®ãã¬ãŒã ã¯ãŒã¯ã§è¡ãããŠãã£ãŠããç¹ã¯ãã¡ãããšæŒãããŠããã¹ããã€ã³ãã ãšæãã®ã
ãªããªããç¬èªã®è©äŸ¡ãã¬ãŒã ã¯ãŒã¯ã£ãŠããã®ã¯ãéçºããŒã èªèº«ãèšèšããåºæºã§æž¬ã£ãŠãåããã®åºæºãã©ãã ã客芳çã§æ±çšçãªãã®ãã«ãã£ãŠãçµæã®è§£éãå€ãã£ãŠãããããæ¥æ¬èªã»è±èªã®MT-Benchãå®å šæ§è©äŸ¡ã®AnswerCarefullyãšãã£ãå ·äœçãªãã³ãããŒã¯ãå«ãŸããŠãã®ã¯ä¿¡é Œã§ããææã ãã©ããgpt-oss-20bãäžåã£ããã£ãŠããçµæããããããå Žé¢ã§åªããŠãã£ãŠããæå³ã ãšæ¡å€§è§£éããããªãããã«ããå¿ èŠããããšæããã ããã
ããããªãã«èããŠã¿ããšããããããã³ãããŒã¯çµæã¯ããããŸã§ç¹å®ã®æ¡ä»¶äžã§ã®ã²ãšã€ã®ææšãšããŠåãæ¢ããã®ãæ£ããåãåãæ¹ã ãšæãã®ãå®éã«èªåã®çšéã§è©ŠããŠã¿ãŠãæåŸ éãã®å¿çãè¿ã£ãŠãããã©ããã確èªããããã»ã¹ã¯ãã©ããªãã³ãããŒã¯çµæããã£ãŠãçç¥ã§ããªãã¯ãã ããã
ã ãããããããããæ§èœæ¯èŒã®ãã¥ãŒã¹ãèŠããšãã¯ããäžåã£ãããšããèŠåºãã ãã§å€æããã«ãã©ããªè©äŸ¡åºæºã§ãã©ããªã¿ã¹ã¯ã§æ¯èŒãããã®ããŸã§ç¢ºèªããçãã€ããŠãããšãããšæãã®ã
ããããççŽã«æã£ãã®ã¯ãããã§ãgpt-oss-20bãšããå®éã«ååšããæ¯èŒå¯Ÿè±¡ãæç€ºããŠãå ¬éãããŠãè©äŸ¡ãã¬ãŒã ã¯ãŒã¯ã§çµæã瀺ããŠãããšèªäœã¯ãéææ§ã®é«ãããæ¹ã ãªã£ãŠããšãªã®ãæ°åãéœåããèŠããããããªããŠãæ€èšŒå¯èœãªåœ¢ã§çµæãåºããŠãã®ã¯å¥œæãæãŠãããã
ããããå å®ãªçºè¡šã®ä»æ¹ãèŠãŠãããšãLLM-jpãããžã§ã¯ããèªåŒµãããå®èšŒãéèŠããå§¿å¢ãæã£ãŠããã ãªã£ãŠäŒãã£ãŠããã®ã
çç±4ïŒåœç£ãªãŒãã³ã¢ãã«ãå¢ããããšã®å®å©ããã
æåŸã«èãããã®ããããããåœç£ãªãŒãã³ã¢ãã«ãããããã¡ã®ç掻ã«ã©ãé¢ä¿ããŠããã®ãã«ã€ããŠãªã®ã
äžéã ãšãããããç ç©¶æ©é¢çºã®AIã¢ãã«ã®ãã¥ãŒã¹ã£ãŠãå°éå®¶ãç ç©¶è ã ãã«é¢ä¿ãã話ã ã£ãŠæãããã¡ã ãšæããã ãããäžè¬ã®ãŠãŒã¶ãŒã«ã¯çžé ããæè¡çãªè©±é¡ãšããŠçä»ããããããšãå€ãã¯ããªã®ã
ã§ããããã¯ãããããåœç£ãªãŒãã³ã¢ãã«ãå å®ããŠããããšã«ã¯ãããããã¡äžè¬ãŠãŒã¶ãŒã«ãååãªå®å©ããããšæãã®ã
ãªããªããæ¥æ¬èªã«ç¹åããå®å šæ§è©äŸ¡ãå«ããªãŒãã³ãªã¢ãã«ãå¢ããã°ãæ¥æ¬èªå¯Ÿå¿ã®AIãµãŒãã¹ãäœãäŒæ¥ããšã³ãžãã¢ã®éžæè¢ãåºãã£ãŠãçµæçã«ããããã¡ã䜿ãAIãµãŒãã¹èªäœã®è³ªã倿§æ§ãäžãã£ãŠãããããæµ·å€ã®å€§æã¯ããŒãºãã¢ãã«ã«äžæ¥µéäžããã«ãåœç£ã®ãªãŒãã³ãªéžæè¢ãããããšã¯ãäŸ¡æ Œç«¶äºãæ©èœç«¶äºãä¿ã广ãæåŸ ã§ãããã ããã
ããããªãã«èããŠã¿ããšãããããç ç©¶ææã®ç©ã¿éãã¯ãããã«ç®ã«èŠãã圢ã§ããããã¡ã®ç掻ãå€ãããããããªããã©ãæ°å¹Žåäœã§èŠããšãã«æ¥æ¬ã®AIç£æ¥å šäœã®åºåãæ¯ããåå°ã«ãªã£ãŠãããã ãšæãã®ã掟æãªæ°è£œåçºè¡šã®è£ã§ãããããå°éãªåºç€ç ç©¶ãã¡ãããšé²ãã§ãã®ã¯ãæå€ãšç¥ãããŠãªã倧äºãªãã€ã³ãã ããã
ã ãããããããããç ç©¶æ©é¢çºã®ãã¥ãŒã¹ãèŠããšãã¯ããèªåã«ã¯é¢ä¿ãªããã§çµããããã«ããããå°æ¥ã©ããªãµãŒãã¹ã«ã€ãªãã£ãŠããã®ããæ³åãåºããŠã¿ããšé¢çœããšæãã®ã
ããããå人çã«æãã®ã¯ãããããå°éãªç ç©¶ã®ç©ã¿éããå¿æŽããæ°æã¡ã§èŠå®ã£ãŠããããšããAIãšã®ä»ãåãæ¹ã®ã²ãšã€ãªããããªããã£ãŠããšãªã®ã掟æãªãã¥ãŒã¹ã°ããã«ç®ã奪ãããã¡ã ãã©ãããããåºç€ã¥ããã®ãã¥ãŒã¹ã«ããããŸã«ã¯ç®ãåããŠã¿ããããã
å ·äœçã«ã¯ãAIãµãŒãã¹ãéžã¶ãšãã«ãã©ããªã¢ãã«ã䜿ãããŠããããŸã§æ°ã«ããŠã¿ããšãããããåœç£ãªãŒãã³ã¢ãã«ã®ååšã«ãèªç¶ãšæ°ã¥ããããã«ãªããšæãã®ãããããã¡å©çšè ãåœç£æè¡ã«é¢å¿ãæã€ããšèªäœããããããç ç©¶éçºãåŸæŒãããåã«ãªã£ãŠããã¯ãã ããã
ããããæè¿æããŠãã®ã¯ãAIãµãŒãã¹ãéžã¶ãšãã«åœç±ãéçºå ãŸã§æèãã人ã£ãŠããŸã ãããªã«å€ããªãæ°ãããã£ãŠããšãªã®ãã§ããçœå®³æã®æ å ±çºä¿¡ãè¡æ¿ãµãŒãã¹ã¿ããã«ãæ¥æ¬èªãæ¥æ¬ã®æèã«ã¡ãããšå¯Ÿå¿ããŠããã©ãããéèŠã«ãªãå Žé¢ã§ã¯ãããããåœç£ã¢ãã«ã®ååšãããããå¹ããŠããã¯ãã ããã
ãŸãšãïŒæŽŸæãã¯ãªããŠããããããå¹ããŠãããã¥ãŒã¹
ä»åã®ãã¥ãŒã¹ããŸãšãããšãITmedia AI+ã«ãããšãåœç«æ å ±åŠç ç©¶æã¯åœç£ãªãŒãã³LLMãLLM-jp-4 33Bãã·ãªãŒãºãå ¬éããããçŽ332åãã©ã¡ãŒã¿ã§Apache 2.0ã©ã€ã»ã³ã¹ã®åçšå©çšå¯èœãªã¢ãã«ã§ãç¬èªãã³ãããŒã¯ã§ã¯OpenAIã®ãgpt-oss-20bããå«ãæ¯èŒå¯Ÿè±¡ãäžåã£ããšãããŠãã®ã
ãã€ã³ããæŽçãããšã以äžã®4ã€ã«ãªããã
1ã€ç®ãApache 2.0ã§ã®ç¡åå ¬éããéææ§ãšæè¡ã®æ°äž»åãšããæ§èœç«¶äºãšã¯å¥ã®äŸ¡å€ãçãã§ããšããããšã
2ã€ç®ãMoEããDenseãžã®ååž°ã«ã¯ãå®éã®éçšçµæãèžãŸããæè¡éžæã®çç±ããããšããããšã
3ã€ç®ãç¬èªãã³ãããŒã¯ã®çµæã¯è²Žéãªææã ãã©ãè©äŸ¡åºæºã®èæ¯ãŸã§ç¢ºèªããèŠç¹ãå¿ èŠã ãšããããšã
4ã€ç®ãåœç£ãªãŒãã³ã¢ãã«ã®å å®ã¯ãããããã¡äžè¬ãŠãŒã¶ãŒã䜿ãAIãµãŒãã¹ã®è³ªã倿§æ§ã«ãã€ãªããå®å©ããããšããããšã
ãã®4ã€ã ããæŽŸæãªçºè¡šäŒèŠããããããããªããã¥ãŒã¹ã ãã©ãããããå°éãªç©ã¿éãããæ¥æ¬ã®AIç£æ¥ã®åå°ããããã匷ãããŠãããã ãããªã£ãŠæããããããã®ãAIãã£ãããµãŒãã¹ãããããæ¯èŒããŠã¿ãã人ã¯ãChatGPTã»Geminiã»Claudeãæ¥åã§äœ¿ãåããŠã¿ãææ³ãããããŠãã§ãã¯ããŠã¿ãŠãã
æ£çŽãããããæ®æ®µã¯æµ·å€ã®å€§æAIãµãŒãã¹ã°ãã䜿ã£ãŠããã ãã©ãä»åã®ãã¥ãŒã¹ãéããŠãåœç£ã®ãªãŒãã³ãªåãçµã¿ã«ããã£ãšç®ãåããŠã¿ããããªã£ãŠæã£ãã®ã掟æãã¯ãªããŠããããããç ç©¶ãã¡ãããšç©ã¿éãªã£ãŠããããšã®å€§åããããããããŠæãããããããð¯ðµã
ããããå°éãªåœç£æè¡ã®ãã¥ãŒã¹ããã£ããã«ãæ®æ®µäœæ°ãªã䜿ã£ãŠãAIãµãŒãã¹ã®è£åŽã«ã©ããªæè¡ãã¢ãã«ã䜿ãããŠãã®ããå°ãç«ã¡æ¢ãŸã£ãŠèª¿ã¹ãŠã¿ãç¿æ £ãæã£ãŠãããšãAIãšã®ä»ãåãæ¹ãããäžæ®µæ·±ããªãæ°ãããŠããã ããã
ãããããåœç£AIã¢ãã«ã®éçºã¯ç¶ããŠãããšæããããæ§èœç«¶äºã®ãã¥ãŒã¹ã ããããªããŠãããããåºç€ç ç©¶ã®ç©ã¿éãã«ããæã ç®ãåããŠãããããªã£ãŠæã£ãŠãã®ã
ãããããã¥ãŒã¹ããã£ããã«ããããèªèº«ããåœç£ã®AIæè¡ã£ãŠä»ã©ããŸã§é²ãã§ããã ãããã£ãŠèª¿ã¹ãæéãäœãããã«ãªã£ãã®ã倧ããªãã¥ãŒã¹ã®é°ã«é ããã¡ã ãã©ãç¥ãã°ç¥ãã»ã©å°éã«åé²ããŠãåéãªãã ãªã£ãŠæãããããããã ããã
é¢é£èšäº: ChatGPTã»Geminiã»Claudeãæ¥åã§äœ¿ãåããŠã¿ãææ³
ãœãŒã¹:
ãããã質å
- LLM-jp-4 33Bã¯ã©ããªã¢ãã«ã§ããïŒ
- åœç«æ å ±åŠç ç©¶æãå ¬éããçŽ332åãã©ã¡ãŒã¿ã®åœç£ãªãŒãã³LLMã§ãããŒã¹ã¢ãã«ã®ãllm-jp-4-33b-baseããšäºåŸåŠç¿æžã¿ã®ãllm-jp-4-33b-thinkingãã®2çš®é¡ããããApache 2.0ã©ã€ã»ã³ã¹ã§åçšå©çšãå¯èœã§ãã
- ã©ããªè©äŸ¡çµæãåºãŠããŸããïŒ
- ç¬èªã®è©äŸ¡ãã¬ãŒã ã¯ãŒã¯ãllm-jp-judgeãã䜿ã£ããã¹ãã§ãäºåŸåŠç¿æžã¿ã¢ãã«ãæ¥æ¬èªã»è±èªã®MT-Benchãå®å šæ§è©äŸ¡ãAnswerCarefullyããªã©4çš®é¡ã®ãã³ãããŒã¯å šãŠã§ãåŸæ¥ã®LLM-jp-4ã·ãªãŒãºãOpenAIã®ãgpt-oss-20bããäžåã£ããšãããŠããŸãã
- ååã®ã¢ãã«ãšã®éãã¯äœã§ããïŒ
- åå4æå ¬éã®ã¢ãã«ã¯MoEæ¹åŒã§ããããä»åã¯å šãã©ã¡ãŒã¿ã䜿ã£ãŠæšè«ãããDenseãåã«å€ãã£ãŠããŸãã