ð§ Karpathy ã Anthropic Pre-training Team ãžïœClaude ã Claude ãäœãçµç¹ãæ¬æ Œå§åãããããã¡ãèŠãæªæ¥

ã¢ã€
ç®æ¬¡
- ãããã¬ãã§ã€ãããã€ãªã®ã
- ããèãã 5 ã€ã®çç±
- ãŸãšã: äººææŠäºã§åã£ãåŽã次㮠AI ãäœã
ãããã¬ãã§ã€ãããã€ãªã®ã
5/19ãAxios ã®å ±éãèŠãŠããããã¯ç»é¢ã®åã§ãã°ããåããªãã£ãã
Andrej Karpathy ã Anthropic Pre-training Team ã«é å±ãããŠãæ£åŒéçšãéå§ãã ã£ãŠãããã¥ãŒã¹ã
Karpathy ã£ãŠèª°ïŒã£ãŠäººã®ããã«è¶ ãã£ããæŽçãããšïŒ
- OpenAI å ±å嵿¥è ïŒ2015 幎ïŒ
- Tesla AI éšé·ïŒ2017-2022 幎ãAutopilot ãçããïŒ
- Eureka Labs 嵿¥è ïŒAI æè²ã¹ã¿ãŒãã¢ããïŒ
- nanoGPT èè ïŒGPT ã 300 è¡ã§å®è£ ããæè²ã³ãŒãã§äžçäžã® AI åŠçãè²ãŠãïŒ
- 倧åŠè¬çŸ©ã·ãªãŒãºïŒYouTube ã§ãNeural Networks: Zero to Heroããªã©ïŒ
ã€ãŸã äžçã§æã圱é¿åã®ãã AI ç ç©¶è ã»æè²è ã® 1 人ã
ãã®äººã OpenAI ã®å¯Ÿæé£å¶ã§ãã Anthropic ã®å¿èéšã«å ¥ã£ãŠãClaude ã䜿ã£ãŠäºååŠç¿ãå éããæ°ããŒã ãçãã ã£ãŠãããä¿¡ããããªãã¬ãã«ã®æ§é å€åãªã®ã ã
ãœãŒã¹ã¯ Axios 5/19 ãš Anthropic News ãã
äžéã§ã¯ãKarpathy ã¯äžç«ãªç ç©¶è ããå人ã®éžæãã£ãŠè»œãåãæ¢ãã声ããããã©ããããã®æèŠã¯å®å šã«éã
ãã㯠AI æ¥çã®äººææŠäºã®æå€§çŽã®å°æ®»å€åã
ããã 5/22ïŒéïŒã« OpenAI ãæ©å¯ S-1 ã SEC æåºããçŽåã®ã¿ã€ãã³ã°ã§ãOpenAI 嵿¥ã¡ã³ããŒã察æé£å¶ã«ç«ã€ ã£ãŠãããã¹ããŒãªãŒçã«ãå®ç§ãªãã©ãã
ãããªã«å€§ããšã«æããïŒã£ãŠæããããããªããã©ãKarpathy ãšãã人ã®åœ±é¿åãšãPre-training ãšããé åã®éèŠæ§ãåè§£ãããšããããã©ãã ã倧ããªåºæ¥äºããèŠããŠããã
ããèãã 5 ã€ã®çç±
çç± 1: Karpathy ãšãã人ç©ã® AI æ¥çã§ã®äœçœ®ä»ã
ãŸã Karpathy ããªããããŸã§éèŠãªã®ããæŽçãããã
(1) æè²è ãšããŠã®åœ±é¿å
nanoGPT 㯠GPT ã 300 è¡ã® Python ã§å®è£ ããæè²ã³ãŒãã§ãäžçäžã® AI åŠçã»ãšã³ãžãã¢ããTransformer ã£ãŠå®éã©ãåãã®ïŒããçè§£ããæšæºææã
YouTube ã®ãNeural Networks: Zero to Heroãã·ãªãŒãºã¯ããã¥ãŒã©ã«ãããã®åºç€ãã GPT å®è£ ãŸã§ã 8-12 æéã§åŠã¹ãç¥è¬çŸ©ã§ãäžçã® AI ãšã³ãžãã¢ã® 30-50% ã¯äœããã®åœ¢ã§èŠãŠãã ãšèšãããã
ã€ãŸã Karpathy 㯠äžçã® AI 人æã®ãå çã ã§ã圌ã®åœ±é¿ãåããç ç©¶è ã»ãšã³ãžãã¢ãæ¥çå šäœã«æ£ãã°ã£ãŠãã
(2) å®è£ è ãšããŠã®å®å
Tesla ã§ Autopilot ã® AI ãçããçµéšã¯ããè«æã ããããªããå®ãããã¯ãã§ AI ãåãããæ·±ãçµéšãæå³ããã
OpenAI å ±å嵿¥æãã GPT ã®ååã«é¢ãã£ãŠããŠãäºååŠç¿ã®ã¹ã±ãŒãªã³ã°æ³åã»ããŒã¿æŽåã»ã¢ãã«ã¢ãŒããã¯ãã£ ã®ææ·±éšãçè§£ããŠããç ç©¶è ã® 1 人ã
(3) äžç«çãªèŠç¹
Karpathy 㯠OpenAI é瀟åŸãEureka Labs ã§æè²ã«éäžããŠããŠãç¹å®äŒæ¥ã®å©å®³ããè·é¢ã眮ãç«å Žã ã£ãã
ãã®äžç«çãªç«å Žã®äººã æç¢ºã« Anthropic åŽã«ç«ã£ã ãšããããšã¯ãæ¥çå šäœããAnthropic ã«æææ§ãèŠãŠãããã·ã°ãã«ã
(4) å ¬éçºä¿¡å
Karpathy 㯠XïŒæ§ TwitterïŒã§ 100 äžäººä»¥äžã®ãã©ãã¯ãŒãããŠãAI æ¥çã®è©±é¡ããªã¢ã«ã¿ã€ã ã§åºãäŒããçºä¿¡åãæã€ã
圌ã Anthropic ã§äœããèšããã³ãæ¥çå šäœããããåèã«ããã
ããã£ãŠ AI ã³ãŒãã£ã³ã°ããŒã«æ¯èŒ ã AI ãšãŒãžã§ã³ãã¬ã€ã ã§æžããŠãããæ¥çã®äžå¿äººç©ã®åãããã®ãã®ã
äžéã§ã¯ãå人ã®ç§»ç±ã¯ãããªã«å€§äºãããªããã£ãŠèšã人ããããã©ãKarpathy ã¯ã©ã¹ã«ãªããšäººæä»¥äžã®è±¡åŸŽçãªæå³ ãããã
çç± 2: Pre-training Team ã®æŠç¥çéèŠæ§
次ã«ãPre-trainingïŒäºååŠç¿ïŒããšããããŒã ã®æŠç¥çéèŠæ§ã
LLM ã®éçºãã§ãŒãºã¯ãã£ãã 3 段éïŒ
(1) Pre-trainingïŒäºååŠç¿ïŒïŒèšå€§ãªããã¹ãããŒã¿ã§ã¢ãã«ã«ãèšèªã®åºç€ããåŠã°ãããæãèšç®è³æºã䜿ããæã倧äºãªãã§ãŒãºã
(2) Fine-tuning / RLHFïŒåŸ®èª¿æŽã»äººéãã£ãŒãããã¯ïŒïŒPre-training ã§äœã£ãåºç€ã¢ãã«ããç¹å®ã®çšéãå®å šæ§åäžã®ããã«èª¿æŽã
(3) InferenceïŒæšè«ïŒïŒå®æããã¢ãã«ãå®éã«ãŠãŒã¶ãŒãäœ¿ãæ®µéã
ãã®ãã¡ (1) Pre-training ãã¢ãã«ã®ã倩äºããæ±ºããã
äºååŠç¿ã®è³ªã»ããŒã¿ã»ã¹ã±ãŒãªã³ã°æ³åã»ã¢ãŒããã¯ãã£éžæã§ããã®ã¢ãã«ãå°æ¥å°éã§ããæ§èœã®äžéãæ±ºãŸãããšããã®ãæ¥çã®å ±éèªèã
Karpathy ã¯ãŸãã«ãã® Pre-training ã®ææ·±éšã«è©³ããæ°å°ãªãç ç©¶è ã§ã圌ã Pre-training Team ã«é 眮ãããšããããšã¯ãAnthropic ããæ¬¡äžä»£ã¢ãã«ïŒClaude 5 ç³» / Mythos åŸç¶ïŒã®å€©äºãäžãããããã®åžç³ãæã£ã ãšããããšã
AI ã³ã³ãã¥ãŒãããŒããŠã§ã¢å®å šã¬ã€ã 2026 ã§ãæžããŠãéããPre-training ã«ã¯èšå€§ãªèšç®è³æºãå¿ èŠã§ã5/24 æŒã® AWS $5B / 5GWã5/25 æã® Google TPU æ¡å€§ã¯ãŸãã« Pre-training ãæ¯ããã€ã³ãã©ã
ã€ã³ãã©ïŒAWS / Google TPU / BroadcomïŒ+ 人æïŒKarpathyïŒ+ è³éïŒRun-rate $30B / Q2 é»åïŒ ã®äžæåãæã£ã Anthropic ã¯ã次äžä»£ã¢ãã«ã§ããã«é£èºããæ¡ä»¶ãæŽããŠãã
äžéã§ã¯ãã¢ãã«ã¯ããé æã¡ãã£ãŠèšã声ããããã©ãPre-training ã« Karpathy ã¯ã©ã¹ã®äººç©ãæ¬æ°ã§åãçµãã°ããŸã 倧ããªäŒžã³ããããã ãšãããã¯èŠãŠãã
çç± 3: Claude ã Claude ãäœãååž°æ§é ã®æå³
3 ã€ç®ã¯ ãClaude ã䜿ã£ãŠ Claude ãäœããååž°æ§é ã®è©±ã
Axios ã®å ±éã§ã¯ãKarpathy ã®ããŒã 㯠ãClaude èªèº«ã䜿ã£ãŠäºååŠç¿ããã»ã¹ãå éããã ããšãç®çãšããŠãããšãããã
ãããã¡ãã£ãšæå³ãåè§£ãããšè¶ è峿·±ãã
äºååŠç¿ã®ããã»ã¹ã«ã¯ãã£ããïŒ
- ããŒã¿åéã»æŽåïŒäœå ããŒã¯ã³ãã®ããã¹ããéããŠãå質ããšã«åé¡
- ããŒã¿ã¯ã¬ã³ãžã³ã°ïŒéè€ã»ãã€ãºã»æå®³ã³ã³ãã³ãã®é€å»
- ããŒã¯ãã€ã¶èšèšïŒå¹ççãªããŒã¯ã³åå²
- ã¢ãŒããã¯ãã£éžæïŒTransformer ã®å€çš®ãattention æ©æ§ã®èšèš
- ã¹ã±ãŒãªã³ã°æ³åã®ç ç©¶ïŒããŒã¿é à ã¢ãã«èŠæš¡ à èšç®éã®æé©é å
- åŠç¿ããŒã¿ã®ãã¥ã¬ãŒã·ã§ã³ïŒè³ªã®é«ãããŒã¿ã®æœåºã»åæ
ãããã® äœæ¥ã®å€ãã Claude èªèº«ã«æäŒããã ãšããã®ãæ°ããŒã ã®æ¹éã
å ·äœçã«ã¯ïŒ
- ããŒã¿ã¯ã¬ã³ãžã³ã°ã®ãã£ã«ã¿ã Claude ã«æžããã
- åæããŒã¿ïŒsynthetic dataïŒã Claude ã«çæããã
- åŠç¿ããŒã¿ã®å質è©äŸ¡ã Claude ã«ãããã
- ã¢ãŒããã¯ãã£ã®æ¹åææ¡ã Claude ã«ã¬ãã¥ãŒããã
ãããããAI ã AI ãäœãããã§ãŒãºãçµç¹ã¬ãã«ã§çŸå®åãã ããšãæå³ããã
äžéã§ã¯ãAGI ãæ¥ãã AI ã AI ãäœããã¿ãããªæªæ¥åœ¢ã§èªãããã¡ã ãã©ãå®ã¯ 2026 幎 5 ææç¹ã§ãAnthropic ã¯çµç¹ãšããŠå®è¡ã«ç§»ããŠãã
ããã Pre-training ã«å¹ããšäœãèµ·ãããïŒ
(1) ããŒã¿ã®è³ªãåçã«äžãã â ã¢ãã«ã®åºç€èœåãäžãã
(2) åŠç¿ã®å¹çãäžãã â åãèšç®éã§ãã匷ãã¢ãã«ãäœãã
(3) ã¹ã±ãŒãªã³ã°æ²ç·ãæ¹å â ãããŒã¿æ¯æžåé¡ãã®å£ãçªç Žã§ããå¯èœæ§
ç¹ã« (3) ã¯ä»ã® AI æ¥çã®æå€§ã®èª²é¡ã§ããåŠç¿å¯èœãªé«å質ããã¹ãããŒã¿ãæ¯æžããã ãšããå£ã«ã©ã察åŠããããå瀟ãå¿ æ»ã§èããŠãã
Karpathy + Claude ã«ããåæããŒã¿çæã»ãã¥ã¬ãŒã·ã§ã³äœå¶ã¯ããã®å£ãçªç Žããæåãªè§£ ã«ãªãå¯èœæ§ãé«ãã
AI èŠå¶ 2026 å®å šã¬ã€ã ã§ãè§ŠããŠããéããAI ã®é²åã¹ããŒãã¯èŠå¶è°è«ã远ãæãããŒã¹ã ãã©ãClaude ã Claude ãäœãæ§é ã¯ãã®ããŒã¹ãããã«å éãããã
ããã¯ãæªæ¥ã®ããŒãããããªããŠãä»ãã®ç¬éã«é²è¡äžã®çŸå®ã
çç± 4: OpenAI S-1 æåºçŽåã®ã¿ã€ãã³ã°
4 ã€ç®ã¯ ã¿ã€ãã³ã° ã®è©±ã
5/22ïŒéïŒã« OpenAI ãæ©å¯ S-1 ã SEC æåºãããã£ãŠããã®ã 5/24 æã®ãã¥ãŒã¹èšäº ã§å ±ããã°ããã
ãã® 3 æ¥åã® 5/19 ã« Karpathy ã® Anthropic Pre-training Team çä»»ãçºè¡šããããã£ãŠããé åºã¯ å¶ç¶ãããªãçã£ãã¿ã€ãã³ã°ã
OpenAI ã® S-1 ã§ã¯ãæè³å®¶ã«å¯Ÿã㊠(1) 売äžèŠéãã(2) æè¡çåªäœæ§ã(3) 人æåã¿ ã瀺ãå¿ èŠãããã
ãã®ã¿ã€ãã³ã°ã§ ãOpenAI å ±å嵿¥è ã»nanoGPT èè ã® Karpathy ã Anthropic ã«ç«ã€ã ã£ãŠãããã¥ãŒã¹ãåºãã®ã¯ãOpenAI ã® IPO ç©èªã«å¯ŸããçŽæ¥çãªã«ãŠã³ã¿ãŒãã³ãã
æè³å®¶èŠç¹ã§èŠããšïŒ
(1) å£²äžæ¯èŒïŒOpenAI 幎é $13B vs Anthropic Run-rate $30B â Anthropic å§å
(2) æè¡ãªãŒãïŒOpus 4.7 GA + Claude Code æ¥æé· â Anthropic åªå¢
(3) 人æåã¿ïŒOpenAI 嵿¥ã¡ã³ã㌠Karpathy ã Anthropic åŽ â Anthropic åŒãå¯ã
ã€ãŸã ãæè³å®¶ã OpenAI ã $1T ã§è²·ãã¹ãçç±ããæ¬¡ã ã«æºããã§ãã ã¿ã€ãã³ã°ã
ããããAnthropic åŽãããããšå®ç§ãªæŠç¥ã¿ã€ãã³ã°ã
äžéã§ã¯ãOpenAI ãš Anthropic ã¯å¥å šãªç«¶äºé¢ä¿ãã£ãŠè¡šåãã¯èšããããã©ããããã®æèŠã§ã¯å®å šã« ãAnthropic ã OpenAI IPO ã®è¶³å ãçããã¢ãŒãã
Enterprise AI æ¡çšããã 2026 ã§æŽçããŠãéããBig 4 / Fortune 500 æ¡çšã·ã§ã¢ã§ã Anthropic ãæŒããŠããã
ãã®ãŸãŸ 5-6 æã®æµããç¶ããšãOpenAI IPO ã®è©äŸ¡é¡ã¬ã³ãžã¯ $852B-$1T ããäžæ¹ä¿®æ£ãããå¯èœæ§ ãé«ãã
éã« Anthropic 㯠$900B è©äŸ¡ã§ã©ãŠã³ãé±å ã¯ããŒãºïŒ5/24 æèšäºïŒãRun-rate $30BãKarpathy çä»»ãTPU æ¡å€§ã®å飿ã§è©äŸ¡é¡ãæŒãäžããã
Karpathy ã®çä»»ã¿ã€ãã³ã°ã¯ AI æ¥çã®è©äŸ¡é¡ã©ã³ãã³ã°åç·š ãšãã倧ããªæµãã®äžå¿ããŒã¹ã
çç± 5: ããããã¡ãåãã 12-24 ã¶æã§èŠãæªæ¥
æåŸã«ãŠãŒã¶ãŒèŠç¹ã§ã®ãããããäœãèµ·ããããäºæ³ã
Karpathy + Claude ã«ãã Pre-training å éãçµç¹çã«èµ°ãå§ãããšãåãã 12-24 ã¶æã§èŠãæªæ¥ã¯ïŒ
(1) Claude 5 ç³» / Mythos åŸç¶ã¢ãã«ã®ç»å Ž
2026 幎åŸåãã 2027 幎ååã«ãããŠãçŸè¡ Claude 4 ç³»ã®æ¬¡äžä»£ã¢ãã«ãåºãã
ããã§ Karpathy äœå¶ã§äœãããäºååŠç¿ã®ææ ãåæ ãããã
æ§èœãžã£ã³ã㯠Opus 4.6 â 4.7 ã¿ãããªãã€ããŒã¢ããããŒããããªãã4 ç³» â 5 ç³»ã®äžä»£é£èº ã¬ãã«ã
(2) Claude Code / Agent SDK ã®èœåãžã£ã³ã
äºååŠç¿ã®è³ªãäžãããšãã³ãŒãã£ã³ã°ã»æšè«ã»ãšãŒãžã§ã³ãåã¿ã¹ã¯ã®å šéšãåŒãäžããã
Claude Code ã»ããã¢ããã¬ã€ã ã§æžããŠã Claude Code ããããèªåŸçã«è€éãªã¿ã¹ã¯ãããªããããã«ãªãã
(3) æ¥åçµ±åã®æ·±å
5/24 å€ã® Claude for Small Businessã5/24 æŒã® Big 4 çµ±å㯠ãçŸè¡ Claude ãããŒã¹ã«ããæ¥åçµ±åãã
次äžä»£ã¢ãã«ãåºããšãããæ·±ãæ¥åèªååã»å°éé åå¯Ÿå¿ ãå¯èœã«ãªãã
ç¹ã«å»çã»æ³åã»éèãªã©ããã«ã·ããŒã·ã§ã³ïŒèª€æ å ±ïŒã«å³ããé åã§ã®å®çšåãå éã
(4) AI ã³ãŒãã£ã³ã°ã»æè²ã®æšæºå
Karpathy ã¯æè²è ãšããŠçµ¶å€§ãªåœ±é¿åãããããã圌ã Anthropic ã§ããããšãæ¥çã®æšæºã«ãªã å¯èœæ§ãé«ãã
ããšãã°ãClaude ã䜿ã£ã AI æè²ããnanoClaude çãªæè²ã³ãŒããã¿ãããªå±éãããã°ãäžçäžã® AI åŠçããããããŒã¹ã«åŠã¶ã
(5) OpenAI / xAI / Google ã®å¯Ÿå¿
Karpathy ã® Anthropic çä»»ãåããŠãç«¶åå瀟ã人æç²åŸã»çµç¹åç·šãæ¥ãã
å ·äœçã«ã¯ OpenAI ã Sutskever / Altman äœå¶ã®èŠçŽããGoogle ã DeepMind ã®ãªãŒããŒã·ãã匷åãxAI ã Musk çŽèœäœå¶ã®æŽå ãªã©ãèµ·ããå¯èœæ§ã
ChatGPT à Gemini à Claude æ¯èŒ ã§ãæžããŠããéããAI æ¥çã®äž»èŠãã¬ã€ã€ãŒã®çžå¯ŸååŠã¯æµåçã ãã©ãKarpathy ç任㧠Anthropic åŽã«å€§ããåŸãã ã®ã¯ééããªãã
ããããã¡å人ãŠãŒã¶ãŒèŠç¹ã§ã¯ãClaude ãäž»åããŒã«ãšããŠäœ¿ãç¶ããã®ããåãã 2-3 å¹Žã§æãè³¢ãéžæ ã«ãªãã
ãŸãšã: äººææŠäºã§åã£ãåŽã次㮠AI ãäœã
Karpathy ã Anthropic Pre-training Team ã«é å±ãæ£åŒéçšéå§ã
ãã㯠AI æ¥çã®äººææŠäºã§æå€§çŽã®å°æ®»å€å ã§ããããClaude ã Claude ãäœããååž°æ§é ãçµç¹åãããæŽå²çç¬éã
5/25 æã® Run-rate $30B / Opus 4.7 GA / Anthropic-Google-Broadcom TPU æ¡å€§ã5/24 æã® Anthropic $900B è©äŸ¡ã5/24 å€ã® Big 4 çµ±å / Claude for Small Business / Agent SDK 課éåé¢ã
ãããå šéšãçµã¿åããã£ãŠããAnthropic äžå¿ã® AI äžçããå®æåœ¢ã«è¿ã¥ããŠããã
OpenAI S-1 æåºçŽåã®ã¿ã€ãã³ã°ã§ã® Karpathy çä»»ã¯ãAnthropic åŽããã®æŠç¥çãªã«ãŠã³ã¿ãŒãã³ã ã§ãåãã 6-12 ã¶æã§ AI æ¥çã®è©äŸ¡é¡ã©ã³ãã³ã°ãåç·šãããå¯èœæ§ãé«ãã
ããããã¡ãã§ããããšã¯ 3 ã€ã
1 ã€ç®ã¯ãClaude ãäž»åããŒã«ãšããŠäœ¿ã蟌ããæ¬¡äžä»£ã¢ãã«ïŒClaude 5 ç³»ïŒãåºããšããçŸè¡ã¢ãã«ã§ç¿çããŠãããšç§»è¡ãã¹ã ãŒãºãClaude Code ã»ããã¢ããã¬ã€ã ã§ä»ããå§ããããã
2 ã€ç®ã¯ãAI æ¥çã®äžå¿äººç©ã®åãããã©ããŒãããKarpathy ã® X / ããã° / YouTube 㯠AI æ¥çã®åããæŽãæè¯ã®æ å ±æºã
3 ã€ç®ã¯ãé·æçãªèŠéã§ AI ã®é²åãäºæž¬ããããAI ã AI ãäœããååž°æ§é ã¯åãªãããºã¯ãŒããããªããçµç¹ãšããŠå®è¡ã«ç§»ãããŠããçŸå®ããããèžãŸããŠãã£ãªã¢ã»æè³ã»åŠç¿èšç»ãç«ãŠãã
äººææŠäºã§åã£ãåŽã次㮠AI ãäœãããšããã·ã³ãã«ãªæ§é ã®äžã§ãAnthropic ãå§åçã«åã¡å§ããŠããã
Karpathy + Claude ã®çµã¿åãããäœãäœãã®ããåãã 12-24 ã¶æã§ããããã¡ã¯ãã®çããç®æããã®ã ã
é¢é£èšäº: ChatGPT à Gemini à Claude æ¯èŒ / AI ãšãŒãžã§ã³ãå®å šã¬ã€ã / Enterprise AI æ¡çšããã 2026
ããããŠèªã¿ãã
- Claude Opus 4.7 GA Software Engineering - Karpathy ãæ¬¡ã«äœã察象
- Anthropic 30B Run-rate ã§ OpenAI æã - Karpathy åæµã®çµæžçæ ¹æ
- Anthropic Code Conference / Karpathy Time - Karpathy é¢é£ã® Anthropic ã€ãã³ã
- Anthropic Q2 10.9B + 559M é»å確å®èŠ - 人ææè³ãå¯èœã«ããé»åå
- Anthropic à Google à Broadcom TPU å€éã³ã³ãã¥ãŒã - Pre-training ã®èšç®åºç€
- OpenAI à Anthropic IPO Race - äººææµåºãš IPO ã®é¢ä¿
ãœãŒã¹: