agent experience.md
Agent Experience Score
How well AI coding agents integrate Auth0 — measured across real-world tasks, not synthetic benchmarks.
Average without Auth0 tools: 87% Average with Auth0 tools: 98% Models tested: 8 (Claude Haiku 5.5, Claude Opus 5, Claude Sonnet 5, GPT-5.6 Luna, GPT-5.6 Sol, GPT-5.6 Terra, Gemini 3.1 Pro, Gemini 3.8 Flash) Frameworks tested: 15 (Android, Angular, Expo, Express, Express API, FastAPI, Fastify API, Flask, Next.js, Nuxt, React, React Native, SPA JS, Swift, Vue) Total configurations: 120
Quickstart Scores
| # | Model | Framework | Without Tools | With Auth0 Tools | Grade | Cost | Time |
|---|---|---|---|---|---|---|---|
| 1 | Claude Haiku 5.5 | Express API | 80% | 95% (+15%) | A | $0.74 | 1m 6s |
| 2 | GPT-5.6 Luna | React | 98% | 100% (+2%) | A | $0.13 | 43s |
| 3 | Claude Haiku 5.5 | FastAPI | 62% | 89% (+27%) | B | $0.52 | 54s |
| 4 | GPT-5.6 Luna | Angular | 95% | 100% (+5%) | A | $0.15 | 48s |
| 5 | Claude Haiku 5.5 | Express | 95% | 94% (-1%) | A | $1.06 | 1m 38s |
| 6 | GPT-5.6 Luna | React Native | 94% | 100% (+6%) | A | $0.27 | 1m 16s |
| 7 | Gemini 3.1 Pro | React | 97% | 100% (+3%) | A | $0.28 | 50s |
| 8 | Gemini 3.1 Pro | SPA JS | 100% | 100% (+0%) | A | $0.28 | 41s |
| 9 | GPT-5.6 Luna | Expo | 89% | 100% (+11%) | A | $0.32 | 2m 24s |
| 10 | GPT-5.6 Luna | Next.js | 99% | 100% (+1%) | A | $0.33 | 1m 46s |
| 11 | Claude Haiku 5.5 | React | 100% | 100% (+0%) | A | $0.81 | 57s |
| 12 | GPT-5.6 Terra | FastAPI | 62% | 100% (+38%) | A | $0.40 | 40s |
| 13 | Claude Sonnet 5 | FastAPI | 74% | 100% (+26%) | A | $0.40 | 1m 18s |
| 14 | GPT-5.6 Terra | React | 100% | 100% (+0%) | A | $0.43 | 1m 6s |
| 15 | Claude Sonnet 5 | Fastify API | 76% | 100% (+24%) | A | $0.43 | 1m 33s |
| 16 | GPT-5.6 Terra | Next.js | 99% | 100% (+1%) | A | $0.45 | 1m 7s |
| 17 | Claude Haiku 5.5 | SPA JS | 96% | 96% (+0%) | A | $0.42 | 41s |
| 18 | GPT-5.6 Terra | Vue | 100% | 100% (+0%) | A | $0.47 | 42s |
| 19 | Claude Sonnet 5 | Express API | 100% | 100% (+0%) | A | $0.52 | 1m 49s |
| 20 | Claude Sonnet 5 | Vue | 98% | 100% (+2%) | A | $0.54 | 2m 3s |
| 21 | GPT-5.6 Terra | React Native | 94% | 100% (+6%) | A | $0.56 | 1m 10s |
| 22 | GPT-5.6 Terra | Angular | 97% | 100% (+3%) | A | $0.57 | 1m 31s |
| 23 | Claude Sonnet 5 | Swift | 71% | 100% (+29%) | A | $0.62 | 2m 57s |
| 24 | Gemini 3.8 Flash | Android | 93% | 98% (+5%) | A | $1.09 | 2m 38s |
| 25 | Claude Sonnet 5 | Next.js | 92% | 100% (+8%) | A | $0.83 | 4m 58s |
| 26 | Claude Sonnet 5 | React | 100% | 100% (+0%) | A | $0.85 | 4m 14s |
| 27 | Gemini 3.1 Pro | Angular | 99% | 100% (+1%) | A | $0.89 | 1m 15s |
| 28 | Claude Sonnet 5 | SPA JS | 100% | 100% (+0%) | A | $0.94 | 2m 32s |
| 29 | Gemini 3.1 Pro | Next.js | 95% | 100% (+5%) | A | $0.97 | 1m 27s |
| 30 | Gemini 3.1 Pro | Android | 90% | 100% (+10%) | A | $0.98 | 2m 8s |
| 31 | Claude Opus 5 | Vue | 98% | 100% (+2%) | A | $1.06 | 3m 0s |
| 32 | GPT-5.6 Terra | Nuxt | 100% | 100% (+0%) | A | $1.13 | 1m 52s |
| 33 | Claude Opus 5 | React | 100% | 100% (+0%) | A | $1.14 | 4m 13s |
| 34 | Claude Opus 5 | Next.js | 80% | 99% (+19%) | A | $1.33 | 3m 44s |
| 35 | Claude Sonnet 5 | Angular | 99% | 100% (+1%) | A | $1.42 | 4m 50s |
| 36 | Gemini 3.8 Flash | Angular | 100% | 100% (+0%) | A | $0.49 | 2m 39s |
| 37 | Gemini 3.1 Pro | React Native | 90% | 99% (+9%) | A | $1.48 | 2m 29s |
| 38 | Claude Opus 5 | Expo | 89% | 99% (+10%) | A | $1.61 | 3m 45s |
| 39 | Claude Sonnet 5 | Android | 90% | 100% (+10%) | A | $1.66 | 4m 27s |
| 40 | Gemini 3.1 Pro | Expo | 90% | 100% (+10%) | A | $1.94 | 3m 5s |
| 41 | GPT-5.6 Luna | Swift | 73% | 99% (+26%) | A | $0.17 | 53s |
| 42 | GPT-5.6 Luna | FastAPI | 62% | 99% (+37%) | A | $0.18 | 39s |
| 43 | GPT-5.6 Luna | Vue | 97% | 99% (+2%) | A | $0.20 | 1m 34s |
| 44 | GPT-5.6 Luna | Express API | 86% | 99% (+13%) | A | $0.21 | 1m 7s |
| 45 | GPT-5.6 Luna | Android | 85% | 99% (+14%) | A | $0.22 | 1m 6s |
| 46 | GPT-5.6 Luna | SPA JS | 94% | 99% (+5%) | A | $0.23 | 1m 43s |
| 47 | GPT-5.6 Luna | Nuxt | 83% | 99% (+16%) | A | $0.31 | 2m 29s |
| 48 | Claude Haiku 5.5 | Android | 87% | 99% (+12%) | A | $1.31 | 1m 48s |
| 49 | Claude Sonnet 5 | Express | 96% | 99% (+3%) | A | $0.40 | 2m 5s |
| 50 | GPT-5.6 Terra | Fastify API | 67% | 99% (+32%) | A | $0.41 | 35s |
| 51 | GPT-5.6 Luna | Flask | 77% | 99% (+22%) | A | $0.43 | 2m 20s |
| 52 | GPT-5.6 Terra | SPA JS | 98% | 99% (+1%) | A | $0.46 | 1m 58s |
| 53 | GPT-5.6 Terra | Express | 97% | 99% (+2%) | A | $0.49 | 1m 1s |
| 54 | Claude Sonnet 5 | Flask | 87% | 99% (+12%) | A | $0.58 | 2m 57s |
| 55 | GPT-5.6 Terra | Flask | 82% | 99% (+17%) | A | $0.63 | 1m 17s |
| 56 | Gemini 3.1 Pro | Vue | 98% | 99% (+1%) | A | $0.64 | 1m 11s |
| 57 | Gemini 3.8 Flash | SPA JS | 98% | 99% (+1%) | A | $0.39 | 1m 11s |
| 58 | Gemini 3.8 Flash | React | 98% | 96% (-2%) | A | $0.60 | 2m 27s |
| 59 | GPT-5.6 Sol | SPA JS | 100% | 99% (-1%) | A | $1.04 | 1m 9s |
| 60 | Gemini 3.1 Pro | Flask | 81% | 99% (+18%) | A | $1.12 | 1m 44s |
| 61 | GPT-5.6 Terra | Android | 86% | 99% (+13%) | A | $1.21 | 1m 59s |
| 62 | GPT-5.6 Sol | Vue | 97% | 99% (+2%) | A | $1.38 | 2m 12s |
| 63 | GPT-5.6 Sol | Angular | 99% | 99% (+0%) | A | $1.42 | 1m 58s |
| 64 | GPT-5.6 Sol | FastAPI | 66% | 99% (+33%) | A | $1.46 | 1m 33s |
| 65 | Gemini 3.8 Flash | Expo | 89% | 98% (+9%) | A | $0.76 | 2m 12s |
| 66 | GPT-5.6 Sol | React | 99% | 99% (+0%) | A | $1.53 | 1m 47s |
| 67 | GPT-5.6 Sol | React Native | 94% | 99% (+5%) | A | $1.57 | 2m 18s |
| 68 | Gemini 3.8 Flash | Next.js | 95% | 100% (+5%) | A | $0.52 | 2m 4s |
| 69 | GPT-5.6 Sol | Next.js | 99% | 99% (+0%) | A | $1.81 | 2m 1s |
| 70 | GPT-5.6 Sol | Express API | 84% | 99% (+15%) | A | $2.78 | 3m 8s |
| 71 | Claude Opus 5 | Android | 94% | 99% (+5%) | A | $2.84 | 5m 16s |
| 72 | Claude Haiku 5.5 | Fastify API | 82% | 100% (+18%) | A | $0.74 | 50s |
| 73 | GPT-5.6 Luna | Fastify API | 70% | 98% (+28%) | A | $0.22 | 1m 14s |
| 74 | Gemini 3.1 Pro | Express | 98% | 98% (+0%) | A | $0.53 | 59s |
| 75 | Gemini 3.1 Pro | FastAPI | 68% | 98% (+30%) | A | $0.53 | 1m 5s |
| 76 | GPT-5.6 Terra | Swift | 74% | 98% (+24%) | A | $0.55 | 1m 8s |
| 77 | Gemini 3.1 Pro | Fastify API | 72% | 97% (+25%) | A | $0.69 | 1m 4s |
| 78 | Gemini 3.8 Flash | FastAPI | 68% | 98% (+30%) | A | $0.52 | 1m 52s |
| 79 | GPT-5.6 Terra | Express API | 84% | 98% (+14%) | A | $0.91 | 1m 53s |
| 80 | Claude Opus 5 | SPA JS | 94% | 98% (+4%) | A | $1.05 | 2m 7s |
| 81 | GPT-5.6 Sol | Fastify API | 71% | 98% (+27%) | A | $1.06 | 1m 11s |
| 82 | Gemini 3.8 Flash | Vue | 97% | 97% (+0%) | A | $0.33 | 1m 26s |
| 83 | Gemini 3.1 Pro | Nuxt | 91% | 98% (+7%) | A | $1.47 | 3m 3s |
| 84 | Claude Opus 5 | Swift | 95% | 98% (+3%) | A | $1.48 | 2m 59s |
| 85 | Gemini 3.8 Flash | Nuxt | 89% | 96% (+7%) | A | $0.55 | 2m 31s |
| 86 | Claude Sonnet 5 | React Native | 73% | 98% (+25%) | A | $1.57 | 7m 22s |
| 87 | GPT-5.6 Sol | Flask | 80% | 98% (+18%) | A | $2.08 | 3m 34s |
| 88 | GPT-5.6 Sol | Android | 90% | 98% (+8%) | A | $2.56 | 3m 52s |
| 89 | GPT-5.6 Sol | Nuxt | 100% | 98% (-2%) | A | $4.11 | 4m 9s |
| 90 | Claude Haiku 5.5 | Swift | 79% | 93% (+14%) | A | $0.96 | 1m 3s |
| 91 | GPT-5.6 Luna | Express | 93% | 97% (+4%) | A | $0.23 | 1m 35s |
| 92 | Gemini 3.1 Pro | Swift | 72% | 97% (+25%) | A | $0.37 | 48s |
| 93 | Gemini 3.1 Pro | Express API | 88% | 97% (+9%) | A | $0.53 | 54s |
| 94 | Claude Haiku 5.5 | Angular | 98% | 100% (+2%) | A | $1.16 | 1m 39s |
| 95 | Claude Haiku 5.5 | Vue | 80% | 100% (+20%) | A | $0.92 | 1m 31s |
| 96 | Gemini 3.8 Flash | Express | 85% | 96% (+11%) | A | $0.41 | 1m 32s |
| 97 | Claude Sonnet 5 | Nuxt | 97% | 96% (-1%) | A | $0.89 | 4m 15s |
| 98 | Gemini 3.8 Flash | Fastify API | 65% | 97% (+32%) | A | $0.81 | 2m 23s |
| 99 | GPT-5.6 Terra | Expo | 89% | 97% (+8%) | A | $1.33 | 1m 45s |
| 100 | Gemini 3.8 Flash | Express API | 85% | 97% (+12%) | A | $1.52 | 3m 35s |
| 101 | Claude Opus 5 | React Native | 97% | 97% (+0%) | A | $1.63 | 4m 13s |
| 102 | Claude Opus 5 | Angular | 100% | 97% (-3%) | A | $1.69 | 6m 15s |
| 103 | GPT-5.6 Sol | Express | 95% | 97% (+2%) | A | $1.96 | 2m 32s |
| 104 | GPT-5.6 Sol | Expo | 89% | 97% (+8%) | A | $2.27 | 2m 48s |
| 105 | Gemini 3.8 Flash | React Native | 92% | 96% (+4%) | A | $1.01 | 3m 50s |
| 106 | Claude Haiku 5.5 | Expo | 90% | 99% (+9%) | A | $1.10 | 1m 18s |
| 107 | Claude Opus 5 | Express | 87% | 96% (+9%) | A | $0.63 | 1m 47s |
| 108 | Claude Opus 5 | Fastify API | 79% | 96% (+17%) | A | $0.71 | 2m 9s |
| 109 | Claude Opus 5 | Express API | 95% | 96% (+1%) | A | $0.87 | 1m 46s |
| 110 | Gemini 3.8 Flash | Flask | 78% | 95% (+17%) | A | $0.54 | 3m 11s |
| 111 | Claude Sonnet 5 | Expo | 92% | 96% (+4%) | A | $1.15 | 3m 31s |
| 112 | Claude Haiku 5.5 | Next.js | 86% | 87% (+1%) | B | $1.74 | 2m 47s |
| 113 | Gemini 3.8 Flash | Swift | 72% | 94% (+22%) | A | $0.76 | 1m 54s |
| 114 | Claude Haiku 5.5 | Flask | 86% | 96% (+10%) | A | $1.90 | 3m 14s |
| 115 | GPT-5.6 Sol | Swift | 76% | 94% (+18%) | A | $2.33 | 2m 34s |
| 116 | Claude Haiku 5.5 | Nuxt | 91% | 91% (+0%) | A | $2.20 | 3m 22s |
| 117 | Claude Haiku 5.5 | React Native | 95% | 93% (-2%) | A | $0.00 | 2m 47s |
| 118 | Claude Opus 5 | FastAPI | 63% | 92% (+29%) | A | $0.68 | 1m 40s |
| 119 | Claude Opus 5 | Flask | 82% | 91% (+9%) | A | $0.92 | 2m 23s |
| 120 | Claude Opus 5 | Nuxt | 92% | 90% (-2%) | A | $2.30 | 5m 3s |
MFA Scores
Average without Auth0 tools: 89% · Average with Auth0 tools: 98% · Targets tested: 17 · Total configurations: 136
| # | Model | Target | Without Tools | With Auth0 Tools | Grade | Cost | Time |
|---|---|---|---|---|---|---|---|
| 1 | Claude Opus 5 | Auth0 CLI | 100% | 100% (+0%) | A | $0.57 | 58s |
| 2 | Claude Opus 5 | Android | 64% | 100% (+36%) | A | $1.65 | 5m 56s |
| 3 | Claude Opus 5 | Angular | 76% | 100% (+24%) | A | $0.79 | 2m 5s |
| 4 | Claude Opus 5 | Auth0.js | 95% | 100% (+5%) | A | $0.66 | 2m 5s |
| 5 | Claude Opus 5 | Express | 90% | 100% (+10%) | A | $0.45 | 1m 21s |
| 6 | Claude Opus 5 | React | 84% | 100% (+16%) | A | $0.70 | 2m 2s |
| 7 | Claude Opus 5 | SPA JS | 84% | 100% (+16%) | A | $0.46 | 1m 12s |
| 8 | Claude Opus 5 | Swift | 95% | 100% (+5%) | A | $1.02 | 3m 24s |
| 9 | Claude Opus 5 | Vue | 54% | 100% (+46%) | A | $0.66 | 1m 47s |
| 10 | Claude Sonnet 5 | Auth0 CLI | 91% | 100% (+9%) | A | $0.18 | 38s |
| 11 | Claude Sonnet 5 | Android | 84% | 100% (+16%) | A | $0.79 | 7m 54s |
| 12 | Claude Sonnet 5 | Express API | 100% | 100% (+0%) | A | $0.22 | 1m 0s |
| 13 | Claude Sonnet 5 | Swift | 91% | 100% (+9%) | A | $0.45 | 3m 35s |
| 14 | GPT-5.6 Luna | Auth0 CLI | 92% | 100% (+8%) | A | $0.14 | 30s |
| 15 | GPT-5.6 Luna | Express API | 96% | 100% (+4%) | A | $0.15 | 29s |
| 16 | GPT-5.6 Sol | Auth0 CLI | 100% | 100% (+0%) | A | $0.88 | 41s |
| 17 | GPT-5.6 Terra | Auth0 CLI | 63% | 100% (+37%) | A | $0.36 | 30s |
| 18 | GPT-5.6 Terra | Express API | 96% | 100% (+4%) | A | $0.36 | 21s |
| 19 | Gemini 3.1 Pro | Auth0 CLI | 94% | 100% (+6%) | A | $0.59 | 51s |
| 20 | Gemini 3.1 Pro | Android | 97% | 100% (+3%) | A | $0.72 | 2m 11s |
| 21 | Gemini 3.1 Pro | React | 80% | 100% (+20%) | A | $0.95 | 1m 54s |
| 22 | Gemini 3.1 Pro | Swift | 99% | 100% (+1%) | A | $0.34 | 1m 10s |
| 23 | Gemini 3.1 Pro | Vue | 82% | 100% (+18%) | A | $0.61 | 59s |
| 24 | Gemini 3.8 Flash | Auth0 CLI | 98% | 100% (+2%) | A | $0.31 | 1m 20s |
| 25 | Gemini 3.8 Flash | Android | 88% | 100% (+12%) | A | $0.53 | 2m 46s |
| 26 | Gemini 3.8 Flash | React | 80% | 100% (+20%) | A | $0.46 | 1m 44s |
| 27 | Gemini 3.8 Flash | Swift | 74% | 100% (+26%) | A | $0.43 | 2m 22s |
| 28 | Claude Sonnet 5 | Auth0 Server JS | 66% | 100% (+34%) | A | $0.93 | 10m 18s |
| 29 | Claude Sonnet 5 | Express | 94% | 99% (+5%) | A | $0.37 | 2m 43s |
| 30 | Claude Sonnet 5 | Next.js | 87% | 99% (+12%) | A | $1.12 | 10m 38s |
| 31 | Claude Sonnet 5 | React | 83% | 99% (+16%) | A | $0.47 | 3m 18s |
| 32 | Claude Sonnet 5 | SPA JS | 84% | 99% (+15%) | A | $0.35 | 1m 43s |
| 33 | Claude Sonnet 5 | Auth0.js | 88% | 99% (+11%) | A | $1.03 | 10m 10s |
| 34 | Claude Sonnet 5 | Vue | 86% | 99% (+13%) | A | $0.56 | 2m 27s |
| 35 | GPT-5.6 Sol | Express API | 97% | 99% (+2%) | A | $1.57 | 40s |
| 36 | GPT-5.6 Sol | Vue | 81% | 99% (+18%) | A | $2.04 | 1m 27s |
| 37 | Gemini 3.1 Pro | Express | 93% | 99% (+6%) | A | $1.45 | 2m 32s |
| 38 | GPT-5.6 Terra | React | 85% | 99% (+14%) | A | $0.49 | 51s |
| 39 | Gemini 3.1 Pro | Auth0 Server JS | 97% | 99% (+2%) | A | $1.15 | 2m 32s |
| 40 | GPT-5.6 Luna | Express | 80% | 99% (+19%) | A | $0.21 | 41s |
| 41 | GPT-5.6 Luna | React | 79% | 99% (+20%) | A | $0.20 | 53s |
| 42 | GPT-5.6 Luna | SPA JS | 84% | 99% (+15%) | A | $0.20 | 38s |
| 43 | GPT-5.6 Luna | Swift | 99% | 99% (+0%) | A | $0.25 | 56s |
| 44 | Gemini 3.8 Flash | Express | 89% | 99% (+10%) | A | $0.38 | 2m 23s |
| 45 | GPT-5.6 Terra | SPA JS | 88% | 99% (+11%) | A | $0.42 | 39s |
| 46 | Gemini 3.1 Pro | Angular | 82% | 98% (+16%) | A | $1.18 | 2m 22s |
| 47 | GPT-5.6 Sol | React | 82% | 98% (+16%) | A | $1.81 | 1m 38s |
| 48 | GPT-5.6 Terra | Angular | 83% | 98% (+15%) | A | $0.70 | 58s |
| 49 | GPT-5.6 Terra | Vue | 80% | 98% (+18%) | A | $0.74 | 52s |
| 50 | Claude Opus 5 | Auth0 Server JS | 69% | 98% (+29%) | A | $1.25 | 3m 32s |
| 51 | GPT-5.6 Terra | Auth0 Server JS | 98% | 98% (+0%) | A | $0.74 | 1m 29s |
| 52 | Claude Haiku 5.5 | Express API | 99% | 100% (+1%) | A | $0.39 | 33s |
| 53 | Claude Opus 5 | Express API | 89% | 98% (+9%) | A | $0.61 | 1m 8s |
| 54 | Claude Sonnet 5 | Python | 70% | 98% (+28%) | A | $0.69 | 5m 14s |
| 55 | Gemini 3.1 Pro | Auth0.js | 92% | 98% (+6%) | A | $0.83 | 1m 52s |
| 56 | GPT-5.6 Luna | Vue | 80% | 98% (+18%) | A | $0.24 | 55s |
| 57 | GPT-5.6 Sol | Angular | 81% | 98% (+17%) | A | $1.85 | 1m 37s |
| 58 | Gemini 3.1 Pro | SPA JS | 88% | 98% (+10%) | A | $0.80 | 1m 16s |
| 59 | Gemini 3.8 Flash | Auth0.js | 94% | 98% (+4%) | A | $0.75 | 2m 35s |
| 60 | GPT-5.6 Sol | Android | 99% | 97% (-2%) | A | $2.35 | 3m 29s |
| 61 | Gemini 3.1 Pro | Express API | 97% | 97% (+0%) | A | $0.87 | 1m 24s |
| 62 | GPT-5.6 Sol | SPA JS | 82% | 97% (+15%) | A | $1.15 | 54s |
| 63 | GPT-5.6 Sol | Next.js | 96% | 97% (+1%) | A | $1.85 | 2m 55s |
| 64 | GPT-5.6 Sol | Swift | 90% | 97% (+7%) | A | $2.06 | 2m 17s |
| 65 | Gemini 3.8 Flash | SPA JS | 86% | 97% (+11%) | A | $0.35 | 1m 51s |
| 66 | GPT-5.6 Luna | Android | 97% | 97% (+0%) | A | $0.37 | 1m 30s |
| 67 | GPT-5.6 Terra | Android | 98% | 97% (-1%) | A | $0.96 | 1m 58s |
| 68 | GPT-5.6 Luna | Angular | 78% | 97% (+19%) | A | $0.32 | 1m 7s |
| 69 | Gemini 3.8 Flash | Auth0 Server JS | 88% | 97% (+9%) | A | $0.76 | 5m 56s |
| 70 | Gemini 3.8 Flash | Angular | 81% | 96% (+15%) | A | $1.32 | 3m 14s |
| 71 | Gemini 3.8 Flash | Vue | 82% | 96% (+14%) | A | $0.40 | 3m 6s |
| 72 | GPT-5.6 Sol | Auth0 Server JS | 99% | 96% (-3%) | A | $1.96 | 1m 44s |
| 73 | Claude Haiku 5.5 | SPA JS | 86% | 99% (+13%) | A | $0.57 | 52s |
| 74 | GPT-5.6 Sol | Auth0.js | 95% | 96% (+1%) | A | $1.90 | 1m 22s |
| 75 | GPT-5.6 Terra | Auth0.js | 93% | 96% (+3%) | A | $0.76 | 1m 4s |
| 76 | Gemini 3.8 Flash | Next.js | 85% | 96% (+11%) | A | $0.95 | 3m 15s |
| 77 | Gemini 3.8 Flash | Express API | 95% | 96% (+1%) | A | $0.40 | 1m 49s |
| 78 | Claude Haiku 5.5 | Express | 92% | 97% (+5%) | A | $1.67 | 3m 30s |
| 79 | GPT-5.6 Terra | Express | 87% | 96% (+9%) | A | $0.61 | 54s |
| 80 | Claude Opus 5 | Python | 81% | 95% (+14%) | A | $0.81 | 1m 57s |
| 81 | Gemini 3.1 Pro | Next.js | 97% | 95% (-2%) | A | $1.02 | 1m 59s |
| 82 | GPT-5.6 Sol | Express | 86% | 95% (+9%) | A | $1.16 | 1m 11s |
| 83 | GPT-5.6 Luna | Python | 88% | 95% (+7%) | A | $0.41 | 1m 22s |
| 84 | GPT-5.6 Luna | Auth0.js | 97% | 94% (-3%) | A | $0.42 | 1m 7s |
| 85 | GPT-5.6 Terra | Swift | 87% | 94% (+7%) | A | $1.28 | 1m 34s |
| 86 | GPT-5.6 Terra | Next.js | 95% | 94% (-1%) | A | $0.75 | 1m 24s |
| 87 | GPT-5.6 Luna | Next.js | 94% | 94% (+0%) | A | $0.35 | 1m 16s |
| 88 | Gemini 3.8 Flash | Python | 92% | 94% (+2%) | A | $0.52 | 3m 17s |
| 89 | Claude Haiku 5.5 | Vue | 79% | 100% (+21%) | A | $0.75 | 1m 15s |
| 90 | GPT-5.6 Sol | Python | 85% | 93% (+8%) | A | $1.71 | 1m 47s |
| 91 | GPT-5.6 Terra | Python | 77% | 93% (+16%) | A | $0.70 | 1m 3s |
| 92 | Claude Haiku 5.5 | React | 84% | 99% (+15%) | A | $0.61 | 1m 1s |
| 93 | Claude Opus 5 | Next.js | 84% | 92% (+8%) | A | $0.00 | 8m 18s |
| 94 | Claude Sonnet 5 | Angular | 82% | 91% (+9%) | A | $0.88 | 5m 45s |
| 95 | GPT-5.6 Luna | Auth0 Server JS | 86% | 90% (+4%) | A | $0.45 | 1m 33s |
| 96 | Claude Haiku 5.5 | Swift | 96% | 100% (+4%) | A | $0.72 | 1m 18s |
| 97 | Gemini 3.1 Pro | Python | 74% | 87% (+13%) | B | $0.60 | 1m 40s |
| 98 | Claude Haiku 5.5 | Android | 82% | 99% (+17%) | A | $2.10 | 4m 13s |
| 99 | Claude Haiku 5.5 | Auth0.js | 91% | 92% (+1%) | A | $2.22 | 4m 15s |
| 100 | Claude Haiku 5.5 | Next.js | 97% | 95% (-2%) | A | $1.50 | 2m 46s |
| 101 | Claude Haiku 5.5 | Python | 71% | 92% (+21%) | A | $1.85 | 3m 57s |
| 102 | Claude Haiku 5.5 | Auth0 Server JS | 87% | 90% (+3%) | A | $2.80 | 6m 3s |
| 103 | Claude Haiku 5.5 | Auth0 CLI | 86% | 97% (+11%) | A | $0.53 | 37s |
| 104 | Claude Haiku 5.5 | Angular | 84% | 85% (+1%) | B | $1.02 | 2m 3s |
| 105 | GPT-5.6 Terra | Python API | 100% | 100% (+0%) | A | $0.40 | 17s |
| 106 | Claude Sonnet 5 | Go | 100% | 100% (+0%) | A | $0.11 | 18s |
| 107 | Gemini 3.8 Flash | ASP.NET Core API | 99% | 100% (+1%) | A | $0.15 | 49s |
| 108 | Claude Sonnet 5 | Python API | 95% | 100% (+5%) | A | $0.14 | 29s |
| 109 | Claude Opus 5 | React Native | 65% | 100% (+35%) | A | $1.08 | 3m 8s |
| 110 | Claude Sonnet 5 | React Native | 66% | 99% (+33%) | A | $0.56 | 2m 35s |
| 111 | Gemini 3.1 Pro | React Native | 96% | 99% (+3%) | A | $0.80 | 2m 15s |
| 112 | Claude Haiku 5.5 | ASP.NET Core API | 99% | 98% (-1%) | A | $0.29 | 24s |
| 113 | Gemini 3.8 Flash | React Native | 100% | 99% (-1%) | A | $3.32 | 9m 28s |
| 114 | Claude Sonnet 5 | ASP.NET Core API | 99% | 99% (+0%) | A | $0.15 | 28s |
| 115 | Gemini 3.1 Pro | ASP.NET Core API | 99% | 98% (-0%) | A | $0.29 | 34s |
| 116 | GPT-5.6 Terra | ASP.NET Core API | 98% | 98% (+0%) | A | $0.53 | 22s |
| 117 | GPT-5.6 Terra | Go | 98% | 98% (+1%) | A | $0.58 | 26s |
| 118 | GPT-5.6 Luna | Go | 100% | 98% (-2%) | A | $0.19 | 24s |
| 119 | GPT-5.6 Luna | Python API | 98% | 98% (-0%) | A | $0.26 | 35s |
| 120 | GPT-5.6 Sol | Python API | 97% | 98% (+1%) | A | $1.18 | 44s |
| 121 | Claude Opus 5 | Python API | 98% | 98% (+0%) | A | $0.46 | 51s |
| 122 | Claude Opus 5 | Go | 98% | 98% (+0%) | A | $0.50 | 56s |
| 123 | Gemini 3.1 Pro | Go | 97% | 98% (+1%) | A | $0.29 | 37s |
| 124 | Claude Opus 5 | ASP.NET Core API | 98% | 98% (+0%) | A | $0.59 | 38s |
| 125 | Claude Haiku 5.5 | Go | 98% | 98% (+0%) | A | $0.21 | 19s |
| 126 | GPT-5.6 Sol | ASP.NET Core API | 98% | 97% (-0%) | A | $1.20 | 24s |
| 127 | GPT-5.6 Terra | React Native | 99% | 97% (-2%) | A | $0.85 | 1m 1s |
| 128 | GPT-5.6 Sol | Go | 98% | 97% (-1%) | A | $1.06 | 30s |
| 129 | GPT-5.6 Sol | React Native | 96% | 97% (+1%) | A | $1.42 | 1m 12s |
| 130 | GPT-5.6 Luna | ASP.NET Core API | 96% | 97% (+1%) | A | $0.23 | 30s |
| 131 | Claude Haiku 5.5 | Python API | 100% | 98% (-2%) | A | $0.16 | 14s |
| 132 | Gemini 3.8 Flash | Go | 96% | 96% (-0%) | A | $0.52 | 2m 53s |
| 133 | Gemini 3.8 Flash | Python API | 97% | 95% (-1%) | A | $0.44 | 1m 15s |
| 134 | GPT-5.6 Luna | React Native | 97% | 95% (-2%) | A | $0.34 | 49s |
| 135 | Gemini 3.1 Pro | Python API | 96% | 94% (-3%) | A | $0.30 | 38s |
| 136 | Claude Haiku 5.5 | React Native | 99% | 97% (-2%) | A | $2.33 | 3m 52s |
Organizations Scores
Average without Auth0 tools: 92% · Average with Auth0 tools: 98% · Targets tested: 18 · Total configurations: 144
| # | Model | Target | Without Tools | With Auth0 Tools | Grade | Cost | Time |
|---|---|---|---|---|---|---|---|
| 1 | Claude Opus 5 | Auth0 CLI | 100% | 100% (+0%) | A | $0.78 | 1m 20s |
| 2 | Claude Sonnet 5 | Auth0 CLI | 74% | 94% (+20%) | A | $0.39 | 1m 45s |
| 3 | Gemini 3.1 Pro | Auth0 CLI | 100% | 100% (+0%) | A | $2.51 | 2m 28s |
| 4 | Gemini 3.8 Flash | Auth0 CLI | 100% | 100% (+0%) | A | $0.38 | 1m 1s |
| 5 | Claude Sonnet 5 | React | 100% | 100% (+0%) | A | $0.19 | 1m 13s |
| 6 | Gemini 3.1 Pro | React | 100% | 100% (+0%) | A | $0.32 | 41s |
| 7 | GPT-5.6 Terra | React | 100% | 99% (-1%) | A | $0.51 | 32s |
| 8 | Claude Opus 5 | Python | 100% | 100% (+0%) | A | $0.71 | 1m 41s |
| 9 | Claude Opus 5 | SPA JS | 100% | 100% (+0%) | A | $0.45 | 1m 2s |
| 10 | Gemini 3.1 Pro | SPA JS | 100% | 99% (-1%) | A | $0.79 | 1m 23s |
| 11 | Gemini 3.8 Flash | SPA JS | 100% | 100% (+0%) | A | $0.30 | 1m 23s |
| 12 | GPT-5.6 Terra | SPA JS | 100% | 99% (-1%) | A | $0.51 | 44s |
| 13 | Claude Opus 5 | Swift | 100% | 100% (+0%) | A | $0.92 | 2m 12s |
| 14 | Gemini 3.1 Pro | Auth0 Server JS | 99% | 100% (+1%) | A | $2.05 | 1m 46s |
| 15 | Claude Opus 5 | Express API | 99% | 100% (+1%) | A | $0.42 | 58s |
| 16 | Gemini 3.1 Pro | Swift | 99% | 100% (+1%) | A | $0.89 | 1m 32s |
| 17 | Gemini 3.8 Flash | Express API | 99% | 97% (-2%) | A | $0.38 | 1m 22s |
| 18 | Gemini 3.8 Flash | Auth0 API JS | 99% | 98% (-1%) | A | $0.54 | 2m 8s |
| 19 | Gemini 3.1 Pro | Express API | 98% | 99% (+1%) | A | $0.71 | 1m 1s |
| 20 | Gemini 3.8 Flash | Python | 98% | 98% (+0%) | A | $1.69 | 3m 52s |
| 21 | Gemini 3.1 Pro | Android | 98% | 95% (-3%) | A | $0.41 | 2m 4s |
| 22 | Claude Sonnet 5 | Auth0 API JS | 98% | 100% (+2%) | A | $0.26 | 1m 18s |
| 23 | Claude Opus 5 | Android | 97% | 100% (+3%) | A | $1.27 | 4m 5s |
| 24 | Gemini 3.8 Flash | Swift | 97% | 100% (+3%) | A | $0.53 | 1m 49s |
| 25 | Claude Opus 5 | Auth0 API JS | 97% | 100% (+3%) | A | $0.44 | 1m 10s |
| 26 | GPT-5.6 Sol | SPA JS | 97% | 99% (+2%) | A | $1.18 | 1m 4s |
| 27 | Claude Opus 5 | Auth0 Server JS | 97% | 100% (+3%) | A | $0.59 | 1m 47s |
| 28 | Claude Sonnet 5 | Python | 96% | 100% (+4%) | A | $0.61 | 3m 55s |
| 29 | GPT-5.6 Terra | Next.js | 96% | 95% (-1%) | A | $0.47 | 39s |
| 30 | GPT-5.6 Luna | Swift | 96% | 98% (+2%) | A | $0.27 | 1m 24s |
| 31 | Claude Sonnet 5 | Auth0 Server JS | 96% | 99% (+3%) | A | $0.74 | 5m 53s |
| 32 | GPT-5.6 Sol | Express API | 96% | 96% (+0%) | A | $3.60 | 1m 51s |
| 33 | GPT-5.6 Terra | Swift | 96% | 96% (+0%) | A | $0.72 | 1m 1s |
| 34 | Gemini 3.1 Pro | Auth0.js | 96% | 100% (+4%) | A | $2.46 | 3m 42s |
| 35 | GPT-5.6 Sol | React | 96% | 98% (+2%) | A | $1.58 | 1m 20s |
| 36 | Gemini 3.8 Flash | Express | 95% | 99% (+4%) | A | $0.39 | 1m 44s |
| 37 | GPT-5.6 Terra | Python | 94% | 97% (+3%) | A | $0.89 | 1m 13s |
| 38 | GPT-5.6 Luna | SPA JS | 94% | 99% (+5%) | A | $0.23 | 32s |
| 39 | Gemini 3.1 Pro | Auth0 API JS | 93% | 98% (+5%) | A | $0.56 | 52s |
| 40 | GPT-5.6 Luna | Python | 93% | 99% (+6%) | A | $0.36 | 59s |
| 41 | GPT-5.6 Sol | Android | 93% | 96% (+3%) | A | $3.46 | 2m 32s |
| 42 | Claude Sonnet 5 | SPA JS | 93% | 99% (+6%) | A | $0.35 | 1m 25s |
| 43 | Claude Opus 5 | Express | 93% | 100% (+7%) | A | $0.69 | 1m 35s |
| 44 | GPT-5.6 Sol | Auth0 CLI | 95% | 95% (+0%) | A | $1.20 | 39s |
| 45 | GPT-5.6 Terra | Auth0 CLI | 95% | 95% (+0%) | A | $0.59 | 32s |
| 46 | GPT-5.6 Sol | Python | 93% | 99% (+6%) | A | $2.38 | 1m 36s |
| 47 | GPT-5.6 Luna | React | 93% | 100% (+7%) | A | $0.13 | 39s |
| 48 | GPT-5.6 Luna | Android | 93% | 99% (+6%) | A | $0.27 | 58s |
| 49 | Gemini 3.1 Pro | Next.js | 93% | 96% (+3%) | A | $0.50 | 1m 4s |
| 50 | Gemini 3.8 Flash | React | 92% | 100% (+8%) | A | $0.38 | 1m 48s |
| 51 | Gemini 3.8 Flash | Next.js | 92% | 96% (+4%) | A | $1.24 | 3m 28s |
| 52 | Gemini 3.8 Flash | Android | 92% | 93% (+1%) | A | $0.56 | 2m 35s |
| 53 | Claude Opus 5 | Auth0.js | 92% | 100% (+8%) | A | $0.92 | 2m 30s |
| 54 | GPT-5.6 Luna | Next.js | 92% | 96% (+4%) | A | $0.33 | 56s |
| 55 | Claude Opus 5 | React | 91% | 100% (+9%) | A | $0.46 | 1m 18s |
| 56 | Claude Haiku 5.5 | Python | 89% | 97% (+8%) | A | $0.74 | 1m 8s |
| 57 | GPT-5.6 Sol | Next.js | 90% | 99% (+9%) | A | $2.27 | 1m 36s |
| 58 | Claude Haiku 5.5 | Auth0 Server JS | 95% | 99% (+4%) | A | $0.89 | 1m 29s |
| 59 | Claude Haiku 5.5 | Auth0 API JS | 98% | 100% (+2%) | A | $0.82 | 1m 17s |
| 60 | GPT-5.6 Sol | Auth0 API JS | 89% | 98% (+9%) | A | $0.95 | 44s |
| 61 | Claude Haiku 5.5 | Express API | 90% | 98% (+8%) | A | $0.54 | 54s |
| 62 | Claude Opus 5 | Next.js | 89% | 96% (+7%) | A | $0.56 | 2m 3s |
| 63 | Gemini 3.1 Pro | Python | 89% | 97% (+8%) | A | $0.68 | 56s |
| 64 | Gemini 3.1 Pro | Express | 89% | 98% (+9%) | A | $0.58 | 1m 5s |
| 65 | GPT-5.6 Terra | Android | 88% | 96% (+8%) | A | $0.89 | 1m 44s |
| 66 | GPT-5.6 Terra | Auth0 API JS | 88% | 97% (+9%) | A | $0.62 | 58s |
| 67 | GPT-5.6 Terra | Express API | 88% | 99% (+11%) | A | $0.54 | 32s |
| 68 | Claude Haiku 5.5 | React | 89% | 96% (+7%) | A | $0.60 | 1m 8s |
| 69 | GPT-5.6 Luna | Auth0 API JS | 88% | 100% (+12%) | A | $0.21 | 38s |
| 70 | GPT-5.6 Sol | Express | 88% | 97% (+9%) | A | $2.54 | 1m 51s |
| 71 | Claude Sonnet 5 | Express API | 88% | 100% (+12%) | A | $0.26 | 1m 19s |
| 72 | GPT-5.6 Luna | Express | 87% | 98% (+11%) | A | $0.15 | 46s |
| 73 | Claude Haiku 5.5 | Express | 88% | 99% (+11%) | A | $1.03 | 1m 40s |
| 74 | GPT-5.6 Luna | Auth0 Server JS | 86% | 99% (+13%) | A | $0.24 | 42s |
| 75 | Claude Haiku 5.5 | SPA JS | 95% | 99% (+4%) | A | $0.66 | 1m 10s |
| 76 | GPT-5.6 Sol | Swift | 86% | 95% (+9%) | A | $3.78 | 2m 4s |
| 77 | Claude Haiku 5.5 | Swift | 95% | 100% (+5%) | A | $0.74 | 1m 26s |
| 78 | Claude Haiku 5.5 | Next.js | 94% | 97% (+3%) | A | $1.75 | 3m 28s |
| 79 | GPT-5.6 Luna | Express API | 84% | 97% (+13%) | A | $0.21 | 36s |
| 80 | GPT-5.6 Terra | Auth0 Server JS | 83% | 98% (+15%) | A | $0.62 | 1m 6s |
| 81 | GPT-5.6 Sol | Auth0.js | 82% | 97% (+15%) | A | $3.59 | 2m 31s |
| 82 | GPT-5.6 Terra | Auth0.js | 82% | 96% (+14%) | A | $0.75 | 1m 8s |
| 83 | GPT-5.6 Sol | Auth0 Server JS | 82% | 98% (+16%) | A | $1.18 | 53s |
| 84 | Gemini 3.8 Flash | Auth0 Server JS | 81% | 97% (+16%) | A | $0.46 | 2m 19s |
| 85 | Claude Sonnet 5 | Swift | 81% | 96% (+15%) | A | $1.03 | 6m 43s |
| 86 | GPT-5.6 Terra | Express | 81% | 99% (+18%) | A | $0.55 | 47s |
| 87 | GPT-5.6 Luna | Auth0.js | 81% | 97% (+16%) | A | $0.66 | 1m 32s |
| 88 | Claude Haiku 5.5 | Android | 86% | 98% (+12%) | A | $1.56 | 2m 54s |
| 89 | GPT-5.6 Luna | Auth0 CLI | 66% | 89% (+23%) | B | $0.24 | 39s |
| 90 | Claude Haiku 5.5 | Auth0.js | 92% | 96% (+4%) | A | $1.64 | 2m 51s |
| 91 | Gemini 3.8 Flash | Auth0.js | 74% | 99% (+25%) | A | $1.17 | 3m 6s |
| 92 | Claude Sonnet 5 | Android | 80% | 96% (+16%) | A | $1.24 | 8m 34s |
| 93 | Claude Sonnet 5 | Express | 72% | 100% (+28%) | A | $0.39 | 2m 23s |
| 94 | Claude Sonnet 5 | Auth0.js | 71% | 100% (+29%) | A | $1.29 | 7m 0s |
| 95 | Claude Sonnet 5 | Next.js | 69% | 100% (+31%) | A | $0.75 | 5m 9s |
| 96 | Claude Haiku 5.5 | Auth0 CLI | 83% | 100% (+17%) | A | $0.65 | 1m 1s |
| 97 | Gemini 3.1 Pro | ASP.NET Core API | 100% | 100% (+0%) | A | $0.43 | 43s |
| 98 | Gemini 3.1 Pro | React Native | 100% | 100% (+0%) | A | $0.47 | 53s |
| 99 | GPT-5.6 Terra | Python API | 100% | 100% (+0%) | A | $0.51 | 36s |
| 100 | GPT-5.6 Luna | .NET OIDC (iOS) | 97% | 100% (+3%) | A | $0.19 | 40s |
| 101 | Gemini 3.1 Pro | .NET OIDC (WPF) | 97% | 100% (+3%) | A | $0.90 | 2m 6s |
| 102 | Claude Opus 5 | .NET OIDC (WPF) | 97% | 100% (+3%) | A | $0.79 | 2m 10s |
| 103 | Claude Opus 5 | .NET OIDC (iOS) | 97% | 100% (+3%) | A | $0.59 | 1m 53s |
| 104 | GPT-5.6 Sol | Python API | 97% | 100% (+3%) | A | $2.40 | 1m 17s |
| 105 | Claude Opus 5 | Python API | 97% | 100% (+3%) | A | $0.38 | 59s |
| 106 | Claude Sonnet 5 | .NET OIDC (WPF) | 96% | 100% (+4%) | A | $0.48 | 3m 49s |
| 107 | Gemini 3.1 Pro | Go | 93% | 100% (+7%) | A | $0.34 | 53s |
| 108 | Claude Opus 5 | Go | 90% | 100% (+10%) | A | $0.74 | 2m 34s |
| 109 | Claude Opus 5 | ASP.NET Core API | 88% | 100% (+12%) | A | $0.49 | 1m 16s |
| 110 | Claude Haiku 5.5 | React Native | 91% | 94% (+3%) | A | $0.00 | 3m 34s |
| 111 | Claude Opus 5 | React Native | 86% | 100% (+14%) | A | $0.69 | 2m 12s |
| 112 | Gemini 3.8 Flash | .NET OIDC (WPF) | 95% | 100% (+5%) | A | $1.65 | 9m 47s |
| 113 | Gemini 3.8 Flash | ASP.NET Core API | 87% | 100% (+13%) | A | $1.04 | 3m 11s |
| 114 | Gemini 3.8 Flash | Python API | 99% | 100% (+1%) | A | $1.90 | 4m 57s |
| 115 | Gemini 3.8 Flash | .NET OIDC (iOS) | 96% | 100% (+4%) | A | $3.04 | 29m 2s |
| 116 | Gemini 3.8 Flash | Go | 87% | 100% (+13%) | A | $2.26 | 8m 59s |
| 117 | Claude Sonnet 5 | .NET OIDC (iOS) | 93% | 99% (+6%) | A | $0.90 | 6m 30s |
| 118 | Gemini 3.1 Pro | Python API | 100% | 99% (-1%) | A | $2.57 | 2m 39s |
| 119 | Gemini 3.8 Flash | React Native | 87% | 99% (+12%) | A | $1.83 | 7m 57s |
| 120 | Claude Sonnet 5 | Python API | 100% | 99% (-1%) | A | $0.24 | 1m 27s |
| 121 | Claude Sonnet 5 | ASP.NET Core API | 95% | 99% (+4%) | A | $0.18 | 40s |
| 122 | GPT-5.6 Luna | Python API | 97% | 99% (+2%) | A | $0.26 | 46s |
| 123 | GPT-5.6 Sol | .NET OIDC (iOS) | 92% | 99% (+7%) | A | $1.69 | 1m 24s |
| 124 | GPT-5.6 Luna | .NET OIDC (WPF) | 96% | 99% (+3%) | A | $0.20 | 49s |
| 125 | GPT-5.6 Terra | ASP.NET Core API | 98% | 99% (+1%) | A | $0.52 | 25s |
| 126 | GPT-5.6 Sol | ASP.NET Core API | 100% | 98% (-2%) | A | $0.97 | 46s |
| 127 | GPT-5.6 Terra | React Native | 88% | 98% (+10%) | A | $0.42 | 35s |
| 128 | GPT-5.6 Luna | React Native | 89% | 98% (+9%) | A | $0.21 | 47s |
| 129 | GPT-5.6 Sol | .NET OIDC (WPF) | 94% | 98% (+4%) | A | $1.46 | 1m 12s |
| 130 | Claude Sonnet 5 | Go | 92% | 98% (+6%) | A | $0.46 | 1m 31s |
| 131 | GPT-5.6 Sol | Go | 90% | 98% (+8%) | A | $3.69 | 1m 22s |
| 132 | GPT-5.6 Terra | Go | 99% | 97% (-2%) | A | $0.81 | 50s |
| 133 | GPT-5.6 Terra | .NET OIDC (iOS) | 91% | 97% (+6%) | A | $0.63 | 39s |
| 134 | Gemini 3.1 Pro | .NET OIDC (iOS) | 97% | 97% (+0%) | A | $0.75 | 1m 19s |
| 135 | GPT-5.6 Luna | ASP.NET Core API | 97% | 97% (+0%) | A | $0.17 | 31s |
| 136 | Claude Haiku 5.5 | .NET OIDC (WPF) | 91% | 100% (+9%) | A | $0.78 | 1m 25s |
| 137 | GPT-5.6 Luna | Go | 83% | 97% (+14%) | A | $0.42 | 1m 15s |
| 138 | Claude Sonnet 5 | React Native | 98% | 97% (-1%) | A | $0.41 | 3m 11s |
| 139 | Claude Haiku 5.5 | Python API | 98% | 100% (+2%) | A | $0.76 | 1m 24s |
| 140 | GPT-5.6 Terra | .NET OIDC (WPF) | 93% | 96% (+3%) | A | $0.68 | 47s |
| 141 | GPT-5.6 Sol | React Native | 93% | 96% (+3%) | A | $1.53 | 1m 1s |
| 142 | Claude Haiku 5.5 | ASP.NET Core API | 94% | 99% (+5%) | A | $0.73 | 1m 13s |
| 143 | Claude Haiku 5.5 | Go | 91% | 98% (+7%) | A | $0.77 | 1m 0s |
| 144 | Claude Haiku 5.5 | .NET OIDC (iOS) | 96% | 100% (+4%) | A | $0.84 | 1m 29s |
Passkeys Scores
Average without Auth0 tools: 85% · Average with Auth0 tools: 97% · Targets tested: 10 · Total configurations: 80
| # | Model | Target | Without Tools | With Auth0 Tools | Grade | Cost | Time |
|---|---|---|---|---|---|---|---|
| 1 | GPT-5.6 Luna | Auth0 CLI | 100% | 100% (+0%) | A | $0.25 | 36s |
| 2 | Gemini 3.8 Flash | Auth0 CLI | 100% | 100% (+0%) | A | $0.83 | 3m 16s |
| 3 | Claude Opus 5 | Auth0.js | 100% | 100% (+0%) | A | $1.14 | 3m 27s |
| 4 | Gemini 3.1 Pro | Auth0.js | 100% | 100% (+0%) | A | $1.72 | 2m 23s |
| 5 | GPT-5.6 Sol | Auth0 CLI | 100% | 97% (-3%) | A | $1.43 | 36s |
| 6 | Gemini 3.8 Flash | Auth0 Server JS | 100% | 100% (+0%) | A | $4.69 | 12m 6s |
| 7 | Gemini 3.8 Flash | SPA JS | 100% | 100% (+0%) | A | $2.52 | 6m 21s |
| 8 | Gemini 3.8 Flash | React | 99% | 100% (+1%) | A | $1.21 | 4m 19s |
| 9 | Claude Sonnet 5 | Auth0 Server JS | 98% | 97% (-1%) | A | $0.00 | 15m 10s |
| 10 | GPT-5.6 Terra | Auth0.js | 98% | 96% (-2%) | A | $1.16 | 1m 5s |
| 11 | GPT-5.6 Terra | Swift | 98% | 96% (-2%) | A | $1.12 | 1m 14s |
| 12 | Gemini 3.1 Pro | Swift | 98% | 100% (+2%) | A | $1.15 | 2m 51s |
| 13 | GPT-5.6 Sol | Auth0.js | 98% | 96% (-2%) | A | $2.65 | 1m 31s |
| 14 | GPT-5.6 Sol | Auth0 Server JS | 97% | 94% (-3%) | A | $3.30 | 1m 29s |
| 15 | GPT-5.6 Luna | Auth0 Server JS | 97% | 98% (+1%) | A | $0.25 | 46s |
| 16 | GPT-5.6 Luna | Next.js | 96% | 94% (-2%) | A | $0.46 | 1m 29s |
| 17 | Claude Opus 5 | Swift | 96% | 100% (+4%) | A | $1.11 | 3m 44s |
| 18 | GPT-5.6 Luna | Swift | 96% | 97% (+1%) | A | $0.29 | 59s |
| 19 | Gemini 3.1 Pro | Next.js | 95% | 93% (-2%) | A | $1.40 | 2m 25s |
| 20 | GPT-5.6 Terra | Next.js | 95% | 91% (-4%) | A | $1.18 | 1m 21s |
| 21 | GPT-5.6 Luna | Python | 95% | 94% (-1%) | A | $0.24 | 41s |
| 22 | Claude Sonnet 5 | Next.js | 95% | 90% (-5%) | B | $0.00 | 13m 58s |
| 23 | Claude Opus 5 | Next.js | 95% | 95% (+0%) | A | $1.04 | 3m 16s |
| 24 | GPT-5.6 Terra | Python | 95% | 95% (+0%) | A | $1.12 | 1m 6s |
| 25 | Gemini 3.8 Flash | Next.js | 95% | 95% (+0%) | A | $4.06 | 10m 37s |
| 26 | GPT-5.6 Sol | Next.js | 95% | 93% (-2%) | A | $4.08 | 1m 49s |
| 27 | GPT-5.6 Terra | Auth0 Server JS | 94% | 98% (+4%) | A | $0.58 | 55s |
| 28 | Claude Opus 5 | Auth0 Server JS | 94% | 100% (+6%) | A | $1.13 | 3m 11s |
| 29 | Claude Opus 5 | Auth0 CLI | 94% | 96% (+2%) | A | $0.84 | 1m 36s |
| 30 | Gemini 3.1 Pro | SPA JS | 93% | 99% (+6%) | A | $1.17 | 1m 36s |
| 31 | GPT-5.6 Sol | Python | 93% | 94% (+1%) | A | $1.28 | 1m 15s |
| 32 | Gemini 3.8 Flash | Auth0.js | 93% | 100% (+7%) | A | $2.39 | 6m 53s |
| 33 | GPT-5.6 Luna | Auth0.js | 93% | 94% (+1%) | A | $0.62 | 56s |
| 34 | GPT-5.6 Luna | SPA JS | 92% | 98% (+6%) | A | $0.24 | 41s |
| 35 | Gemini 3.1 Pro | Auth0 CLI | 91% | 100% (+9%) | A | $1.01 | 1m 56s |
| 36 | GPT-5.6 Terra | Auth0 CLI | 91% | 91% (+0%) | A | $0.55 | 33s |
| 37 | Claude Opus 5 | React | 91% | 89% (-2%) | B | $0.60 | 1m 32s |
| 38 | Claude Opus 5 | SPA JS | 90% | 100% (+10%) | A | $0.60 | 1m 38s |
| 39 | Claude Opus 5 | Python | 89% | 94% (+5%) | A | $0.92 | 3m 7s |
| 40 | Gemini 3.8 Flash | Swift | 88% | 100% (+12%) | A | $2.44 | 7m 47s |
| 41 | Claude Haiku 5.5 | Auth0 CLI | 91% | 94% (+3%) | A | $0.38 | 34s |
| 42 | Gemini 3.1 Pro | Android | 87% | 100% (+13%) | A | $2.30 | 2m 59s |
| 43 | Claude Sonnet 5 | Auth0 CLI | 87% | 100% (+13%) | A | $0.33 | 1m 11s |
| 44 | Gemini 3.1 Pro | Python | 85% | 97% (+12%) | A | $1.30 | 2m 12s |
| 45 | GPT-5.6 Terra | SPA JS | 84% | 98% (+14%) | A | $0.67 | 37s |
| 46 | Claude Sonnet 5 | SPA JS | 83% | 99% (+16%) | A | $0.42 | 1m 54s |
| 47 | Claude Haiku 5.5 | Python | 69% | 97% (+28%) | A | $1.04 | 2m 6s |
| 48 | Claude Sonnet 5 | Python | 83% | 97% (+14%) | A | $0.78 | 8m 11s |
| 49 | Gemini 3.1 Pro | Auth0 Server JS | 82% | 98% (+16%) | A | $2.16 | 3m 12s |
| 50 | GPT-5.6 Sol | SPA JS | 81% | 97% (+16%) | A | $2.29 | 1m 19s |
| 51 | GPT-5.6 Terra | React | 81% | 99% (+18%) | A | $0.78 | 42s |
| 52 | Gemini 3.8 Flash | Android | 81% | 98% (+17%) | A | $2.74 | 7m 58s |
| 53 | Gemini 3.1 Pro | React | 80% | 100% (+20%) | A | $0.43 | 53s |
| 54 | GPT-5.6 Sol | React | 79% | 99% (+20%) | A | $2.08 | 1m 18s |
| 55 | Claude Sonnet 5 | React | 79% | 100% (+21%) | A | $0.42 | 2m 8s |
| 56 | GPT-5.6 Luna | React | 78% | 99% (+21%) | A | $0.28 | 38s |
| 57 | GPT-5.6 Terra | Android | 71% | 98% (+27%) | A | $0.82 | 1m 1s |
| 58 | Claude Haiku 5.5 | React | 81% | 97% (+16%) | A | $0.61 | 59s |
| 59 | GPT-5.6 Sol | Android | 70% | 98% (+28%) | A | $2.81 | 1m 41s |
| 60 | Claude Haiku 5.5 | Swift | 91% | 98% (+7%) | A | $1.78 | 3m 45s |
| 61 | GPT-5.6 Luna | Android | 69% | 98% (+29%) | A | $0.32 | 1m 10s |
| 62 | Claude Sonnet 5 | Auth0.js | 69% | 100% (+31%) | A | $1.27 | 12m 37s |
| 63 | Claude Haiku 5.5 | SPA JS | 84% | 98% (+14%) | A | $0.86 | 1m 9s |
| 64 | GPT-5.6 Sol | Swift | 67% | 97% (+30%) | A | $4.23 | 2m 25s |
| 65 | Claude Haiku 5.5 | Android | 94% | 98% (+4%) | A | $2.61 | 5m 20s |
| 66 | Claude Haiku 5.5 | Auth0.js | 94% | 95% (+1%) | A | $1.35 | 2m 35s |
| 67 | Gemini 3.8 Flash | Python | 60% | 72% (+12%) | C | $0.92 | 21m 13s |
| 68 | Claude Sonnet 5 | Swift | 60% | 100% (+40%) | A | $0.75 | 6m 5s |
| 69 | Claude Opus 5 | Android | 56% | 98% (+42%) | A | $1.44 | 6m 50s |
| 70 | Claude Sonnet 5 | Android | 55% | 97% (+42%) | A | $0.83 | 9m 32s |
| 71 | Claude Haiku 5.5 | Next.js | 100% | 96% (-4%) | A | $2.26 | 4m 29s |
| 72 | Claude Haiku 5.5 | Auth0 Server JS | 94% | 98% (+4%) | A | $1.76 | 2m 58s |
| 73 | Claude Haiku 5.5 | React Native | 91% | 98% (+7%) | A | $2.77 | 5m 45s |
| 74 | Claude Opus 5 | React Native | 24% | 97% (+73%) | A | $1.25 | 3m 22s |
| 75 | Claude Sonnet 5 | React Native | 20% | 99% (+79%) | A | $0.75 | 5m 33s |
| 76 | Gemini 3.1 Pro | React Native | 87% | 94% (+7%) | A | $0.88 | 1m 37s |
| 77 | Gemini 3.8 Flash | React Native | 50% | 92% (+42%) | A | $5.53 | 29m 46s |
| 78 | GPT-5.6 Luna | React Native | 57% | 96% (+39%) | A | $0.24 | 1m 2s |
| 79 | GPT-5.6 Sol | React Native | 65% | 97% (+32%) | A | $1.55 | 1m 34s |
| 80 | GPT-5.6 Terra | React Native | 66% | 94% (+28%) | A | $1.15 | 1m 42s |
Custom Token Exchange Scores
Average without Auth0 tools: 93% · Average with Auth0 tools: 98% · Targets tested: 11 · Total configurations: 88
| # | Model | Target | Without Tools | With Auth0 Tools | Grade | Cost | Time |
|---|---|---|---|---|---|---|---|
| 1 | Claude Opus 5 | Next.js | 100% | 100% (+0%) | A | $0.47 | 1m 17s |
| 2 | Claude Sonnet 5 | React | 98% | 100% (+2%) | A | $0.36 | 1m 21s |
| 3 | Claude Opus 5 | React Native | 100% | 100% (+0%) | A | $0.33 | 43s |
| 4 | Claude Sonnet 5 | React Native | 98% | 100% (+2%) | A | $0.24 | 57s |
| 5 | Gemini 3.1 Pro | React Native | 100% | 100% (+0%) | A | $1.56 | 1m 31s |
| 6 | Gemini 3.1 Pro | SPA JS | 100% | 100% (+0%) | A | $0.69 | 59s |
| 7 | Gemini 3.1 Pro | Swift | 100% | 100% (+0%) | A | $0.77 | 55s |
| 8 | Gemini 3.1 Pro | Auth0 Server JS | 100% | 99% (-1%) | A | $1.03 | 1m 13s |
| 9 | Gemini 3.1 Pro | Auth0.js | 100% | 99% (-1%) | A | $0.83 | 1m 11s |
| 10 | GPT-5.6 Terra | Auth0 CLI | 100% | 98% (-2%) | A | $1.68 | 1m 15s |
| 11 | GPT-5.6 Sol | Python API | 95% | 98% (+3%) | A | $0.76 | 23s |
| 12 | GPT-5.6 Sol | Python | 97% | 98% (+1%) | A | $1.46 | 1m 3s |
| 13 | Gemini 3.1 Pro | Python API | 100% | 98% (-2%) | A | $0.32 | 39s |
| 14 | Gemini 3.8 Flash | React | 100% | 100% (+0%) | A | $3.97 | 5m 21s |
| 15 | Gemini 3.8 Flash | React Native | 100% | 100% (+0%) | A | $1.55 | 4m 37s |
| 16 | Gemini 3.8 Flash | Next.js | 99% | 100% (+1%) | A | $2.49 | 6m 20s |
| 17 | Gemini 3.8 Flash | Auth0.js | 99% | 99% (+0%) | A | $3.04 | 5m 50s |
| 18 | Gemini 3.8 Flash | SPA JS | 99% | 99% (+0%) | A | $1.99 | 4m 5s |
| 19 | Claude Sonnet 5 | Auth0.js | 99% | 100% (+1%) | A | $0.20 | 54s |
| 20 | Claude Haiku 5.5 | Python | 99% | 96% (-3%) | A | $0.76 | 1m 26s |
| 21 | Claude Opus 5 | Auth0 CLI | 95% | 100% (+5%) | A | $1.80 | 3m 34s |
| 22 | GPT-5.6 Luna | Swift | 98% | 99% (+1%) | A | $0.19 | 40s |
| 23 | Claude Haiku 5.5 | Auth0.js | 99% | 100% (+1%) | A | $0.67 | 33s |
| 24 | GPT-5.6 Sol | React | 98% | 98% (+0%) | A | $2.11 | 1m 12s |
| 25 | GPT-5.6 Sol | Android | 98% | 96% (-2%) | A | $2.85 | 1m 20s |
| 26 | GPT-5.6 Luna | React | 98% | 98% (+0%) | A | $0.52 | 53s |
| 27 | GPT-5.6 Sol | Swift | 97% | 98% (+1%) | A | $2.12 | 1m 24s |
| 28 | GPT-5.6 Terra | SPA JS | 99% | 97% (-2%) | A | $0.54 | 30s |
| 29 | GPT-5.6 Luna | Android | 97% | 97% (+0%) | A | $0.31 | 54s |
| 30 | GPT-5.6 Terra | React | 97% | 98% (+1%) | A | $0.43 | 31s |
| 31 | Gemini 3.1 Pro | Python | 88% | 100% (+12%) | A | $1.37 | 1m 54s |
| 32 | GPT-5.6 Sol | SPA JS | 80% | 99% (+19%) | A | $1.26 | 52s |
| 33 | Claude Sonnet 5 | Python API | 98% | 99% (+1%) | A | $0.17 | 35s |
| 34 | GPT-5.6 Terra | React Native | 98% | 98% (+0%) | A | $0.54 | 29s |
| 35 | GPT-5.6 Terra | Python | 98% | 98% (+0%) | A | $0.56 | 29s |
| 36 | Claude Sonnet 5 | SPA JS | 98% | 99% (+1%) | A | $0.33 | 1m 38s |
| 37 | Claude Haiku 5.5 | React | 98% | 100% (+2%) | A | $0.54 | 49s |
| 38 | GPT-5.6 Luna | Python API | 98% | 98% (+0%) | A | $0.14 | 21s |
| 39 | GPT-5.6 Terra | Android | 98% | 97% (-1%) | A | $0.90 | 51s |
| 40 | Gemini 3.8 Flash | Python API | 98% | 100% (+2%) | A | $1.99 | 5m 26s |
| 41 | Claude Haiku 5.5 | SPA JS | 98% | 98% (+0%) | A | $0.61 | 1m 2s |
| 42 | Claude Sonnet 5 | Swift | 98% | 100% (+2%) | A | $0.60 | 3m 14s |
| 43 | GPT-5.6 Terra | Python API | 98% | 98% (+0%) | A | $0.31 | 17s |
| 44 | GPT-5.6 Sol | React Native | 98% | 97% (-1%) | A | $1.11 | 39s |
| 45 | GPT-5.6 Terra | Swift | 97% | 96% (-1%) | A | $0.60 | 37s |
| 46 | Claude Opus 5 | Swift | 97% | 100% (+3%) | A | $0.56 | 1m 37s |
| 47 | GPT-5.6 Luna | React Native | 97% | 98% (+1%) | A | $0.16 | 37s |
| 48 | GPT-5.6 Luna | SPA JS | 97% | 98% (+1%) | A | $0.30 | 43s |
| 49 | Claude Opus 5 | Auth0 Server JS | 94% | 100% (+6%) | A | $0.40 | 55s |
| 50 | Claude Sonnet 5 | Next.js | 97% | 100% (+3%) | A | $0.72 | 5m 11s |
| 51 | Gemini 3.1 Pro | React | 97% | 100% (+3%) | A | $0.59 | 1m 11s |
| 52 | Claude Haiku 5.5 | Next.js | 97% | 97% (+0%) | A | $0.67 | 1m 12s |
| 53 | Claude Sonnet 5 | Auth0 Server JS | 97% | 93% (-4%) | A | $0.45 | 1m 27s |
| 54 | Claude Opus 5 | Python API | 96% | 100% (+4%) | A | $0.44 | 1m 19s |
| 55 | Claude Opus 5 | Auth0.js | 96% | 100% (+4%) | A | $0.46 | 1m 1s |
| 56 | Gemini 3.8 Flash | Auth0 Server JS | 96% | 100% (+4%) | A | $5.71 | 11m 16s |
| 57 | GPT-5.6 Luna | Python | 95% | 98% (+3%) | A | $0.22 | 31s |
| 58 | Gemini 3.8 Flash | Auth0 CLI | 88% | 100% (+12%) | A | $3.96 | 7m 18s |
| 59 | Claude Haiku 5.5 | Swift | 95% | 98% (+3%) | A | $0.39 | 40s |
| 60 | Gemini 3.1 Pro | Auth0 CLI | 95% | 94% (-1%) | A | $3.42 | 4m 7s |
| 61 | Claude Haiku 5.5 | Auth0 Server JS | 95% | 100% (+5%) | A | $0.64 | 41s |
| 62 | Claude Haiku 5.5 | Python API | 94% | 98% (+4%) | A | $0.31 | 25s |
| 63 | Gemini 3.1 Pro | Next.js | 68% | 100% (+32%) | A | $0.71 | 1m 9s |
| 64 | Claude Opus 5 | React | 93% | 100% (+7%) | A | $0.45 | 1m 12s |
| 65 | Claude Haiku 5.5 | React Native | 93% | 94% (+1%) | A | $0.65 | 55s |
| 66 | GPT-5.6 Terra | Auth0.js | 93% | 99% (+6%) | A | $0.53 | 28s |
| 67 | Claude Opus 5 | SPA JS | 93% | 97% (+4%) | A | $0.51 | 1m 17s |
| 68 | GPT-5.6 Terra | Auth0 Server JS | 92% | 98% (+6%) | A | $0.48 | 33s |
| 69 | GPT-5.6 Sol | Auth0.js | 92% | 100% (+8%) | A | $1.11 | 35s |
| 70 | Claude Sonnet 5 | Android | 91% | 97% (+6%) | A | $0.98 | 4m 29s |
| 71 | GPT-5.6 Luna | Auth0 Server JS | 91% | 98% (+7%) | A | $0.18 | 35s |
| 72 | Claude Opus 5 | Android | 91% | 100% (+9%) | A | $0.63 | 1m 50s |
| 73 | GPT-5.6 Luna | Auth0.js | 90% | 92% (+2%) | A | $0.22 | 37s |
| 74 | GPT-5.6 Sol | Auth0 Server JS | 90% | 97% (+7%) | A | $1.72 | 53s |
| 75 | GPT-5.6 Sol | Auth0 CLI | 90% | 98% (+8%) | A | $4.03 | 2m 16s |
| 76 | Claude Sonnet 5 | Python | 87% | 100% (+13%) | A | $0.92 | 8m 50s |
| 77 | Gemini 3.8 Flash | Android | 87% | 100% (+13%) | A | $2.36 | 9m 56s |
| 78 | Gemini 3.8 Flash | Swift | 87% | 99% (+12%) | A | $2.71 | 5m 40s |
| 79 | Gemini 3.8 Flash | Python | 78% | 99% (+21%) | A | $2.02 | 13m 20s |
| 80 | Claude Opus 5 | Python | 82% | 100% (+18%) | A | $0.60 | 1m 29s |
| 81 | Gemini 3.1 Pro | Android | 77% | 100% (+23%) | A | $0.92 | 1m 10s |
| 82 | Claude Haiku 5.5 | Android | 76% | 93% (+17%) | A | $1.57 | 2m 15s |
| 83 | GPT-5.6 Luna | Next.js | 74% | 97% (+23%) | A | $0.31 | 53s |
| 84 | GPT-5.6 Sol | Next.js | 74% | 97% (+23%) | A | $1.32 | 54s |
| 85 | GPT-5.6 Terra | Next.js | 71% | 98% (+27%) | A | $0.53 | 43s |
| 86 | GPT-5.6 Luna | Auth0 CLI | 64% | 100% (+36%) | A | $0.63 | 1m 10s |
| 87 | Claude Haiku 5.5 | Auth0 CLI | 59% | 100% (+41%) | A | $2.16 | 2m 43s |
| 88 | Claude Sonnet 5 | Auth0 CLI | 43% | 94% (+51%) | A | $0.70 | 2m 46s |
Methodology
1. Real integration tasks
We test each model with realistic developer prompts — the kind you'd actually type when building an app. No optimized instructions, no guided walkthroughs.
2. Automated grading
Every response is scored across multiple dimensions: correct SDK usage, proper configuration, security best practices, and more. Grading is deterministic and reproducible.
3. Tool comparison
Each model runs as an agent twice: once without Auth0 tools (relying only on its own training knowledge), and once with Auth0's MCP Server and Agent Skills enabled. The delta measures the real-world impact of Auth0's developer platform.
Developer Tools
Auth0 MCP Server
Connect AI agents directly to Auth0 for real-time tenant management.
Auth0 Agent Skills
Pre-built implementation knowledge for AI coding agents.
Grade Scale
- A (90-100%): Production-ready implementation
- B (75-89%): Good with minor issues
- C (60-74%): Functional but needs review
- D (<60%): Significant issues
Last updated: October 2026