Evaluation record · gemini-cli

Gemini CLI

v0.x (enterprise/API-key access only since 2026-06-18)

Google

Agentcliopen-sourcecoding-agentgoogle

Strong

About This Agent

Open-source terminal AI agent from Google that brings Gemini into the command line. Uses a ReAct loop with built-in tools, MCP server support, and Google Search grounding. Consumer/individual access (free tier and Google AI Pro/Ultra) ended 2026-06-18 as Google transitioned individuals to the closed-source Antigravity CLI ('agy'); Gemini CLI remains available to Gemini Code Assist Standard/Enterprise organizations and paid Gemini API key users.

Last Evaluated: July 9, 2026

Official Website

Trust Vector Analysis

Dimension Breakdown

🚀Performance & Reliability

task completion accuracy

Coding and shell task completion testing with large-context workloads

Evidence

Google Blog - Introducing Gemini CLI — Gemini 2.5 Pro with 1M token context window handles large codebases and multi-file tasks

mediumVerified: 2026-07-09

tool use reliability

Tool integration testing across built-in and MCP tools

Evidence

Gemini CLI GitHub — Built-in tools (file ops, shell, web fetch, Google Search grounding) plus extensibility via MCP servers

highVerified: 2026-07-09

multi step planning

Multi-step task decomposition testing via ReAct loop

Evidence

Google Blog - Introducing Gemini CLI — Reason-and-act (ReAct) loop plans, executes tools, and iterates on complex tasks like bug fixing and feature work

highVerified: 2026-07-09

memory persistence

Session and context persistence evaluation

Evidence

Gemini CLI Documentation — GEMINI.md context files, session checkpointing, and a memory tool persist project context across sessions

mediumVerified: 2026-07-09

error recovery

Error handling and retry behavior testing

Evidence

Gemini CLI GitHub Issues — ReAct loop retries on tool failures and model fallback (Pro to Flash) on rate limits; loop detection still imperfect per community reports

mediumVerified: 2026-07-09

agent collaboration

Multi-agent and scripting capability assessment

Evidence

Gemini CLI Documentation — Primarily a single-agent CLI; non-interactive mode and MCP enable scripting into pipelines but no native multi-agent orchestration

mediumVerified: 2026-07-09

🛡️Security

tool sandboxing

Sandboxing options review and testing

Evidence

Gemini CLI Sandbox Documentation — Optional sandboxing via Docker/Podman containers or macOS Seatbelt profiles to isolate shell and file operations

highVerified: 2026-07-09

access control

Access control configuration assessment

Evidence

Gemini CLI Configuration Docs — Tool allowlists/blocklists, trusted folders, and Google account or API key auth; enterprise policy via Gemini Code Assist licensing

mediumVerified: 2026-07-09

prompt injection defense

Injection surface review focusing on confirmation gates and web content handling

Evidence

Gemini CLI GitHub — Per-tool confirmation prompts before file writes and shell execution act as a human-in-the-loop gate; YOLO mode bypasses protections

mediumVerified: 2026-07-09

data isolation

Data handling terms review across auth tiers

Evidence

Gemini CLI Terms and Privacy — Free personal-account tier may use prompts and code to improve Google products; paid API and Code Assist Standard/Enterprise tiers exclude training use

mediumVerified: 2026-07-09

open source transparency

Source code and license review

Evidence

Gemini CLI GitHub — Apache 2.0 licensed, fully open source with public roadmap and tens of thousands of stars

highVerified: 2026-07-09

🔒Privacy & Compliance

data retention

Evidence

Gemini CLI Terms and Privacy — Retention governed by Google terms tied to the chosen auth method; free-tier data may be retained for product improvement

mediumVerified: 2026-07-09

gdpr compliance

Compliance posture assessment per access tier

Evidence

Google Cloud Compliance — Enterprise use via Gemini Code Assist / Vertex AI inherits Google Cloud GDPR commitments; consumer tier offers weaker guarantees

mediumVerified: 2026-07-09

third party data sharing

Data flow analysis

Evidence

Gemini CLI Terms and Privacy — All prompts, files in context, and tool outputs are sent to Google's Gemini API; Search grounding sends queries to Google Search

mediumVerified: 2026-07-09

local deployment option

Deployment options assessment

Evidence

Gemini CLI GitHub — Client is open source and runs locally, but inference requires Google's cloud Gemini models; no official local-model backend

mediumVerified: 2026-07-09

👁️Trust & Transparency

documentation quality

Documentation completeness review

Evidence

Gemini CLI Documentation — Detailed docs covering commands, configuration, sandboxing, MCP, extensions, and enterprise deployment

highVerified: 2026-07-09

execution traceability

Logging and telemetry capabilities assessment

Evidence

Gemini CLI Telemetry Docs — OpenTelemetry-based observability for prompts, tool calls, and token usage; visible tool call log in the terminal UI

mediumVerified: 2026-07-09

decision explainability

Explainability features assessment

Evidence

Gemini CLI GitHub — ReAct loop surfaces reasoning steps and proposed actions before execution, with diffs shown for file edits

mediumVerified: 2026-07-09

open source code

Open source assessment

Evidence

Gemini CLI GitHub — Apache 2.0 license; released 2025-06-25 with active public development and community contributions

highVerified: 2026-07-09

community activity

Community engagement analysis

Evidence

Gemini CLI GitHub — One of the fastest-growing CLI agent repos with very high star count, frequent releases, and an extensions ecosystem

highVerified: 2026-07-09

⚙️Operational Excellence

ease of integration

Setup and onboarding complexity assessment, updated for the post-2026-06-18 access model

Evidence

Google Blog - Introducing Gemini CLI — Single npm install and Google account login; free tier with 60 requests/min and 1,000 requests/day

Google Developers Blog - Transitioning Gemini CLI to Antigravity CLI — Simple Google-account onboarding no longer available: since 2026-06-18 access requires a Gemini Code Assist Standard/Enterprise license or a paid Gemini API key (score reduced 88 to 80)

highVerified: 2026-07-09

scalability

Automation and rate-limit assessment

Evidence

Gemini CLI Documentation — Non-interactive mode supports CI/CD scripting; throughput bounded by per-user rate limits unless using paid API keys

mediumVerified: 2026-07-09

cost predictability

Pricing model analysis updated for removal of the free consumer tier

Evidence

Google Developers Blog - Transitioning Gemini CLI to Antigravity CLI — Free consumer tier (1,000 requests/day) discontinued 2026-06-18; remaining usage is via metered Gemini API keys or flat Gemini Code Assist Standard/Enterprise subscriptions (score reduced 78 to 72)

mediumVerified: 2026-07-09

monitoring capabilities

Monitoring features assessment

Evidence

Gemini CLI Telemetry Docs — OpenTelemetry export for metrics and traces; enterprise-grade monitoring requires external tooling

mediumVerified: 2026-07-09

production readiness

Product continuity assessment; the consumer shutdown is now confirmed by Google's official announcement, so score lowered 62 to 58 and confidence raised to high — the product continues but only for enterprise/API-key audiences

Evidence

Google Developers Blog - Transitioning Gemini CLI to Antigravity CLI — Officially confirmed and executed: on 2026-06-18 Gemini CLI (and Gemini Code Assist IDE extensions) stopped serving Google AI Pro/Ultra and free individual users; individuals are directed to the closed-source Go-based Antigravity CLI ('agy'), which lacks 1:1 feature parity and uses weekly compute caps. Organizations on Gemini Code Assist Standard/Enterprise and paid Gemini API key users retain access

highVerified: 2026-07-09

Strengths

+Open source (Apache 2.0) with a very large community (6,000+ merged community PRs)
+Strong safety options: Docker/Seatbelt sandboxing and per-tool confirmation prompts
+ReAct loop with built-in tools, MCP support, and Google Search grounding
+1M token context window via Gemini Pro models for large codebases

Limitations

!Consumer/individual access ended 2026-06-18 (officially confirmed): free tier and Google AI Pro/Ultra users were cut off and directed to the closed-source Antigravity CLI, which lacks full feature parity and uses weekly compute caps; only Gemini Code Assist Standard/Enterprise orgs and paid API key users retain Gemini CLI access
!Historical free personal tier could use prompts and code for Google product improvement
!No local model backend; inference requires Google's cloud Gemini API
!Single-agent design with no native multi-agent orchestration
!Rate limits and model fallback (Pro to Flash) can degrade quality under load

Metadata

license: Apache 2.0

supported models

0: Gemini 2.5 Pro

1: Gemini 2.5 Flash

2: Gemini 3 (paid/preview tiers)

programming languages

0: TypeScript (Node.js)

deployment type: Local CLI client with cloud model inference

tool support

0: Built-in file and shell tools

1: Google Search grounding

2: Web fetch

3: MCP servers

4: Extensions

first release: 2025-06-25

pricing: Free consumer tier discontinued 2026-06-18; access via metered Gemini API keys or Gemini Code Assist Standard/Enterprise subscriptions

product status note: Officially confirmed by Google (developers.googleblog.com): consumer/individual access ended 2026-06-18 in favor of the closed-source Antigravity CLI ('agy'); enterprise access continues via Gemini Code Assist Standard/Enterprise and paid Gemini API keys

Use Case Ratings

code generation

Strong terminal coding agent with large context, ReAct loop, and MCP extensibility

research assistant

Google Search grounding and web fetch make it effective for in-terminal research

data analysis

Capable of scripting analyses via shell and file tools, though not analytics-specialized

content creation

Useful for drafting docs and content in the terminal with multimodal generation via extensions

education

No longer accessible to individual learners since the 2026-06-18 consumer shutdown; requires an enterprise Code Assist license or paid API key