Llama 3.1 Nemotron 70B Instruct

by NVIDIAChat

Nemotron model for efficient reasoning, coding, and specialized AI agents

Context
128K tokens
Max output
8,192 tokens
Released
2025-04-15
Weights
Open

nvidia/llama-3-1-nemotron-70b-instruct · also seen as nvidia/Llama-3.1-Nemotron-70B-Instruct-HF, deepinfra/nvidia/Llama-3.1-Nemotron-70B-Instruct

Specifications

Full facts as recorded, incl. what is unknown.

Released
2025-04-15
Weights
Open
Input
Text
Output
Text
Context window
128,000 max across endpoints
Max output
8,192
Providers
2 + 2 gateways, not counted as providers
Epoch Capabilities Index
not evaluated
Direct price range
$0.60 in · $0.60 out per 1M tokens · 1 of 2 providers have a comparable price
More details
Last updated
2025-04-15
Knowledge cutoff

Capabilities

Across all endpoints: supported if any endpoint supports it.

  • Tool calling
  • Parallel toolsunknown
  • Structured output
  • Reasoning
  • Image input
  • PDF input
  • Audio input
  • Audio outputunknown
  • Video input
  • Prompt cachingunknown
  • Web searchunknown
  • Computer useunknown
  • System messagesunknown
  • Assistant prefillunknown
  • Temperature
  • Streamingunknown
  • Attachments

Endpoints

One row per provider and variant; gateways are listed separately.

Loading endpoints…

Price history

No change since 19 Oct 2026. The cheapest direct price has been $0.60 in / $0.60 out per 1M tokens at Deep Infra on every data refresh since then.

Tracked from 19 Oct 2026. Headline-eligible direct prices only, so a price the sanity check flags never draws a spike. Series as JSON

Cost calculator

Loading endpoints…

Similarly priced models

Blended rate per 1M tokens, each at its own cheapest provider (10M input : 2M output mix).

ModelBlended/1MIn/1MOut/1MContextvs Llama 3.1 Nemotron 70B Instruct
Qwen2.5 72B InstructAlibaba (Qwen)$0.367$0.36$0.40131K+0%
DeepSeek V3.1DeepSeek$0.367$0.25$0.95164K+0%
MAI-Code-1.1-FlashMicrosoft$0.367$0.20$1.20256K+0%
GPT-5.6 Luna ProOpenAI$0.367$0.20$1.201.05M+0%
Llama 4 Maverick 17b 128e InstructMeta$0.362$0.24$0.971.05M−1% cheaper
Toast 1Mixedbread$0.37$0.30$0.72131K+1%
Step 3.7 FlashStepFun$0.358$0.20$1.15256K−2% cheaper
Mercury Coder Small BetaInception$0.375$0.25$1.0032.8K+3%

More from NVIDIA

Newest NVIDIA models in the catalogue. All NVIDIA models

ModelReleasedContextListed price
Nemotron 3.5 Super VL 120B A12B2026-10-151.05Mfrom $0.10
Switchyard2026-09-211Munpriced
Nemotron 3.5 ASR Streaming Multilingual 0.6B2026-08-13—unpriced
Nemotron 3.5 Lightning 30B A3B2026-08-11262Kfrom $0.025
Nemotron 3 Nano Omni 30B TEE2026-07-23131Kfrom $0.0245
Nemotron 3 Embed 1B2026-07-1632.8Kunpriced
Nemotron 3 Ultra 550B A55B2026-06-041Mfrom $0.50
Nemotron 3.5 Content Safety2026-06-04128Kfrom $0.05
Heads up: prices are indicative list rates scraped from provider pricing pages; verify with the provider before relying on them. Report incorrect data for this model