Inference AI Tools

Tools

• Category: AI Infrastructure
• Subcategory: Inference

• 

  ZeroGPU

  AI Infrastructure

  Runs specialized and open-weight models faster and cheaper across edge and cloud infrastructure.

  • Open-Weight Models
  • Global Inference Network
  • High-Volume Processing
• 

  Groq Cloud

  AI Infrastructure

  Build fast with GroqCloud

  • Local AI
  • Self-Hosted AI
  • OpenAI Compatibility
• 

  Local

  AI Infrastructure

  Runs AI on-device with fast, private infrastructure

  • On-Device AI
  • Private Infrastructure
  • LLM Runtime
• 

  Petals

  AI Infrastructure

  Run LLMs at home with BitTorrent-style distribution for faster inference and fine-tuning.
• 

  Cerebras-GPT

  AI Infrastructure

  Accelerates AI inference with the fastest wafer-scale chip.

  • AI Inference
  • Wafer-Scale Chip
  • Open-Source Models

  Freemium

• 

  Janus / Janus-Pro

  AI Infrastructure

  Unified multimodal understanding and generation models for text, image, video, and audio.

  • Multimodal AI
  • Open Source

  Free

• 

  Cerebras Inference

  AI Infrastructure

  Fastest LLM inference with 1000+ tok/s for Llama 3.3 70B

  • LLM Inference
  • Local AI
  • Self-Hosted AI