Table of Contents
- Overview
- About Sarvam.ai
- Job Summary
- Key Responsibilities
- Required Skills
- Good-to-Have Skills
- Work Environment
- Salary Range (Estimated)
- Why Join Sarvam.ai?
- Conclusion
Overview
Sarvam.ai is hiring Backend Engineers for its API team in Bengaluru. This is a full-time on-site engineering role focused on building low-latency, distributed systems for AI model serving. The position is ideal for engineers who want to work on high-performance backend infrastructure powering speech, language, and vision models at scale.
About Sarvam.ai
Sarvam.ai is a leading generative AI startup with a mission to make AI accessible for Bharat. The company designs cost-efficient, high-performance AI systems optimised for Indian languages and enterprise needs.
They specialise in:
- Speech technologies (ASR, TTS)
- Language models (LLMs)
- Vision models
- Cloud-agnostic AI deployment
The organisation operates with a mix of research-driven innovation and practical engineering for real-world scale.
Job Summary
As a Backend Engineer in the API team, you will be responsible for exposing and managing a suite of ML models via high-performance APIs. These systems must be low-latency, fault-tolerant, secure, and cloud-neutral, capable of handling millions of requests across Azure, AWS, GCP and on-prem infrastructures. The role is a blend of backend engineering, distributed systems, infrastructure automation and real-time data processing.
Key Responsibilities
Hey,
Backend Development
- Build and optimise Python-based APIs using FastAPI, Flask, Django or similar frameworks.
- Develop high-performance communication layers using HTTP, WebSockets and gRPC.
System Architecture
- An architect designed distributed, fault-tolerant and low-latency systems for real-time model inference.
- Do authentication, rate limiting, throttling, and secure coding standards.
Data & Storage
- Work with PostgreSQL, Redis and ClickHouse for high-speed data storage and retrieval.
Event & Streaming Systems
- Build event-driven pipelines using Kafka and Redis Streams.
Infrastructure & CI/CD
- Collaborate on canary deployments, feature rollouts and automated release pipelines.
- Deploy services across Azure, AWS, GCP and hybrid environments.
Reliability & Observability
- Ensure systems are observable, resilient and cloud-agnostic, using modern monitoring and logging tools.
Required Skills
Candidates must have:
- Strong Python programming skills.
- Experience with FastAPI, Django or Flask.
- Deep understanding of HTTP, WebSockets and gRPC.
- Proven experience building distributed backend systems.
- Hands-on skills with PostgreSQL, Redis, ClickHouse or similar tools.
- Knowledge of Kafka or Redis Streams.
- Strong fundamentals in API security, authentication and authorisation.
- Experience with Docker, Kubernetes and CI/CD pipelines.
- Familiarity with at least one cloud provider (Azure preferred).
- A focus on secure coding and system reliability.
Good-to-Have Skills
- Now, Experience with canary deployments or feature flagging.
- Exposure to ML inference pipelines or AI model-serving platforms.
- Knowledge of Prometheus, Grafana or OpenTelemetry.
- Contributions to open-source backend projects or a strong GitHub presence.
Work Environment
- Location: Bengaluru, Karnataka
- Work Mode: Hybrid / On-site
- Department: Engineering – API Team
- Job Type: Full-time
Engineers work closely with ML teams, DevOps professionals and platform engineers to build scalable AI infrastructure.
Salary Range (Estimated)
Note: Sarvam.ai has not disclosed an official salary range. Based on Bengaluru backend engineering market standards:
| Experience Level | Estimated Annual Salary (INR) |
|---|---|
| 1–3 years | ₹12–20 LPA |
| 3–6 years | ₹20–35 LPA |
| 6+ years | ₹35–55 LPA |
Actual compensation may vary depending on experience, skills and negotiation.
Why Join Sarvam.ai?
- Opportunity to build India’s leading generative AI infrastructure.
- Work on systems serving millions of real-time requests.
- Exposure to cutting-edge ML model serving technologies.
- Cloud-agnostic engineering environment.
- Strong focus on innovation, performance and reliability.
👉Apply Now
Conclusion
The Backend Engineer API Team role at Sarvam.ai is an excellent opportunity for engineers passionate about building high-performance backend systems for large-scale AI applications.
If you are skilled in Python, distributed systems and cloud-native infrastructure, this position offers a challenging and rewarding career path.
0 Comments