Skip to content
View Prateekbala's full-sized avatar
🎯
Focusing
🎯
Focusing

Highlights

  • Pro

Block or report Prateekbala

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
Prateekbala/README.md

Prateek Bala

Backend Engineer · Distributed Systems · AI Infrastructure

LinkedIn Twitter Email GitHub

I'm a final year CSE undergraduate at LNMIIT and a Founding Engineer at Flexzistay, where I build and scale backend systems in production.

I enjoy working on systems where the engineering gets interesting under the hood: distributed coordination, concurrency, networking, storage, low-latency execution, and performance.

Lately, I've been exploring AI infrastructure, LLM inference, autonomous coding agents, and cloud-native systems. I also contribute to open-source projects in the Kubernetes ecosystem.

I learn best by building things from scratch, measuring how they perform, and understanding why they work.

Projects

1. Codewatch — Autonomous GitHub PR Review Agent

Repository · TypeScript, LangGraph, Node.js, OpenAI API

LLM-powered code review agent supporting CLI and GitHub App workflows.

  • Built multi-stage reviews with parallel diff analysis, line-level grounding, and secondary verification to reduce false positives.
  • Added repository-specific policies, token budgets, and evaluation using precision, recall, and F1.

2. RiftMQ — Distributed Messaging System

Repository · Go, Raft, WAL, Docker

Kafka-inspired distributed message broker built from scratch.

  • Achieved 18K messages/sec with 200 concurrent producers.
  • Implemented Raft consensus, leader election, persistent storage, replication, and consumer groups.

3. FIX Protocol Trading Gateway

Repository · C++20, FIX 4.4, Async I/O

Low-latency trading gateway for order-management and execution workflows.

  • Built asynchronous networking and lock-free queues, benchmarking 250K orders/sec.
  • Achieved 350µs P50 and 633µs P99 latency.

4. Distributed LLM Inference Router

Repository · Python, FastAPI, vLLM, Prometheus, Grafana

OpenAI-compatible gateway for routing inference requests across vLLM workers.

  • Implemented load-aware routing, health checks, automatic failover, retries, and backpressure.
  • Built observability and benchmarking for TTFT, token throughput, and request latency.

5. Flexzistay — Hotel Marketplace

Live Website · Node.js, TypeScript, PostgreSQL, Redis, GCP

Built the production backend for a hotel marketplace serving 10K+ users.

  • Shipped 100+ REST APIs and integrated hotel inventory and booking workflows across 10K+ hotels.
  • Implemented concurrency-safe bookings and reduced API P95 latency by 50% to under 150ms.

6. Voice AI Backend

SIP, Streaming Audio, STT/LLM/TTS, MCP

Built backend infrastructure for real-time voice agents.

  • Reduced perceived audio pipeline latency from 1.4s to 900ms.
  • Implemented provider-agnostic telephony, call orchestration, failover, and MCP tool execution.

Open Source

KServe / Kubeflow — CNCF Ecosystem

Contributing to Kubernetes-native model serving and cloud-native AI infrastructure.

I enjoy contributing to projects where improvements in APIs, resource management, and infrastructure make the developer experience better for everyone.


A few more things

  • Competitive programming: LeetCode Knight, contest rating 1856, ranked in the top 6.13% globally.
  • Problem solving: 500+ coding problems solved across platforms.
  • Education: B.Tech in Computer Science and Engineering, LNMIIT.

I'm always interested in backend engineering, distributed systems, AI infrastructure, and meaningful open-source work.

Feel free to reach out if you're building something interesting in these areas.


Pinned Loading

  1. Codewatch Codewatch Public

    Autonomous AI-powered GitHub PR reviewer built with LangGraph and TypeScript. Features parallel LLM-based code analysis, hallucination filtering, idempotent review publishing, webhook handling, and…

    TypeScript 2 1

  2. Distributed-system Distributed-system Public

    A production-ready, high-performance distributed message broker system inspired by Apache Kafka, built from scratch in Go with advanced features like automatic partition rebalancing, rack-aware rep…

    Go 1

  3. Fix-Protocol-Tranding-Engine Fix-Protocol-Tranding-Engine Public

    A high-performance FIX (Financial Information eXchange) Protocol 4.4 trading gateway implemented in modern C++20. This system provides a complete order management and execution infrastructure with …

    C++ 4

  4. ToolHive ToolHive Public

    Agentic AI toolkit for building and integrating AI agents with external tools using the Model Context Protocol (MCP). Simplifies tool discovery, integration, and execution for extensible LLM-powere…

    Python 1

  5. Distributed-LLM-Router Distributed-LLM-Router Public

    Distributed LLM Router: an OpenAI-compatible FastAPI gateway that intelligently routes requests across multiple vLLM nodes with load balancing, failover retries, backpressure, and real-time Prometh…

    Python 2

  6. eth-api-payments eth-api-payments Public

    Forked from MananSinghal123/eth-api-payments

    💰 Start charging for your api integrating our sdk without having to expose sensitive data or wait for days for settling payments. 🛡️ Trusted Payments though zk-verified usage .

    TypeScript