Rohan Sogani

Senior Software Engineer

I’m a senior software engineer with an interest in distributed systems and generative AI. Over roughly 10 years I’ve built cloud and enterprise software at Oracle, Amazon and SAP, and studied distributed systems at UC Davis.

Portrait of Rohan Sogani

Interests

Distributed systems

Consensus, replication, sharding and the trade-offs of building systems that stay correct and available at scale.

Generative AI

The infrastructure that makes LLM applications and agents reliable, secure and efficient in production.

Cloud infrastructure

Kubernetes, multi-tenancy, autoscaling and the operational craft of running large cloud services.

Selected projects

All projects

Shepherd Model Gateway

Open source

Rust/Tokio-based model gateway that isolates streaming and the agentic loop from the data-plane API tier. Led the migration of OCI Generative AI’s OpenAI-compatible agent execution onto it — 15% lower p90 latency and 90% less memory.

  • Rust
  • Tokio
  • OpenAI API
  • LLM serving

Agentic QA Framework

Oracle

A general QA agent built on the platform’s own agent framework that automates end-to-end regression testing across diverse scenarios and edge cases, speeding up releases across GenAI services.

  • LLM Agents
  • Python
  • Test automation

Scaling ResilientDB by Sharding

Jan 2020 – Jun 2020

Implemented the AHL (Attested HyperLedger) sharding protocol in ResilientDB, an open-source permissioned blockchain (later an Apache Incubator project). Enhanced PBFT with a two-phase-commit optimized protocol, increasing throughput ~3× to 240K txns/sec.

  • C++
  • Bash
  • Python
  • GCP

Writing

All posts

Languages

  • Java
  • Go
  • Rust
  • Python
  • C/C++
  • SQL

Frameworks & Storage

  • Netty
  • FastAPI
  • Kafka
  • Dropwizard
  • Actix/Tokio
  • Oracle
  • MongoDB
  • Postgres
  • Redis/Valkey
  • Elasticsearch

Cloud & Infra

  • OCI
  • AWS
  • GCP
  • Azure
  • Kubernetes
  • Istio
  • Knative
  • Helm
  • Docker
  • Terraform
  • gVisor

Tools

  • Prometheus
  • Grafana
  • Locust
  • Git