About Me

Full-stack and backend engineer with 4+ years of experience building large-scale, cloud-native, microservices-driven applications across distributed systems. Expert in Java, JavaScript and Python with deep experience designing complex systems end-to-end—from architecture to production. Proven ability to build scalable APIs, distributed event-driven platforms, CI/CD pipelines, and secure, reliable infrastructure on AWS.

Strong cross-functional collaborator who mentors teams, drives engineering best practices, and ships high-quality software at speed. Skilled at translating complex requirements into clean design, writing optimized and secure code, and resolving production incidents in on-call environments. Experience spans AI/ML systems, LLM-based reasoning, computer vision, and production-grade intelligent automation.

Name:
Harshil Jhaveri
City:
Dubai, UAE
Degree:
Master's in Computer Science
Graduation:
May 2023
Email:
hjhaveri@usc.edu
Phone:
+971 508169076

Skills

Programming Languages
  • Python, Java, JavaScript

  • TypeScript, Kotlin, Go

  • C++, SQL, Bash, R

Backend & Systems
  • Node.js, Spring Boot, FastAPI

  • Django, Flask, Express

  • RESTful APIs, GraphQL, gRPC

  • Microservices Architecture

Frontend Development
  • React, Angular, Next.js

  • Tailwind CSS, Bootstrap

  • Redux, HTML5, CSS3

AI & Machine Learning
  • PyTorch, TensorFlow, Keras

  • LLMs (GPT-4, Claude), RAG

  • LangChain, LangGraph

  • Hugging Face Transformers

  • YOLO, OpenCV, Computer Vision

  • ONNX Runtime, Model Optimization

  • Vector DBs (Pinecone, FAISS)

  • Triton Inference Server

Databases & Data
  • PostgreSQL, MySQL, MongoDB

  • Redis, Elasticsearch

  • DynamoDB, Pandas, NumPy

  • Apache Spark, Hadoop

  • ETL Pipelines, Data Warehousing

Cloud & DevOps
  • AWS (ECS, Lambda, S3, RDS)

  • Docker, Kubernetes, Terraform

  • CI/CD, Jenkins, GitHub Actions

  • Apache Kafka, RabbitMQ, SQS/SNS

  • Prometheus, Grafana

  • ELK Stack (Elasticsearch, Logstash, Kibana)

Experience

Software Engineer II

Oracle Cloud Infrastructure | Santa Clara, US | July 2023 - Present

  • Project lead for Zero Trust Packet Routing (ZPR) mechanism for Load Balancer Control Plane, reducing unwarranted access by 100% for thousands of enterprise customers through intelligent policy enforcement.
  • Built LLM-based intelligent incident detection system using retrieval-augmented generation (RAG) to analyze operational logs, identify root causes, and recommend mitigation strategies—reducing mean time to resolution (MTTR) by 40%.
  • Implemented a Data Warehousing Architecture for Load Balancer Service for assessment of security risks and business analytics.
  • Increased system availability from 99.95% to 99.995% by architecting resilient systems with predictive failure detection, leveraging ML models to anticipate capacity issues.
  • Lead automation of 2.5 weeks of developer work for monthly host OS patching through intelligent vulnerability detection and prioritization using ML-based risk scoring.
  • Designed adaptive load balancing policies incorporating real-time performance predictions, optimizing resource allocation across distributed infrastructure.

Software Engineer Intern

Cloudera | Santa Clara, US | May 2022 - August 2022

  • Created services to bolster authorization and authentication for SSL interactions with Hadoop clusters on Apache Knox.
  • Automated client certificate authentication and configured composite provider authorization. Executed a header-based identity maintenance plugin, and authorization bearer services, and deployed packages to production via Gerrit.
  • Resolved escalations in identity management service integration with Azure public cloud followed by automation tests.

Full Stack Engineer

University of Southern California | Los Angeles, US | September 2021 - May 2023

  • Lead efforts for web development, analysis, research and visualization of data for USC Viterbi's Globalization team, reporting to Vice Dean Cauligi Raghavendra.

Software Development Intern

Finovate Capital | Mumbai, India | June 2021 - July 2021

  • Introduced AI based generation of invoices, and transfers to and from FTP servers. Reduced manpower required by 300%, and increased auditing accuracy twofold.
  • Led E2E backend and frontend stack development of an interactive web app used by MSME's for supply chain financing.

Data Science Intern

CMS Computers Limited | Mumbai, India | December 2019 - January 2020

  • Pioneered a Vision-based traffic control system, detecting and estimating vehicle speed from live feed transitioning from traditional ultrasonic sensors. It also characterized automobile's coordinates and type at the time of offence.
  • Executed automatic red signal violation detection and penalty generation with 87% accuracy trained on a YOLO model.
  • Created a desktop app for network admins, showing a hash-based authenticated live stream of traffic in a clean UI.

Software Development Intern

Atom Technologies Limited | Mumbai, India | June 2019 - July 2019

  • Developed a full stack E-Commerce platform to offer purchase and online sale of payment models to 150,000+ vendors.
  • Devised a multithreading system for transactions from the same user ID on the existing payment gateway. This facilitated multiple simultaneous payments from the same user and significantly reducing delay.

Built in Stealth

securebot.io

  • Built a security first MCP marketplace, evolving to an automated MCP server generation on demand.
  • Built secure AI gateway platform that manages AI agent permissions and observability, enabling developers to secure agentic systems with 97% less instrumentation effort.
  • Architected production system allowing AI agent security implementation in just 3 lines of code—dramatically simplifying the integration of authentication, authorization, and monitoring for autonomous AI systems.
  • Designed intelligent permission management system for AI agents, implementing fine-grained access controls, policy enforcement, and real-time authorization decisions for agent-to-service interactions.
  • Built comprehensive observability infrastructure capturing AI agent behavior, decision traces, and security events—enabling developers to understand and debug autonomous agent actions in production.
  • Developed backend infrastructure using Python and TypeScript, implementing RESTful APIs, real-time event processing, and scalable microservices architecture deployed on cloud infrastructure.

Education

Master's in Computer Science

University of Southern California | Los Angeles, US | August 2021 - May 2023

  • CGPA: 3.78/4. Coursework in Analysis of Algorithms, Machine Learning, Artificial Intelligence, Databases, Natural Language Processing, Deep Learning and Game Development

Bachelor of Engineering in Computer Engineering

Dwarkadas J. Sanghvi College of Engineering, University of Mumbai | Mumbai, India | August 2017 - June 2021

  • CGPA: 9.67/10. Coursework focussed in Advanced Algorithms, Machine Learning, Cloud Computing, Distributed Systems, Operating Systems, Data Warehousing and Mining, Natural Language Processing

Projects

Patient Holistic Care Portal

Smart recommendations for patients based on symptoms, with WebRTC based video calls with Doctors and chatbots to support their mental health. Made using PyTorch, Django, Angular, VanillaJS, SIP.js.

Smart Disaster Rescue and Mitigation System

Real-time portal for averting disasters in smart cities with mesh network based offline SOS calls. Made using Tensorflow, Node, React and MongoDB.

NGO - Volunteer Matching Portal

One stop portal to match an NGO with prospective volunteers, fundraise and answer cries for help. Made using EmotionAI, Tweetpy, Spring, Bootstrap, MySQL and AWS S3.

Publications & Research

CHIP: Contrastive Hierarchical Image Pretraining

Few-shot, three-level hierarchical classification model for animal species using variational autoencoders

Autoencoder Embedding, Segmentation and Classification of Apparel Images Using a Deep ConvNet Approach
Training Agents to Play 2D Games using Reinforcement Learning
Application of BAT Algorithm for Detecting Malignant Brain Tumors

Testimonials

Harshil Jhaveri

Software Engineer | Full Stack Developer | AI/ML Engineer