Skip to content
View Subodh-17's full-sized avatar

Highlights

  • Pro

Block or report Subodh-17

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
Subodh-17/README.md

Subodh

GitHub LinkedIn Instagram Email

Systems and open-source engineer focused on columnar query processing, distributed ML training determinism, and AI agent runtime verification.

I spend most of my time writing query execution kernels in the Apache Arrow and DataFusion ecosystems, building spatial routing engines, and contributing fixes to open-source data infrastructure.


Open-Source Activity

Merged Upstream Open Upstream Repositories Contributed

A live snapshot of contributions across data systems, ML infrastructure, and runtime verification:

  • Merged Upstream (34 PRs): Merged code in Apache DataFusion, DataFusion-Spark, Hugging Face Diffusers, DevTrack, AgentWatch, and the NSoC ecosystem.
  • Open Upstream (21 PRs): Active PRs under review across Apache Arrow-rs, Apache DataFusion, PyTorch Lightning, SafeTensors, and Diffusers.
  • Repositories Contributed (12+): Contributions spanning the Apache Software Foundation, Hugging Face, PyTorch / Lightning AI, and AI agent platforms.

Technologies

Systems & Query Engines
Rust Apache Arrow Apache DataFusion Python

Backend & Infrastructure
PostgreSQL FastAPI Docker Git

ML & Specialized Technologies
ONNX Runtime React Solidity IPFS Scilab


Selected Projects

Apache Arrow & DataFusion

Columnar query execution, arithmetic kernels, and engine compatibility across the Apache ecosystem.

Rust Apache Arrow Apache DataFusion

  • Apache DataFusion: Merged fix for benchmark row-count propagation in scalar GCD Criterion benchmarks (#26465); submitted cumulative Utf8 array offset overflow protection in repeat (#27643) and partition metadata handling fixes (#27561).
  • DataFusion-Spark: Merged compatibility fixes matching Spark 4 string charset encoding (#116), datetime interval overflow handling (#118, #119), and active port overflow validation in parse_url (#390).
  • Apache Arrow (Rust): Submitted decimal safe-cast overflow handling under extreme scale expansion in arrow-cast (#12389) and strict duplicate key rejection in Parquet Variant parsing (#12135).

Autonomous satellite radar (SAR) oil spill segmentation and hydrodynamic drift hindcasting platform.

Python FastAPI ONNX Runtime React PostgreSQL

  • Ingestion pipeline for Copernicus Sentinel-1 SAR radar imagery, applying 7x7 Lee speckle filtering and adaptive local Gaussian thresholding to isolate oil slicks from sea clutter.
  • Dual lightweight ONNX Runtime CPU models (SpillUNet and SceneClassifier, ~105 KB total payload) for zero-GPU edge inference.
  • 2D Euler hydrodynamic drift model simulating slick advection and dispersion driven by surface wind shear and ocean current vectors (Open-Meteo CMEMS/MET Norway).
  • Full-stack geospatial architecture combining FastAPI, React, Leaflet GIS, and SQLite/PostgreSQL caching.

Terrain- and weather-aware dynamic multi-modal freight routing engine and forward supply chain decision support.

Python FastAPI PostgreSQL React Docker

  • Dynamic multi-modal graph routing engine (A* search) factoring in Digital Elevation Model (DEM) slope penalties and physical speed floors across difficult terrain.
  • 7-factor dispatch priority queue balancing cargo perishability, medical criticality, contract SLAs, transport cost, and route reliability.
  • PostgreSQL and PostGIS spatial queries (ST_DWithin, ST_LineInterpolatePoint) for real-time waypoint tracking, backed by a 280-test regression suite.

Quantitative time-series forecasting terminal and backtester built in native Scilab with companion Python models.

Scilab Python

  • Pure Scilab numerical engine implementing Ordinary Least Squares (OLS) polynomial trend fitting with exact 95% prediction intervals, Autoregressive AR(p) modeling, and Holt double exponential smoothing.
  • Chronological multi-fold walk-forward validation across market regimes evaluated against naive persistence baselines.
  • Companion work in Python (stock_prediction_python) evaluates LSTM sequence architectures alongside statistical baselines.

Decentralized measurement, reporting, and verification (MRV) registry for blue carbon restoration credits.

Solidity IPFS

  • Solidity 0.8.20 smart contracts enforcing cryptographic verification role separation so field verifiers cannot issue credits for their own assessments.
  • Immutable, content-addressed storage integration via IPFS (Kubo RPC & Pinata) for remote-sensing evidence and field survey proofs.

Connect

Pinned Loading

  1. airbytehq/airbyte airbytehq/airbyte Public

    Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.

    Python 22.4k 5.6k

  2. modelscope/ms-swift modelscope/ms-swift Public

    Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.8, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM5.3, Gemma4, Llava, P…

    Python 16.1k 1.8k

  3. huggingface/transformers huggingface/transformers Public

    🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

    Python 169k 35.3k

  4. huggingface/diffusers huggingface/diffusers Public

    🤗 Diffusers: State-of-the-art diffusion models for image, video, and audio generation in PyTorch.

    Python 35k 7.5k

  5. Lightning-AI/pytorch-lightning Lightning-AI/pytorch-lightning Public

    Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.

    Python 31.5k 3.9k

  6. mlflow/mlflow mlflow/mlflow Public

    The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while control…

    Python 28.9k 6.6k