This is a hodge podge of several different templates. Take what you need. It's not a one size fits all. Could be for reading files on the network. Pump n dump API data to S3, or who knows. It's meant to jog my own memory if given another project of one of the types valid for this template. I understand it requires alot of additional information that is housed in my brain in order to make sense. Noone sees my resume, right now, anyway... so they probably won't see this, right? Right. Except for the single diff/checkin i just made. haha. gg.
Generic, environment-driven scaffolding for Python services that pull from APIs or filesystems, write to SQL Server, and optionally persist Parquet to AWS S3.
- src/ contains reusable building blocks (context, SQL base class, AWS + filesystem clients, sample extractor + CLI command)
- .devcontainer/ spins up a Python dev container with a companion SQL Server instance via docker-compose
- Dockerfile shows how to ship the project with a console entry point
- tests/ includes AWS + moto samples to keep reference coverage patterns
- bitbucket-pipelines.yml gives a complex CI example to adapt
pip install -e .[dev]
python -m pytest
python-api-scaffolding --help