3 min read
Cutting a nightly job from 5.5 hours to 3
What I learned parallelizing a pl/pgsql and C-shell batch pipeline that had quietly grown past its window.
- #PostgreSQL
- #Performance
- #Shell
Notes
Occasional notes on backend systems, cloud infrastructure, and whatever I've just spent too long debugging.
What I learned parallelizing a pl/pgsql and C-shell batch pipeline that had quietly grown past its window.