Data Engineering Intern
Guardian Life
– · New York, NY
Shipped a PySpark CDC utility and a row-level quarantine framework to production, and built the backend for an LLM reporting service that generated executive decks.
- Built a CDC utility that can be applied in ELT pipelines across staging tables in Databricks on Azure using PySpark and SQL, processing hundreds of thousands of policy records for the FPRS and CSWM data team.
- Built a quarantine framework utility for row-level failures that can automate hundreds of thousands of data quality validations; passed UAT, and deployed to production.
- Scheduled pipeline runs with Control-M and deployed through Jenkins.
- Assisted in building the backend for a five-person intern capstone, an LLM-powered reporting service that ingested data in row batches through REST APIs and returned executive summary insights, then auto-generated stakeholder PowerPoint decks.
- Developed product-specific prompt endpoints, delivering the dental line first with the service designed to extend to additional coverage lines, and built polling APIs to track long-running generation jobs.