Amazon Agency / E-Commerce Data Infrastructure
ContextBuilt for an Amazon agency that manages advertising and sales data for 30+ brands across multiple European marketplaces. Their data pipeline pulls reports from Amazon's SP-API, Advertising API, and Data Kiosk into BigQuery for analytics and reporting.
The ChallengeAmazon changes their API schemas 2-3 times per year without warning. Fields get renamed, added, or removed — and the pipeline breaks silently. The team discovers the issue when clients report missing data in their dashboards, sometimes hours or days later.
Pain Points