loading

Pipeline health

Live status of every data source feeding the CSS E2G parts and supplier analysis.

Sources

Loading…

Status reads backlog before age, because a pipeline that has caught up looks identical to one that has stopped if you only measure freshness. A one time load with nothing left to pull reads complete. A recurring source with an empty backlog reads caught up and shows when it fires next, so a quiet day never gets mistaken for a dead job.

Work queues

Scrapers

DIBBS blocks cloud traffic and rate limits by address, so it is pulled from two machines that coordinate to stay on separate networks.

Last 24 hours