Comment by 0x59

building a rest APIs that aggregates and structures data from the www

- ETL is vanilla Python - Orchestrated with Cron and SIGUSR1 - http is Nginx -> uvicorn-> FastAPI

Data lives in a CAFS indexed with Xapian and my current time to load is ~200ms

It's been A LOT of work all far. I came in with some skills and have learnt a lot along the way