Case study · Data pipelines
Job Aggregator.
Four job sources. One organised feed.
4job sources
1SQLite database
0copy and paste
RemoteOKWe Work RemotelyGreenhouseLever
jobs.sqlite 0 rows
- 1
Pull
Listings are fetched from RemoteOK, We Work Remotely, Greenhouse and Lever.
- 2
Shape
Each listing is put into the same set of fields.
- 3
Store
Everything is saved in one SQLite database.
- 4
Search
One feed to browse instead of four sites.
01 / The problem
Job listings are scattered across different boards, making manual collection repetitive.
02 / What we built
- A Python pipeline that writes straight to SQLite
- Job boards and company hiring systems side by side
- One file you can open in any database tool
NEXT PROJECT
Clipper
Cuts one long video into many short clips.