C++ and operating systems
Financial Tick Data Pipeline
A compact Linux pipeline that coordinates processes, IPC, worker threads, and aggregation to turn tick CSV records into per-symbol summaries.
- systems programming
- data
- databases
- product
- people
01
The topology
I built a dispatcher that prepares IPC resources and launches ingester, processor, and reporter processes. The processor combines a bounded producer-consumer queue with worker threads before publishing shared-memory output.
02
Why it matters
The project is small, but it gives me concrete evidence that my strongest language is grounded in processes, memory, concurrency primitives, cleanup, and data aggregation—not only syntax exercises.
03
Aggregation
I summarize records per symbol with volume, count, high, low, and volume-weighted average price. This is systems-oriented data processing, not machine learning.
04
Known limits
With one observed commit and no documented benchmark, I do not claim production or performance results. The next useful step for me is a reproducible run and an honest throughput experiment.
Technical notes
Core stack
C++17- POSIX IPC
- pthreads
CMake