ComputeBay
Go · TypeScript · PostgreSQL · Node.js · Docker · RabbitMQ
Distributed compute platform enabling execution of containerized jobs across decentralized worker nodes — run jobs, services, and host apps on other people's computers
Key Highlights & Core Contributions
- Decentralized Job Execution: Built a distributed compute platform enabling execution of containerized jobs across decentralized worker nodes letting users run jobs, services, and host apps on other people's computers.
- Event-Driven Microservices: Designed an event-driven microservices architecture using RabbitMQ and transactional outbox for reliable job processing and message delivery.
- Custom Scheduler: Developed a custom scheduler with resource-aware job placement algorithms and real-time cluster state tracking via heartbeat nodes.
- Worker Isolation: Implemented worker agents executing jobs in isolated Docker containers with strict concurrency, memory, CPU, and resource limits.
- Fault Tolerance: Ensured fault tolerance and scalability through retries, state machine enforcement, node health checks, and horizontal scaling support.