Key Responsibilities
Core Data Management
- Automate the creation and processing of core trading data within our Clickhouse Cluster.
- Ensure data across the platform is highly available, accurate, and consistent.
Observability
- Develop and manage the LGTM stack (Loki, Grafana, Tempo, Mimir) to deliver comprehensive logging, metrics, and tracing for system monitoring and intelligence.
- Design and maintain dashboards and alerts to oversee services and forecast needs for reliability, scalability, and performance.
Analytics and Experimentation
- Create and manage an analytics and experimentation platform to gain insights into user behavior and enhance their experience with the product.
- Collaborate with data scientists and product teams to generate data-driven insights and strategies.
Low Latency Messaging Infrastructure
- Build and maintain messaging infrastructure to meet the high throughput and low latency demands of our trading environment.
- Optimize system performance and ensure dependable message delivery across various conditions.
Cross-Team Collaboration
- Work with other teams to enhance performance, automation, and efficiency organization-wide.
- Partner with the Product Engineering team to develop, test, and improve our SDK and other client-facing systems.
Qualifications
Professional Experience
- At least 5 years of experience in platform or data engineering, or a similar field.
- Experience developing production software in Go, with knowledge of other programming languages.
Technical Skills
- Expertise in database systems like Clickhouse and messaging protocols.
- Experience with tools or services for metric collection and monitoring.
- Strong grasp of API architecture and testing tools.
Problem-Solving and Collaboration
- Excellent analytical and problem-solving skills, with the capability to address complex technical issues.
- Proven track record of working effectively in cross-functional teams and managing multiple stakeholders.
- A thoughtful and empathetic approach to design and implementation.
Additional Skills
- Experience with modern software development infrastructure (e.g., development environments, CI, testing, deployment).
- Understanding of challenges in managing and evolving scalable and reliable data storage systems.
- Willingness and ability to learn new languages and technologies.
Bonus Points
- Experience in the financial technology sector, particularly in high-frequency trading or cryptocurrency exchanges.
- Knowledge of blockchain technology and the cryptocurrency ecosystem.
- Experience with real-time data processing systems and streaming technologies.