Join a small team to design and build a scalable data lakehouse architecture for cybersecurity products.
Posted by employer 7 months ago
First seen on Joblaze 1 month ago
Last verified on the company career page 1 day ago
Skills & Technologies
Not disclosed in this posting: years of experience, work arrangement, visa sponsorship.
Benefits
Joblaze summary
The Data Pipeline Engineer at Cylake is tasked with designing and maintaining a robust data lakehouse architecture that can handle extensive analytics workloads. This role requires expertise in both batch and real-time processing, along with proficiency in open-source technologies like Apache Iceberg and Kafka. Ideal candidates will have a strong background in building large-scale data systems and excellent programming skills in Python. Cylake offers a unique opportunity to contribute to innovative cybersecurity products within a small, experienced team.
Joblaze insights
Quick facts
From the original posting
Join a small team building the next generation of cybersecurity products from the ground up. Led by industry veterans with a proven track record of success - you will get to architect, build, and deliver hugely impactful products with this world-class team. You will have the opportunity to grow your career and skills along with the company from the very start.
Design, build, and maintain a scalable, open-source data lakehouse architecture supporting petabyte-scale analytics workloads. Responsible for architecting end-to-end data pipelines from ingestion through transformation to consumption, ensuring high performance, reliability, and data quality.
A proven track record of success architecting, building, and running large-scale data systems (PB scale)
Experience with both batch and real-time processing architectures
Experience with open source Data Lakehouse components, including Apache Iceberg, PostgreSQL, Neo4j, Apache Parquet, etc.
Experience with tools for stream processing and data analytics - Apache Kafka, Spark, Flink, etc.
Understanding and experience with data transformation solutions
Excellent programming experience with Python
Strong communication and documentation skills
Experience with CSP data platforms is a plus
Understanding of data lineage, quality, and governance tooling is a plus
Standard company text repeated across Cylake's postings is omitted here.