Job Description

Responsibilities

• Lead data architecture, design, and deployment of scalable, high-throughput Big Data systems in production.
• Architect, deploy, and manage vector, NoSQL, and document database systems supporting AI infrastructure.
• Develop end-to-end ETL/ELT pipelines, API services, and data ingestion frameworks.
• Design storage and processing layers for data lakes, data warehouses, distributed file systems, and real-time streaming architectures.
• Build feature-rich context pipelines using batch and streaming processing patterns.
• Optimize large distributed queries and data transformations for high performance and low latency.
• Implement data quality frameworks supporting data integrity, reliability, and governance.
• Collaborate with analytics, product, and platform teams to build data models representing customer metrics, hierarchies, and relationships.
• Evaluate modern data-stack tools, distributed computing frameworks, and database technologies.
• Lead technical projects and mentor engineering teams.

Requirements

• Extensive hands-on data engineering experience delivering in complex data environments.
• Deep practical understanding of vector databases, NoSQL databases, and document stores used in AI and machine learning infrastructure.
• Experience building, scaling, and shipping large-scale data platforms in production.
• Deep experience with Apache Spark, Flink, or Hadoop.
• Strong expertise with message brokers and event streaming platforms such as Apache Kafka and Kinesis.
• Extensive experience with workflow orchestration tools such as Apache Airflow and Dagster.
• Expertise with cloud data warehouses such as Snowflake, BigQuery, and Redshift.
• Experience with data lake architectures and technologies such as Databricks, Delta Lake, and Apache Iceberg.
• Advanced SQL skills and proficiency in Python.
• Strong background in software development practices including testing, code review, CI/CD, and Infrastructure as Code.
• Desirable experience with cloud-native infrastructure on AWS, GCP, or Azure.
• Desirable experience implementing data observability, monitoring, and alerting frameworks at scale.
• Familiarity with Anaplan or similar enterprise planning platforms.

Benefits

• The role is open to candidates located in the Eastern or Central time zones.
• Employees within commuting distance of an Anaplan office are expected to work onsite two days per week under a hybrid work model.
• Anaplan provides reasonable accommodation for individuals with disabilities during the application, interview, and employment process.

Job Tags

Similar Jobs