Senior Data Architect & Engineer – Apache Kafka, Spark, Hadoop, NoSQL, Machine Learning, SQL, Presto Full Time

Our well funded ad tech client, backed by one of the largest tech investors in the world, is seeking a Senior Data Architect & Engineer to re-architect their platform for scalability and computational performance.  You will work in partnership with the Product team and collaborate with the members of a globally distributed team across different time zones.  Reporting to the VP of Engineering, you will participate in re-architecting the full stack of technologies, and migrating components to the new architecture as the company scales.

Requirements

• Deep expertise in Big Data tools and technologies
• Experience in all stages of Software Development, knowledge of CS fundamentals
• Hands-on coding experience in Python, Scala or Java on Linux
• Experience with Hadoop, HBase, Hive, Kafka, Presto Spark, SQL or other NoSQL databases
• Experience with high volume/scale transaction processing systems
• Experience working with open source databases, libraries, tools and code bases
• Deep understanding of data warehousing, consumer analytics, knowledge management and near real time data processing

Responsibilities

• Contribute to product design, architecture and implementation.
• Work on improving the products, features, workflow, and the technology stack.
  Build and deploy data pipelines to capture, clean, store and process mobile consumer data from different sources.
• Build an analytics system that uses mobile consumer location, demographic and behavioral data to create mobile audience segments and personas.
• Use ML and AI tools to refine and extend mobile audience segments.
• Practice and enforce Agile and Scrum development methodologies
• Provide hands-on guidance and bring new members of your team up to speed and share the knowledge.
• Cooperate closely with engineering and operations teams in various countries within Asia.