דאטה

Senior Data Engineer

145596

תאריך עדכון

08/07/2020

תיאור המשרה

Our BI engineering Team aims to provide self-service analytics and reporting at an enterprise level to help drive quality, reliability, usability and profitable growth of the different products. While working as a peer to both technical and non-technical staff throughout the company, you will drive the improvement process of multiple products and business operations. You will help define data access and discoverability requirements and work to create data infrastructure and data validation services that provide access to event streams.
 
What you'll do
  • Provide technical leadership to the BI engineering team and actively lead design discussions
  • Ensure adherence to coding best practices and development of reusable code
  • Constantly monitor data platform and make recommendations to enhance system architecture
  • Work closely with other BI engineers, BI analysts, and business stakeholders to understand and plan technical requirements for BI projects
  • Provide decision analysis and decision support to business stakeholders using BI and other data
  • Learn quickly and deeply about our software platform
  • Contribute software designs, code, tooling, testing, and operational support to a multi-terabyte BI data platform
  • Work closely with the data engineering team based in New York to solve data problems collaboratively
  • Collaborative work: iterative development, design and code review sessions
 
Requirements
  • 5+ years of engineering experience in a fast-paced environment; 3+ years of experience in scalable data architecture, fault-tolerant ETL, and monitoring of data quality in the cloud
  • Working knowledge of design patterns and coding best practices
  • Experience with Airflow, Celery, or other Python-based task processing systems
  • Proficiency in SQL
  • Proficiency in Python
  • Proficiency with modern source control systems, especially Git
  • Experience working with non-technical business stakeholders on technical projects
  • Proficient in English
Bonus Points (Nice Skills to Have, but Not Needed):
  • Cloud-based devops: AWS or Google Cloud Platform
  • Relational database design
  • Kafka, Kinesis, PubSub and other durable, scalable messaging systems Spark
  • Redshift, Vertica, Snowflake, CitusDB, or other distributed columnar-store databases
Basic Linux/Unix system administration skills
שלח קורות חיים
המשרה מיועדת לנשים ולגברים כאחד