תאריך עדכון | 01/09/2020 |
תיאור המשרה | Main responsibilities:
• Evolving our ETL pipeline
• Working closely with Data Scientists to provide them with a lean Feature Engineering and ML platfor
• Enabling Threat Analysts and Data Scientists to explore the collected data
o Learning, prototyping and bench marking new data technologies for new business use cases
o Participating in data modeling and data integrity guaranteeing efforts
Working with: Spark, Impala, Python3, Kafka, Kubernetes, Azure
Main requirements:
Proven strong back-end software engineering skills, ability to think for yourself and challenge common assumptions, commit to high quality execution and embrace collaboration.
• Software Development, Data Engineering, Business Intelligence - must
• Distributed computing technologies (Spark, Hadoop, Beam etc) – must
• Data modeling, ETL development, data warehousing - must
• Knowledge with NoSql stores (Redis, Mongo, Aerospike etc) – an advantage
• Messaging systems Experience (Kafka, RabbitMQ etc) – an advantage
• Implementing ML pipelines in production Experience - an advantage
|
אפשר לעזור?