We are looking for an experienced data engineer for a big data product.
Specific Responsibilities include, but are not limited to, the following:
Create cloud data lake architecture using AWS services
Designing, develop and maintaining big data models, ETL flows and front end infrastructure.
Administer performance and capacity management of the analytics services to provide a stable production environment.
Evaluate and make recommendations such as the acquisition and/or adoption of new tools and technologies.
Work closely with business users and other stakeholders to understand business processes, and translate them into functional and non-functional specifications for analytics solutions.
Your Profile
The successful candidate will possess the following combination of education and experience:
Proven experience as BI/ analytics developer
Experience working with AWS services , including: S3,Glue,EC2, Lambda and Kinesis
Strong programming techniques and languages : SQL ,Python
Knowledge of system availability, scalability and security.
Experience/knowledge of a combination of the following will be advantageous: virtualization technologies, networks, Linux ,artificial intelligence, machine learning and other natural language processing tools; experience with Hadoop and SPARK.
Degree in Industrial engineering, Management Information Systems, Computer Science or closely related field preferred