BigData Developer with Python and SQL (Kyiv, Lviv, Kharkiv)

Необхідні навички

— 3+ years of experience of developing in Python to transform large datasets on distributed and cluster infrastructure
— 5+ years of experience in engineering ETL data pipelines for Big Data Systems
— Proficient in SQL. Have some experience performing data transformations and data analysis using SQL
— Comfortable in juggling multiple technologies and high priority tasks

Буде плюсом

— 5+ years of Object Oriented Programming experience in any of languages such as Java, Scala, C++
— Prior experience of designing and building ETL infrastructure involving streaming systems such as Kafka, Spark, AWS Kinesis

Пропонуємо

— Work with a highly motivated and dedicated team
— Competitive salary
— Flexible schedule
— Benefits program
— Social package — medical insurance, sports
— Corporate social events
— Professional development opportunities
— Opportunity for long business trips to the US and possibility for relocation

Обов’язки

— Develop ETL (Extract, Transform and Load) Data pipelines in Spark, Kinesis, Kafka, custom Python apps to transfer massive amounts of data (over 20TB/ month) most efficiently between systems
— Engineer complex and efficient and distributed data transformation solutions using Python, Java, Scala, SQL
— Productionalize Machine Learning models efficiently utilizing resources in clustered environment
— Research, plan, design, develop, document, test, implement and support proprietary software applications
— Analytical data validation for accuracy and completeness of reported business metrics
— Open to taking on, learn and implement engineering projects outside of core competency
— Understand the business problem and engineer/architect/build an efficient, cost-effective and scalable technology infrastructure solution
— Monitor system performance after implementation and iteratively devise solutions to improve performance and user experience
— Research and innovate new data product ideas to grow client’s revenue opportunities and contribute to company’s intellectual property






Про вакансію:

Локація: Київ, Львів, Харьків
Зайнятість: повна