data engineer
Ref: cc0f6cea7191463baa0d3de0c4028a4e* Maintain, patch legacy data pipelines and design ETL/ELT and build new pipelines that robustly handle different possible modes.
* Proactively monitor our data ingestion & data transformation pipelines and remediate issues
* Transform data using Python/SQL
* Help to onboard new data sources
We are looking for an energetic and creative data engineer who is looking to come with fresh ideas and build new products to get our platform into a new level. Someone that likes to get their hands dirty and is always looking at how to automate processes, in other words you are a problem solver!, * Highly numerate undergraduate STEM degree that involved programming * 3 years of programming experience - Python * Experience with the integration of data from multiple data sources and cloud solutions * Experience working with AWS (S3, kinesis, lambda ,step function, EMR) * Experience working with and (CI/CD) developing continuous integration (CI) and continuous development (CD) environments. Skills * Programming language (Python) * Excellent SQL knowledge, including an understanding of how to write optimized SQL code * Basic understanding of structured and unstructured data. * Being proficient in using AWS services such as S3/Step Functions * Understanding of ETL processes * Strong logical and troubleshooting skills * Eagerness tolearn new technologies and new data paradigms is essential * Able to work independently
* Proactively monitor our data ingestion & data transformation pipelines and remediate issues
* Transform data using Python/SQL
* Help to onboard new data sources
We are looking for an energetic and creative data engineer who is looking to come with fresh ideas and build new products to get our platform into a new level. Someone that likes to get their hands dirty and is always looking at how to automate processes, in other words you are a problem solver!, * Highly numerate undergraduate STEM degree that involved programming * 3 years of programming experience - Python * Experience with the integration of data from multiple data sources and cloud solutions * Experience working with AWS (S3, kinesis, lambda ,step function, EMR) * Experience working with and (CI/CD) developing continuous integration (CI) and continuous development (CD) environments. Skills * Programming language (Python) * Excellent SQL knowledge, including an understanding of how to write optimized SQL code * Basic understanding of structured and unstructured data. * Being proficient in using AWS services such as S3/Step Functions * Understanding of ETL processes * Strong logical and troubleshooting skills * Eagerness tolearn new technologies and new data paradigms is essential * Able to work independently
data engineer
Ref: cc0f6cea7191463baa0d3de0c4028a4eLondon, England
Omnicom Media Group UK (OMG)
Information Technology & Digital