Senior Data Engineer

Details of the offer

Senior Data Engineer - Galway We are continuously innovating and bringing new data driven products, systems and services to customers that reduce environmental impacts and help achieve their business goals. We are looking for people who share our aspirations, who enjoy the art of discovery and the pursuit of solutions to complex problems by analysing detailed data and transforming it into customer facing solutions and insight that help us build even better products and services. Our R&D teams comprise of multiple disciplines including data science, data engineering, dev ops, firmware, enterprise software, database development, UX, mobile application, Standards and compliance and product cybersecurity. Let's work together to make a positive impact on the world. The Role We are seeking a Senior Data Engineer to join our Data Science team in telematics division. Our division is at the forefront of leveraging data to enhance the efficiency and reliability of our products. The ideal candidate will have a passion for working in white space, creating impact from the ground up, and transforming data driven outcomes into fully scalable and optimized solutions for always-on production environments. You will have extensive experience in data engineering, particularly within the cloud ecosystem (we are on AWS), and will be proficient in Python, SQL, and Linux. You will be responsible for designing, developing, and maintaining our data infrastructure, ensuring data quality, and supporting data-driven decision-making across the organization. In this role you will have strong opportunities for both technical and personal growth, where you will be empowered to have the freedom to innovate, using data mining and Machine Learning technologies to gather data insights. Key Responsibilities • Design, develop, and maintain scalable data pipelines and ETL processes using open source and AWS services. • Orchestrate data workflows and pipelines. • Optimize and manage databases and data warehouses. • Implement data transformation workflows. • Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions. • Ensure data quality, integrity, and security across all data platforms. • Develop and maintain documentation for data engineering processes and systems. • Monitor and troubleshoot data pipelines and workflows to ensure reliability and performance. • Implement and manage CI/CD pipelines to automate the deployment and testing of data engineering solutions. • Mentor and provide guidance to other team members Qualifications: • Bachelor's or Master's degree in Computer Science, Engineering, or a related field. • 5+ years of experience in data engineering or a related role. • Strong proficiency in Python and SQL. • Experience with NoSQL databases, Amazon Redshift and DynamoDB • Hands on experience with cloud-based architectures and software stacks • Deep understanding of large always-on enterprise system architecture • Proficiency in Linux server environments. • Experience with containerization technologies such as Docker. • Hands-on experience with data transformation, such as DBT. • Experience with Prefect or similar orchestration tools. • Strong understanding of ETL/ELT processes, data warehousing concepts and best practices. • Experience with CI/CD pipelines and version control systems like Git. • Excellent problem-solving skills and attention to detail. • Strong experience modelling machine behavioural data • Understanding of data governance and security • Understanding of infrastructure-as-code • Experience with monitoring and alerting systems • Strong understanding of big data processing techniques • Proficient with machine learning techniques • Experience with a wide variety of statistical languages and data mining tools For more information/to be considered, hit APPLY today! Or email your CV to ****** *please note you must be eligible to work full time in Ireland (EU/Stamp 4)

#J-18808-Ljbffr


Nominal Salary: To be agreed

Requirements

Dynamics 365 Ce Developer

Dynamics 365 CE Developer, up to €70K, Hybrid, Galway, Ireland Pearson Carter are currently working with a leading Microsoft, Canon and Dell Partner, providi...


Pearson Carter - County Galway

Published 21 days ago

Full Stack Developer (Ruby On Rails)

Need a CRM? Book a FREE intro call with our CRM experts. Used by small businesses in more than 80 countries, OnePageCRM is the first action-focused CRM in th...


Onepagecrm - County Galway

Published 21 days ago

Finnish Technical Support Associate

Technical Support Associate – Finnish - 12 months Overview My client is multinational medical devices and health care company based in Galway, Ireland, they ...


Cpl Healthcare - County Galway

Published 22 days ago

Senior Software Engineer - Daily Rate Contract

Senior Full Stack Engineer - Galway Our client, a multinational financial services company based in Galway, is looking for a Senior Software Engineer to lead...


Cpl Healthcare - County Galway

Published 22 days ago

Built at: 2024-11-20T22:02:12.170Z